第一篇? 算力网络与大数据
第 1 章 算力概述 ············································································2
1.1 算力是什么················································································· 3
1.1.1 计算工具的发展历史 ······································································ 3
1.1.2 算力的内涵和外延 ········································································· 5
1.2 无处不在的现代算力····································································· 6
1.2.1 算力的分类 ·················································································· 6
1.2.2 典型算力平台 ··············································································· 8
1.3 算力,新时代的生产力·································································10
1.3.1 算力成为数据经济新引擎 ·······························································10
1.3.2 信息消费持续释放算力需求 ····························································11
1.3.3 算力助力数字世界和物理世界无缝融合 ·············································12
第 2 章 算力网络 ·········································································· 14
2.1 算力网络因何而生·······································································15
2.1.1 连接算力“消费方”和算力“提供方” ·············································15
2.1.2 从“云网”到“算网” ··································································16
2.2 理解算力网络·············································································18
2.2.1 算力网络的概念 ···········································································18
2.2.2 算力网络功能需求 ········································································19
2.2.3 算力网络关键技术 ········································································20
2.2.4 算力网络的体系架构 ·····································································23
2.3 算力网络发展展望·······································································25
2.3.1 算力网络发展阶段 ········································································26
2.3.2 算力网络面临的挑战 ·····································································26
第 3 章 算力网络提升大数据发展 ····················································· 28
3.1 数据融入经济社会发展各领域························································28
3.2 跨地域数据协同··········································································30
3.2.1 云边数据协同 ··············································································30
3.2.2 分布式云数据中心 ········································································31
3.3 跨行业数据流通··········································································33
3.3.1 全链路数据治理,提供高品质数据供给 ·············································34
3.3.2 开展数据资产化作业,释放数据要素化价值 ·······································34
3.3.3 充分利用已有资源与能力,开创数据增值服务体系 ······························35
第二篇? 面向算力网络的大数据关键技术
第 4 章 边缘计算 ·········································································· 38
4.1 边缘计算简介·············································································38
4.1.1 边缘计算的定义及发展趋势 ····························································38
4.1.2 边缘计算与传统云计算的区别 ·························································40
4.2 边缘计算技术特点分析·································································42
4.2.1 低延时性 ····················································································42
4.2.2 去中心化 ····················································································43
4.2.3 低带宽消耗 ·················································································44
4.2.4 高安全可靠性 ··············································································44
4.2.5 非寡头化 ····················································································44
4.2.6 绿色节能 ····················································································45
4.3 边缘大数据技术··········································································45
4.3.1 边缘计算参考技术架构 ··································································45
4.3.2 边缘计算核心技术 ········································································47
4.4 边缘大数据技术应用场景······························································55
4.4.1 智慧园区边缘大数据应用 ·······························································55
4.4.2 平安城市边缘大数据应用 ·······························································58
第 5 章 分布式协同计算 ································································· 64
5.1 分布式协同计算简介····································································64
5.2 分布式协同计算架构····································································66
5.3 分布式协同计算关键技术······························································67
5.3.1 数据跨域协同交换 ········································································67
5.3.2 分布式任务编排调度 ·····································································73
5.3.3 节点分区可用性保障 ·····································································78
5.3.4 异常任务按需重做 ········································································78
5.3.5 协同控制代理 ··············································································79
5.4 分布式协同计算应用场景······························································81
5.4.1 协同计算在智慧交通场景中的应用 ···················································81
5.4.2 协同计算在智能家庭场景中的应用 ···················································82
第 6 章 数据编织 ·········································································· 84
6.1 数据编织技术·············································································84
6.1.1 数据编织的起源 ···········································································84
6.1.2 数据编织的定义 ···········································································85
6.1.3 数据编织需要具备的能力 ·······························································88
6.1.4 数据编织架构关键组成 ··································································93
6.2 数据虚拟化技术实现····································································94
6.2.1 数据虚拟化的定义及能力 ·······························································94
6.2.2 数据虚拟化的技术实现 ··································································97
6.2.3 数据虚拟化开源技术介绍 ····························································· 100
6.3 数据虚拟化应用场景·································································· 104
6.3.1 电信行业应用场景 ······································································ 104
6.3.2 在线教育行业应用场景 ································································ 105
6.3.3 物联网行业应用场景 ··································································· 106
第 7 章 隐私计算 ········································································ 108
7.1 隐私计算的起源与发展······························································· 109
7.1.1 隐私计算的起源 ········································································· 109
7.1.2 隐私计算的政策环境 ··································································· 109
7.1.3 隐私计算的市场发展 ··································································· 111
7.1.4 隐私计算的发展展望 ··································································· 113
7.2 隐私计算体系··········································································· 114
7.2.1 隐私计算的概念 ········································································· 114
7.2.2 隐私计算体系架构 ······································································ 115
7.3 隐私计算技术介绍····································································· 116
7.3.1 多方安全计算 ············································································ 118
7.3.2 联邦学习 ·················································································· 123
7.3.3 可信执行环境 ············································································ 124
7.3.4 区块链技术辅助隐私计算 ····························································· 126
7.4 隐私计算应用场景····································································· 129
7.4.1 金融行业 ·················································································· 129
7.4.2 医疗健康行业 ············································································ 130
7.4.3 政务行业 ·················································································· 131
第三篇? 大数据技术赋能算力网络
第 8 章 湖仓一体的算网数据中心 ··················································· 134
8.1 算力网络数据存算需求······························································· 134
8.1.1 算力网络中的数据 ······································································ 134
8.1.2 数据存算需求 ············································································ 136
8.2 湖仓一体技术介绍····································································· 137
8.2.1 湖仓一体技术发展背景 ································································ 137
8.2.2 湖仓一体技术架构 ······································································ 139
8.2.3 湖仓一体关键技术 ······································································ 143
8.2.4 湖仓一体开源技术 ······································································ 152
8.2.5 湖仓一体应用场景 ······································································ 163
8.3 算力网络数据中心的定位及作用··················································· 166
8.3.1 算力网络数据中心定位 ································································ 166
8.3.2 数据赋能算力网络运行 ································································ 169
8.4 基于湖仓一体技术的算力网络数据中心 ········································· 172
8.4.1 为什么选择湖仓一体技术 ····························································· 172
8.4.2 算力网络数据中心基于湖仓一体技术的具体实现 ······························· 174
第 9 章 算力网络中的数据治理 ······················································ 176
9.1 算力网络数据治理需求······························································· 176
9.2 数据治理技术发展····································································· 177
9.2.1 跨域数据治理 ············································································ 177
9.2.2 调度能力互通与治理应用 ····························································· 179
9.2.3 数据全生命周期安全保障机制 ······················································· 183
9.3 算力网络中数据治理的实践价值··················································· 187
第 10 章 算力网络交易运营中的隐私计算 ········································· 189
10.1 算力网络运营交易介绍 ····························································· 189
10.1.1 算力网络交易模式 ····································································· 189
10.1.2 算力网络交易中的隐私计算架构实现 ············································· 192
10.1.3 算力网络交易中的隐私计算流程 ··················································· 195
10.1.4 算力网络交易中的隐私计算核心功能 ············································· 196
10.1.5 算力网络交易风险及评估 ···························································· 199
10.2 隐私计算技术在算力网络交易中的价值体现 ·································· 202
10.2.1 数据可信流通 ··········································································· 202
10.2.2 数据价值释放 ··········································································· 204
10.2.3 数据存证溯源 ··········································································· 207
第四篇? 算力网络时代大数据应用场景和发展展望
第 11 章 东数西算 ······································································· 212
11.1 东数西算,国家政策引导 ·························································· 212
11.2 围绕五个一体化推进东数西算的实施 ··········································· 214
11.2.1 网络一体化建设,保障大数据的高效传输 ······································· 215
11.2.2 能源一体化,推动大数据的低碳运营 ············································· 217
11.2.3 算力一体化,构建算力一张网 ······················································ 220
11.2.4 数据安全保障数据的安全流通共享 ················································ 222
11.2.5 基于数据要素构建城市大脑 ························································· 224
11.3 东数西算,典型应用场景 ·························································· 225
11.3.1 在线推理向东,离线分析向西 ······················································ 226
11.3.2 资源托管 ················································································· 226
11.3.3 数据存储与灾备 ········································································ 228
第 12 章 加速数字化转型 ······························································ 230
12.1 云边协同数据应用 ··································································· 231
12.1.1 车路协同应用场景 ····································································· 231
12.1.2 IoT 数据本地处理助力智能制造 ···················································· 232
12.1.3 云边协同在云游戏场景中的应用 ··················································· 234
12.2 赋能 AI,推动智能应用 ···························································· 237
12.2.1 助力生命科学 ··········································································· 237
12.2.2 助力绿色计算 ··········································································· 238
12.2.3 推动自动驾驶落地 ····································································· 239
12.3 数字化、智能化推动企业发展 ···················································· 240
12.3.1 知识管理,助力企业智能化“蜕变” ············································· 241
12.3.2 从企业数字化到管理决策智能化 ··················································· 241
第 13 章 让生活环境更美好 ··························································· 244
13.1 智慧家庭 ··············································································· 244
13.1.1 以家庭宽带作为智慧家庭服务的入口 ············································· 245
13.1.2 以互联网电视作为家庭娱乐操作系统 ············································· 245
13.1.3 以能力开放来构筑智慧家庭产业生态 ············································· 246
13.2 智慧社区 ··············································································· 247
13.2.1 智慧物业 ················································································· 248
13.2.2 智慧社区生活 ··········································································· 249
13.2.3 智慧社区管理平台服务 ······························································· 249
第 14 章 “算力网络 + 大数据”发展展望 ········································ 251
14.1 数据安全与隐私保护 ································································ 251
14.2 绿色计算,数字减碳 ································································ 253
