【正文】 ............................................ 30 . 大數(shù)據(jù)開源 ........................................................................................ 30 . Hadoop將加速發(fā)展 ............................................................................. 30 . 打包的大數(shù)據(jù)行業(yè)分析應(yīng)用 ................................................................ 30 . 大數(shù)據(jù)分析的革命性方法出現(xiàn) ............................................................ 31 . 大數(shù)據(jù)與云計(jì)算 :深度融合 ................................................................. 31 . 大數(shù)據(jù)一體機(jī)陸 續(xù)發(fā)布 ....................................................................... 31 4. 基于基站大數(shù)據(jù)應(yīng)用及案例 .............................................................................. 32 . 氣象災(zāi)害應(yīng)急短信發(fā)布平臺 ....................................................................... 32 . 概述 ................................................................................................... 32 . 項(xiàng)目背景 ............................................................................. 32 . 平臺概述 ............................................................................. 32 . 平臺建設(shè)特點(diǎn)與原則 .......................................................................... 32 . 建設(shè)特點(diǎn) ............................................................................. 32 . 建設(shè)原則 ............................................................................. 32 . 大數(shù)據(jù)管理平臺特點(diǎn) ......................................................... 33 . 平臺整體架構(gòu) ..................................................................................... 33 . 建設(shè)原理 ............................................................................. 33 . 平臺總體設(shè)計(jì) ......................................................................... 35 1. 平臺總體結(jié)構(gòu) .............................................................................. 35 2. 平臺技術(shù)架構(gòu) .................................................... 錯(cuò)誤 !未定義書簽。 ......................................................................... 25 . 高效性。 大數(shù)據(jù)應(yīng)用 解決方案 2 / 38 目 錄 1. 大數(shù)據(jù)概述 ........................................................................................................ 6 . 概述 ............................................................................................................ 6 . 大數(shù)據(jù)定義 ................................................................................................. 6 . 大數(shù)據(jù)技術(shù)發(fā)展 .......................................................................................... 8 2. 大數(shù)據(jù)應(yīng)用 ...................................................................................................... 11 . 大數(shù)據(jù)應(yīng)用闡述 ........................................................................................ 11 . 大數(shù)據(jù)應(yīng)用架構(gòu) ........................................................................................ 13 . 大數(shù)據(jù)行業(yè)應(yīng)用 ........................................................................................ 13 . 醫(yī)療行業(yè) ............................................................................................ 13 . 能源行業(yè) ............................................................................................ 14 . 通信行業(yè) ............................................................................................ 14 . 零售業(yè) ............................................................................................... 15 3. 大數(shù)據(jù)解決方案 ............................................................................................... 16 . 大數(shù)據(jù)技術(shù)組成 ........................................................................................ 16 . 分析技術(shù) ............................................................................................ 16 . 可視化分析 ......................................................................... 16 . 數(shù)據(jù)挖掘算法 ..................................................................... 16 . 預(yù)測分析能力 ..................................................................... 16 . 語義引擎 ............................................................................. 16 . 數(shù)據(jù)質(zhì)量和數(shù)據(jù)管理 ......................................................... 17 . 存儲數(shù)據(jù)庫 ........................................................................................ 17 . 分布式計(jì)算技術(shù) ................................................................................. 18 . 大數(shù)據(jù)處理過程 ........................................................................................ 20 . 采集 ................................................................................................... 20 . 導(dǎo)入 /預(yù)處理 ...................................................................................... 21 . 統(tǒng)計(jì) /分析 .......................................................................................... 21 . 挖掘 ................................................................................................... 21 . 大數(shù)據(jù)處理的核心技術(shù) Hadoop ................................................................. 21 . Hadoop的組成 .................................................................................... 22 . Hadoop的優(yōu)點(diǎn)： ................................................................................ 25 . 高可靠性。 ......................................................................... 25 . 高擴(kuò)展性。 ............................................................................. 25 . 高容錯(cuò)性。 . 平臺技術(shù)思路 ..................................................................... 36 . 平臺技術(shù)路線 ........................................... 錯(cuò)誤 !未定義書簽。 2. 短信發(fā)送多鏈路配置 .......................................... 錯(cuò)誤 !未定義書簽。 4. 參數(shù)可配置 ........................................................ 錯(cuò)誤 !未定義書簽。 . 平臺網(wǎng)絡(luò)拓?fù)?................................................