hadoop安裝過程word版-資料下載頁
2025-08-18 16:27本頁面
【正文】 nput文件夾上傳到了hadoop文件系統(tǒng),文件夾命名為in)root@zhuweiVirtualBox:/home/app/ bin/hadoop jar wordcount in out(運行wordcount計數(shù)in 文件夾,結(jié)果輸出至out目錄)root@zhuweiVirtualBox:/home/app/ bin/hadoop jar wordcount in outWarning: $HADOOP_HOME is deprecated.12/06/14 10:09:22 INFO : Total input paths to process : 212/06/14 10:09:23 INFO : Running job: job_201206131736_000112/06/14 10:09:24 INFO : map 0% reduce 0%12/06/14 10:10:00 INFO : map 100% reduce 0%12/06/14 10:10:30 INFO : map 100% reduce 100%12/06/14 10:10:36 INFO : Job plete: job_201206131736_000112/06/14 10:10:37 INFO : Counters: 2912/06/14 10:10:37 INFO : Job Counters 12/06/14 10:10:37 INFO : Launched reduce tasks=112/06/14 10:10:37 INFO : SLOTS_MILLIS_MAPS=4968612/06/14 10:10:37 INFO : Total time spent by all reduces waiting after reserving slots (ms)=012/06/14 10:10:37 INFO : Total time spent by all maps waiting after reserving slots (ms)=012/06/14 10:10:37 INFO : Launched map tasks=212/06/14 10:10:37 INFO : Datalocal map tasks=212/06/14 10:10:37 INFO : SLOTS_MILLIS_REDUCES=2743612/06/14 10:10:37 INFO : File Output Format Counters 12/06/14 10:10:37 INFO : Bytes Written=4012/06/14 10:10:37 INFO : FileSystemCounters12/06/14 10:10:37 INFO : FILE_BYTES_READ=7812/06/14 10:10:37 INFO : HDFS_BYTES_READ=26712/06/14 10:10:37 INFO : FILE_BYTES_WRITTEN=6470012/06/14 10:10:37 INFO : HDFS_BYTES_WRITTEN=4012/06/14 10:10:37 INFO : File Input Format Counters 12/06/14 10:10:37 INFO : Bytes Read=4912/06/14 10:10:37 INFO : MapReduce Framework12/06/14 10:10:37 INFO : Map output materialized bytes=8412/06/14 10:10:37 INFO : Map input records=212/06/14 10:10:37 INFO : Reduce shuffle bytes=8412/06/14 10:10:37 INFO : Spilled Records=1212/06/14 10:10:37 INFO : Map output bytes=8112/06/14 10:10:37 INFO : CPU time spent (ms)=619012/06/14 10:10:37 INFO : Total mitted heap usage (bytes)=32637747212/06/14 10:10:37 INFO : Combine input records=812/06/14 10:10:37 INFO : SPLIT_RAW_BYTES=21812/06/14 10:10:37 INFO : Reduce input records=612/06/14 10:10:37 INFO : Reduce input groups=512/06/14 10:10:37 INFO : Combine output records=612/06/14 10:10:37 INFO : Physical memory (bytes) snapshot=36916428812/06/14 10:10:37 INFO : Reduce output records=512/06/14 10:10:37 INFO : Virtual memory (bytes) snapshot=155859763212/06/14 10:10:37 INFO : Map output records=8root@zhuweiVirtualBox:/home/app/ bin/hadoop dfs cat out/*(查看處理結(jié)果)Warning: $HADOOP_HOME is deprecated.Bye 1Goodby 1Hadoop 2Hello 2World 2cat: File does not exist: /user/root/out/_logsroot@zhuweiVirtualBox:/home/app/ bin/hadoop dfs cat in/*(查看in文件夾下內(nèi)容)Warning: $HADOOP_HOME is deprecated.Hello World Bye WorldHello Hadoop Goodby Hadoop字符集先在系統(tǒng)中生成gbk的local先建立一個中文local文件$ sudo gedit /var/lib/locales/添加以下內(nèi)容：代碼: UTF8 UTF8 UTF8 UTF8 GB2312 GBK GB18030 Big5 Big5然后執(zhí)行：代碼:$ sudo localegen然后重啟x(ctrl+alt+backspace)，在登錄選項里有選擇local的，選GBK就可以了查看vi /etc/profileVi ~/.bash_profile有vim~/.bashrc 修改字符集設(shè)置里面字符集/etc/default/locale 修改/etc/default/locale, 改為：LANG=LANGUAGE=en_US:ensudo rebootlocaleVi /var/lib/locales/Vi /etc/environmentroot@zhuweiVirtualBox:~/Desktop locale顯示系統(tǒng)字符集root@zhuweiVirtualBox:~/Desktop locale a查看系統(tǒng)內(nèi)安裝的locale這樣大家就可以開始hadoop獲取數(shù)據(jù)了 ！GOGOGO
法律信息相關(guān)推薦
鄂ICP備17016276號-1