hadoop util.NativeCodeLoader: Unable to load native-hadoop library for your platform...

李血甜 发布于 2013/07/07 20:52
阅读 4K+
收藏 0

win7 本地eclipse 提交任务到虚拟机中的hadoop1.1.2,可以成功运行,但是有警告。

13/07/07 20:27:17 INFO input.FileInputFormat: Total input paths to process : 2

13/07/07 20:27:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

13/07/07 20:27:17 WARN snappy.LoadSnappy: Snappy native library not loaded
13/07/07 20:27:17 INFO mapred.JobClient: Running job: job_201307051904_0005
13/07/07 20:27:18 INFO mapred.JobClient:  map 0% reduce 0%
13/07/07 20:27:23 INFO mapred.JobClient:  map 100% reduce 0%
13/07/07 20:27:30 INFO mapred.JobClient:  map 100% reduce 33%
13/07/07 20:27:32 INFO mapred.JobClient:  map 100% reduce 100%
13/07/07 20:27:32 INFO mapred.JobClient: Job complete: job_201307051904_0005
13/07/07 20:27:32 INFO mapred.JobClient: Counters: 29
13/07/07 20:27:32 INFO mapred.JobClient:   Job Counters 
13/07/07 20:27:32 INFO mapred.JobClient:     Launched reduce tasks=1
13/07/07 20:27:32 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=7738
13/07/07 20:27:32 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
13/07/07 20:27:32 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
13/07/07 20:27:32 INFO mapred.JobClient:     Launched map tasks=2
13/07/07 20:27:32 INFO mapred.JobClient:     Data-local map tasks=2
13/07/07 20:27:32 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=8502
13/07/07 20:27:32 INFO mapred.JobClient:   File Output Format Counters 
13/07/07 20:27:32 INFO mapred.JobClient:     Bytes Written=37
13/07/07 20:27:32 INFO mapred.JobClient:   FileSystemCounters
13/07/07 20:27:32 INFO mapred.JobClient:     FILE_BYTES_READ=71
13/07/07 20:27:32 INFO mapred.JobClient:     HDFS_BYTES_READ=269
13/07/07 20:27:32 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=158359
13/07/07 20:27:32 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=37
13/07/07 20:27:32 INFO mapred.JobClient:   File Input Format Counters 
13/07/07 20:27:32 INFO mapred.JobClient:     Bytes Read=41
13/07/07 20:27:32 INFO mapred.JobClient:   Map-Reduce Framework
13/07/07 20:27:32 INFO mapred.JobClient:     Map output materialized bytes=77
13/07/07 20:27:32 INFO mapred.JobClient:     Map input records=3
13/07/07 20:27:32 INFO mapred.JobClient:     Reduce shuffle bytes=77
13/07/07 20:27:32 INFO mapred.JobClient:     Spilled Records=10
13/07/07 20:27:32 INFO mapred.JobClient:     Map output bytes=65
13/07/07 20:27:32 INFO mapred.JobClient:     CPU time spent (ms)=980
13/07/07 20:27:32 INFO mapred.JobClient:     Total committed heap usage (bytes)=337190912
13/07/07 20:27:32 INFO mapred.JobClient:     Combine input records=6
13/07/07 20:27:32 INFO mapred.JobClient:     SPLIT_RAW_BYTES=228
13/07/07 20:27:32 INFO mapred.JobClient:     Reduce input records=5
13/07/07 20:27:32 INFO mapred.JobClient:     Reduce input groups=4
13/07/07 20:27:32 INFO mapred.JobClient:     Combine output records=5
13/07/07 20:27:32 INFO mapred.JobClient:     Physical memory (bytes) snapshot=325242880
13/07/07 20:27:32 INFO mapred.JobClient:     Reduce output records=4
13/07/07 20:27:32 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1121177600
13/07/07 20:27:32 INFO mapred.JobClient:     Map output records=6


想知道警告的产生原因及解决方法

加载中
0
猫哥-u
猫哥-u

snappy.LoadSnappy  应该是你写的一个map reduce吧,提示Snappy native library not loaded

启动脚本是否已经添加了你编译出来的jar包

猫哥-u
猫哥-u
回复 @李血甜 : http://blog.csdn.net/jiedushi/article/details/7496327
李血甜
李血甜
不是我写的。我只是运行一个自带的例子,wordcount,这个是它自己报出来的。
返回顶部
顶部