hadoop java heap space

linyoupanny 发布于 2014/04/30 14:51
阅读 302
收藏 0
hadoop@h01:/usr/local/hadoop/sbin$ hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-0.23.10.jar wordcount /test/test2.txt /test/out/out15
14/04/30 13:38:33 INFO input.FileInputFormat: Total input paths to process : 1
14/04/30 13:38:33 WARN snappy.LoadSnappy: Snappy native library not loaded
14/04/30 13:38:33 INFO mapreduce.JobSubmitter: number of splits:1
14/04/30 13:38:33 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar
14/04/30 13:38:33 WARN conf.Configuration: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
14/04/30 13:38:33 WARN conf.Configuration: mapreduce.combine.class is deprecated. Instead, use mapreduce.job.combine.class
14/04/30 13:38:33 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
14/04/30 13:38:33 WARN conf.Configuration: mapred.job.name is deprecated. Instead, use mapreduce.job.name
14/04/30 13:38:33 WARN conf.Configuration: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
14/04/30 13:38:33 WARN conf.Configuration: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
14/04/30 13:38:33 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
14/04/30 13:38:33 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
14/04/30 13:38:33 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
14/04/30 13:38:33 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
14/04/30 13:38:34 INFO mapred.ResourceMgrDelegate: Submitted application application_1398836202384_0001 to ResourceManager at localhost/127.0.0.1:54311
14/04/30 13:38:34 INFO mapreduce.Job: The url to track the job: http://localhost:54315/proxy/application_1398836202384_0001/
14/04/30 13:38:34 INFO mapreduce.Job: Running job: job_1398836202384_0001
14/04/30 13:39:12 INFO mapreduce.Job: Job job_1398836202384_0001 running in uber mode : false
14/04/30 13:39:12 INFO mapreduce.Job:  map 0% reduce 0%
14/04/30 13:39:46 INFO mapreduce.Job: Task Id : attempt_1398836202384_0001_m_000000_0, Status : FAILED
Error: Java heap space
14/04/30 13:40:21 INFO mapreduce.Job: Task Id : attempt_1398836202384_0001_m_000000_1, Status : FAILED
Error: Java heap space
14/04/30 13:40:57 INFO mapreduce.Job: Task Id : attempt_1398836202384_0001_m_000000_2, Status : FAILED
Error: Java heap space
14/04/30 13:41:32 INFO mapreduce.Job:  map 100% reduce 100%
14/04/30 13:41:32 INFO mapreduce.Job: Job job_1398836202384_0001 failed with state FAILED due to: Task failed task_1398836202384_0001_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0


14/04/30 13:41:32 INFO mapreduce.Job: Counters: 9
Job Counters 
Failed map tasks=4
Launched map tasks=4
Other local map tasks=3
Data-local map tasks=1
Total time spent by all maps in occupied slots (ms)=265684
Total time spent by all reduces in occupied slots (ms)=0
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0

Virtual memory (bytes) snapshot=0

之前在这里也看到个帖子 和我问题一样 但是按照改了也是不行 还请看看还有什么别的方案 我用的是0.23.10    

加载中
返回顶部
顶部