Cannot obtain block length for LocatedBlock{BP-537859293-192.168.10.121-

知行合一1 发布于 2017/02/07 14:59
阅读 191
收藏 0

 Cannot obtain block length for LocatedBlock{BP-537859293-192.168.10.121-1482894356867:blk_1073809710_68890; getBlockSize()=235; corrupt=false; offset=0; locs=[DatanodeInfoWithStorage[192.168.10.122:50010,DS-77b80087-d851-492a-8e41-e9a8d8b595bd,DISK], DatanodeInfoWithStorage[192.168.10.124:50010,DS-0ebbe3dc-3930-4d13-9447-98efa10e7a23,DISK], DatanodeInfoWithStorage[192.168.10.123:50010,DS-58998fcf-fac9-4af8-88f4-b0793c076fe5,DISK]]}
    at org.apache.hadoop.hdfs.DFSInputStream.readBlockLength(DFSInputStream.java:427)
    at org.apache.hadoop.hdfs.DFSInputStream.fetchLocatedBlocksAndGetLastBlockLength(DFSInputStream.java:335)
    at org.apache.hadoop.hdfs.DFSInputStream.openInfo(DFSInputStream.java:271)
    at org.apache.hadoop.hdfs.DFSInputStream.<init>(DFSInputStream.java:263)
    at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:1584)
    at org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:309)
    at org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:305)
    at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
    at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:305)
    at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:780)
    at org.apache.spark.scheduler.EventLoggingListener$.openEventLog(EventLoggingListener.scala:317)
    at org.apache.spark.deploy.history.FsHistoryProvider.org$apache$spark$deploy$history$FsHistoryProvider$$replay(FsHistoryProvider.scala:572)
    at org.apache.spark.deploy.history.FsHistoryProvider$$anonfun$14.apply(FsHistoryProvider.scala:405)
    at org.apache.spark.deploy.history.FsHistoryProvider$$anonfun$14.apply(FsHistoryProvider.scala:402)
    at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)
    at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)
    at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
    at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
    at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:251)
    at scala.collection.AbstractTraversable.flatMap(Traversable.scala:105)
    at org.apache.spark.deploy.history.FsHistoryProvider.org$apache$spark$deploy$history$FsHistoryProvider$$mergeAppl

加载中
返回顶部
顶部