Container: container_1561461543584_0003_01_000003 on master:8041 这个日志说明了啥?

云原生 发布于 06/26 14:06
阅读 63
收藏 0

 SocketReceiver:54 - Connecting to localhost:9999
2019-06-26 14:03:37 INFO  ReceiverSupervisorImpl:54 - Called receiver 0 onStart
2019-06-26 14:03:37 INFO  ReceiverSupervisorImpl:54 - Receiver started again
2019-06-26 14:03:37 WARN  ReceiverSupervisorImpl:87 - Restarting receiver with delay 2000 ms: Error connecting to localhost:9999
java.net.ConnectException: Connection refused (Connection refused)
    at java.net.PlainSocketImpl.socketConnect(Native Method)
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
    at java.net.Socket.connect(Socket.java:589)
    at java.net.Socket.connect(Socket.java:538)
    at java.net.Socket.<init>(Socket.java:434)
    at java.net.Socket.<init>(Socket.java:211)
    at org.apache.spark.streaming.dstream.SocketReceiver.onStart(SocketInputDStream.scala:61)
    at org.apache.spark.streaming.receiver.ReceiverSupervisor.startReceiver(ReceiverSupervisor.scala:149)
    at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:198)
    at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
    at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
    at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
    at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
2019-06-26 14:03:37 INFO  ReceiverSupervisorImpl:54 - Stopping receiver with message: Restarting receiver with delay 2000ms: Error connecting to localhost:9999: java.net.ConnectException: Connection refused (Connection refused)
2019-06-26 14:03:37 INFO  ReceiverSupervisorImpl:54 - Called receiver onStop
2019-06-26 14:03:37 INFO  ReceiverSupervisorImpl:54 - Deregistering receiver 0
2019-06-26 14:03:37 INFO  ReceiverSupervisorImpl:54 - Stopped receiver 0
2019-06-26 14:03:38 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 269514
2019-06-26 14:03:38 INFO  Executor:54 - Running task 1.0 in stage 269446.0 (TID 269514)
2019-06-26 14:03:38 INFO  TorrentBroadcast:54 - Started reading broadcast variable 134725
2019-06-26 14:03:38 INFO  MemoryStore:54 - Block broadcast_134725_piece0 stored as bytes in memory (estimated size 1767.0 B, free 366.2 MB)
2019-06-26 14:03:38 INFO  TorrentBroadcast:54 - Reading broadcast variable 134725 took 1 ms
2019-06-26 14:03:38 INFO  MemoryStore:54 - Block broadcast_134725 stored as values in memory (estimated size 2.9 KB, free 366.2 MB)
2019-06-26 14:03:38 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 67361, fetching them
2019-06-26 14:03:38 INFO  MapOutputTrackerWorker:54 - Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@master :41797)
2019-06-26 14:03:38 INFO  MapOutputTrackerWorker:54 - Got the output locations
2019-06-26 14:03:38 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2019-06-26 14:03:38 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2019-06-26 14:03:38 INFO  Executor:54 - Finished task 1.0 in stage 269446.0 (TID 269514). 1091 bytes result sent to driver
2019-06-26 14:03:38 INFO  BlockManager:54 - Removing RDD 269443
2019-06-26 14:03:38 INFO  BlockManager:54 - Removing RDD 269442
2019-06-26 14:03:38 INFO  BlockManager:54 - Removing RDD 269441
2019-06-26 14:03:38 INFO  BlockManager:54 - Removing RDD 269440
End of LogType:stdout.This log file belongs to a running container (container_1561461543584_0003_01_000003) and so may not be complete.
***********************************************************************


Container: container_1561461543584_0003_01_000003 on master:8041
LogAggregationType: LOCAL
================================================================
LogType:stderr
LogLastModifiedTime:Tue Jun 25 19:20:54 +0800 2019
LogLength:546
LogContents:
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/data2/yarn/nm/usercache/root/filecache/33315/__spark_libs__2989456323155962.zip/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/lib/slf4j-log4j12.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
End of LogType:stderr.This log file belongs to a running container (container_1561461543584_0003_01_000003) and so may not be complete.
***********************************************************************


Container: container_1561461543584_0003_01_000003 on master:8041
LogAggregationType: LOCAL
================================================================
LogType:prelaunch.out
LogLastModifiedTime:Tue Jun 25 19:20:53 +0800 2019
LogLength:70
LogContents:
Setting up env variables
Setting up job resources
Launching container
End of LogType:prelaunch.out.This log file belongs to a running container (container_1561461543584_0003_01_000003) and so may not be complete.
 

加载中
返回顶部
顶部