之前运行的好好的,写了些代码,重启了spark服务,后面报错了,醉了NoSuchMethodError: org.apache.spark.SparkContext$.rddToPairRDDFunctions

ios应用猫 发布于 2017/08/08 18:00
阅读 489
收藏 0

finished: takeSample at KMeans.scala:260, took 0.030605 s
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.SparkContext$.rddToPairRDDFunctions(Lorg/apache/spark/rdd/RDD;Lscala/reflect/ClassTag;Lscala/reflect/ClassTag;Lscala/math/Ordering;)Lorg/apache/spark/rdd/PairRDDFunctions;
    at org.apache.spark.mllib.clustering.KMeans.initKMeansParallel(KMeans.scala:267)
    at org.apache.spark.mllib.clustering.KMeans.runBreeze(KMeans.scala:143)
    at org.apache.spark.mllib.clustering.KMeans.run(KMeans.scala:126)
    at org.apache.spark.mllib.clustering.KMeans$.train(KMeans.scala:333)
    at org.apache.spark.mllib.clustering.KMeans$.train(KMeans.scala:343)
    at org.apache.spark.examples.mllib.KMeansExample$.main(KMeansExample.scala:25)
    at org.apache.spark.examples.mllib.KMeansExample.main(KMeansExample.scala)
17/08/08 18:00:00 INFO SparkContext: Invoking stop() from shutdown hook
17/08/08 18:00:00 INFO SparkUI: Stopped Spark web UI at http://192.168.56.1:4041
17/08/08 18:00:00 INFO BlockManagerInfo: Removed broadcast_1_piece0 on 192.168.56.1:22704 in memory (size: 2.4 KB, free: 895.2 MB)
17/08/08 18:00:00 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/08/08 18:00:00 INFO MemoryStore: MemoryStore cleared

加载中
返回顶部
顶部