程序師世界是廣大編程愛好者互助、分享、學習的平台,程序師世界有你更精彩!
首頁
編程語言
C語言|JAVA編程
Python編程
網頁編程
ASP編程|PHP編程
JSP編程
數據庫知識
MYSQL數據庫|SqlServer數據庫
Oracle數據庫|DB2數據庫
 程式師世界 >> 編程語言 >> 更多編程語言 >> 編程綜合問答 >> spark-Spark平台下運行WordCount時遇到如下的報錯該如何處理?求各路大神指教。。。

spark-Spark平台下運行WordCount時遇到如下的報錯該如何處理?求各路大神指教。。。

編輯:編程綜合問答
Spark平台下運行WordCount時遇到如下的報錯該如何處理?求各路大神指教。。。

還有另外幾個WARN
15/05/19 11:19:19 INFO TaskSchedulerImpl: Adding task set 1.0 with 2 tasks
15/05/19 11:19:33 INFO AppClient$ClientActor: Connecting to master spark://172.18.219.136:7077...
15/05/19 11:19:34 WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient memory
15/05/19 11:19:49 WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient memory
15/05/19 11:19:53 INFO AppClient$ClientActor: Connecting to master spark://172.18.219.136:7077...
15/05/19 11:20:04 WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient memory
15/05/19 11:20:13 ERROR SparkDeploySchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up.
15/05/19 11:20:13 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool
15/05/19 11:20:13 INFO TaskSchedulerImpl: Cancelling stage 1
15/05/19 11:20:13 INFO DAGScheduler: Failed to run collect at WordCount.scala:31
Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: All masters are unresponsive! Giving up.

最佳回答:


http://taoistwar.gitbooks.io/spark-operationand-maintenance-management/content/spark_relate_software/hadoop_2x_install.html
spark-env.sh,中export SPARK_MASTER_IP= master節點的機器名或IP
如何是機器名,查看一下/etc/hosts有沒有解析主機名

  1. 上一頁:
  2. 下一頁:
Copyright © 程式師世界 All Rights Reserved