Как я могу исправить это исключение при запуске spark-job-server?
Я пытаюсь запустить сервер spark-job-server на моей машине с Linux. Я сделал следующее:
- Установил CDH дистрибутива Cloudera (5.x) и запустил его
- загруженный
spark-job-server
из вышеупомянутого GitHub - Извлек проект в какую-то папку
- Установил sbt-0.13.8 и установил переменную пути и смог запустить команду sbt
- Зашел в каталог проектов (
spark-job-server/
) и запустил команду sbt - В оболочке SBT я набрал "re-start", что предполагает запуск
spark-job-server
,
Затем я получил это исключение:
:: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: org.apache.hadoop#hadoop-mapreduce-client-app;2.2.0: not found
[warn] :: org.apache.hadoop#hadoop-yarn-api;2.2.0: not found
[warn] :: org.apache.hadoop#hadoop-mapreduce-client-core;2.2.0: not found
[warn] :: org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.2.0: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn]
[warn] Note: Unresolved dependencies path:
[warn] org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0
[warn] +- org.apache.hadoop:hadoop-client:2.2.0
[warn] +- org.apache.spark:spark-core_2.10:1.3.1 (/home/analytics/data_dir/spark-jobserver-master/project/Build.scala#L186)
[warn] +- spark.jobserver:job-server-api_2.10:0.5.2-SNAPSHOT
[warn] org.apache.hadoop:hadoop-yarn-api:2.2.0
[warn] +- org.apache.hadoop:hadoop-client:2.2.0
[warn] +- org.apache.spark:spark-core_2.10:1.3.1 (/home/analytics/data_dir/spark-jobserver-master/project/Build.scala#L186)
[warn] +- spark.jobserver:job-server-api_2.10:0.5.2-SNAPSHOT
[warn] org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0
[warn] +- org.apache.hadoop:hadoop-client:2.2.0
[warn] +- org.apache.spark:spark-core_2.10:1.3.1 (/home/analytics/data_dir/spark-jobserver-master/project/Build.scala#L186)
[warn] +- spark.jobserver:job-server-api_2.10:0.5.2-SNAPSHOT
[warn] org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0
[warn] +- org.apache.hadoop:hadoop-client:2.2.0
[warn] +- org.apache.spark:spark-core_2.10:1.3.1 (/home/analytics/data_dir/spark-jobserver-master/project/Build.scala#L186)
[warn] +- spark.jobserver:job-server-api_2.10:0.5.2-SNAPSHOT
[warn] Credentials file /root/.bintray/.credentials does not exist
[warn] Credentials file /root/.bintray/.credentials does not exist
[warn] Credentials file /root/.bintray/.credentials does not exist
[trace] Stack trace suppressed: run last job-server-api/*:update for the full output.
[trace] Stack trace suppressed: run last akka-app/*:update for the full output.
[trace] Stack trace suppressed: run last job-server-api/*:update for the full output.
[trace] Stack trace suppressed: run last akka-app/*:update for the full output.
[error] (job-server-api/*:update) sbt.ResolveException: unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-app;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-yarn-api;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-core;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.2.0: not found
[error] (akka-app/*:update) sbt.ResolveException: unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-app;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-yarn-api;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-core;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.2.0: not found
[error] (job-server-api/*:update) sbt.ResolveException: unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-app;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-yarn-api;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-core;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.2.0: not found
[error] (akka-app/*:update) sbt.ResolveException: unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-app;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-yarn-api;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-core;2.2.0: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.2.0: not found
[error] Total time: 5 s, completed Aug 6, 2015 1:29:26 PM
Еще немного информации:
- Я вручную загрузил эти зависимости и разместил их
- когда я снова запускаю команду рестарта, sbt не может найти ту же зависимость, которую я скопировал в
.ivy2
папка
Как я могу это исправить?