Created
October 29, 2015 20:10
-
-
Save AudreyBramy/588d4011905750681b6e to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
<amples.SparkPi --master yarn-cluster --driver-memory 1g --executor-memory 1g --executor-cores 1 ./lib/spark-examples-1.5.1-hadoop2.6.0.jar | |
15/10/29 16:04:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable | |
15/10/29 16:04:18 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032 | |
15/10/29 16:04:18 INFO yarn.Client: Requesting a new application from cluster with 1 NodeManagers | |
15/10/29 16:04:18 INFO yarn.Client: Verifying our application has not requested more than the maximum memory capability of the cluster (8192 MB per container) | |
15/10/29 16:04:18 INFO yarn.Client: Will allocate AM container, with 1408 MB memory including 384 MB overhead | |
15/10/29 16:04:18 INFO yarn.Client: Setting up container launch context for our AM | |
15/10/29 16:04:18 INFO yarn.Client: Setting up the launch environment for our AM container | |
15/10/29 16:04:18 INFO yarn.Client: Preparing resources for our AM container | |
15/10/29 16:04:19 INFO yarn.Client: Source and destination file systems are the same. Not copying hdfs:/spark/spark-assembly-1.5.1-hadoop2.6.0.jar | |
15/10/29 16:04:19 INFO yarn.Client: Uploading resource file:/usr/local/spark-1.5.1-bin-hadoop2.6/lib/spark-examples-1.5.1-hadoop2.6.0.jar -> hdfs://sandbox:9000/user/root/.sparkStaging/application_1446148582738_0008/spark-examples-1.5.1-hadoop2.6.0.jar | |
15/10/29 16:04:24 INFO yarn.Client: Uploading resource file:/tmp/spark-8e7b8311-4fd8-46cd-b727-45bf4aa39532/__spark_conf__4806293219571427197.zip -> hdfs://sandbox:9000/user/root/.sparkStaging/application_1446148582738_0008/__spark_conf__4806293219571427197.zip | |
15/10/29 16:04:24 INFO spark.SecurityManager: Changing view acls to: root | |
15/10/29 16:04:24 INFO spark.SecurityManager: Changing modify acls to: root | |
15/10/29 16:04:24 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); users with modify permissions: Set(root) | |
15/10/29 16:04:25 INFO yarn.Client: Submitting application 8 to ResourceManager | |
15/10/29 16:04:25 INFO impl.YarnClientImpl: Submitted application application_1446148582738_0008 | |
15/10/29 16:04:26 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:26 INFO yarn.Client: | |
client token: N/A | |
diagnostics: N/A | |
ApplicationMaster host: N/A | |
ApplicationMaster RPC port: -1 | |
queue: default | |
start time: 1446149065369 | |
final status: UNDEFINED | |
tracking URL: http://sandbox:8088/proxy/application_1446148582738_0008/ | |
user: root | |
15/10/29 16:04:27 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:28 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:29 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:30 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:31 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:32 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:33 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:34 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:35 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:36 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:37 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:38 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:39 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:40 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:41 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:42 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:43 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:44 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:45 INFO yarn.Client: Application report for application_1446148582738_0008 (state: ACCEPTED) | |
15/10/29 16:04:46 INFO yarn.Client: Application report for application_1446148582738_0008 (state: RUNNING) | |
15/10/29 16:04:46 INFO yarn.Client: | |
client token: N/A | |
diagnostics: N/A | |
ApplicationMaster host: 172.17.0.24 | |
ApplicationMaster RPC port: 0 | |
queue: default | |
start time: 1446149065369 | |
final status: UNDEFINED | |
tracking URL: http://sandbox:8088/proxy/application_1446148582738_0008/ | |
user: root | |
15/10/29 16:04:47 INFO yarn.Client: Application report for application_1446148582738_0008 (state: RUNNING) | |
15/10/29 16:04:48 INFO yarn.Client: Application report for application_1446148582738_0008 (state: RUNNING) | |
15/10/29 16:04:49 INFO yarn.Client: Application report for application_1446148582738_0008 (state: RUNNING) | |
15/10/29 16:04:50 INFO yarn.Client: Application report for application_1446148582738_0008 (state: RUNNING) | |
15/10/29 16:04:51 INFO yarn.Client: Application report for application_1446148582738_0008 (state: RUNNING) | |
15/10/29 16:04:52 INFO yarn.Client: Application report for application_1446148582738_0008 (state: RUNNING) | |
15/10/29 16:04:53 INFO yarn.Client: Application report for application_1446148582738_0008 (state: RUNNING) | |
15/10/29 16:04:54 INFO yarn.Client: Application report for application_1446148582738_0008 (state: RUNNING) | |
15/10/29 16:04:55 INFO yarn.Client: Application report for application_1446148582738_0008 (state: RUNNING) | |
15/10/29 16:04:56 INFO yarn.Client: Application report for application_1446148582738_0008 (state: RUNNING) | |
15/10/29 16:04:57 INFO yarn.Client: Application report for application_1446148582738_0008 (state: FINISHED) | |
15/10/29 16:04:57 INFO yarn.Client: | |
client token: N/A | |
diagnostics: N/A | |
ApplicationMaster host: 172.17.0.24 | |
ApplicationMaster RPC port: 0 | |
queue: default | |
start time: 1446149065369 | |
final status: SUCCEEDED | |
tracking URL: http://sandbox:8088/proxy/application_1446148582738_0008/A | |
user: root | |
15/10/29 16:04:57 INFO yarn.Client: Deleting staging directory .sparkStaging/application_1446148582738_0008 | |
15/10/29 16:04:58 INFO util.ShutdownHookManager: Shutdown hook called | |
15/10/29 16:04:58 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-8e7b8311-4fd8-46cd-b727-45bf4aa39532 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment