Skip to content

Instantly share code, notes, and snippets.

@kmizumar

kmizumar/gist:88cbc5119c130c9d9db28b15d445e3dd

Created January 14, 2022 09:42
Show Gist options
  • Save kmizumar/88cbc5119c130c9d9db28b15d445e3dd to your computer and use it in GitHub Desktop.
Save kmizumar/88cbc5119c130c9d9db28b15d445e3dd to your computer and use it in GitHub Desktop.
Download ZIP
Apache Ozone kubernetes/examples/getting-tarted succeeded output
Raw
gistfile1.txt
~/IdeaProjects/ozone/hadoop-ozone/dist/target/ozone-1.3.0-SNAPSHOT/kubernetes/examples/getting-started master* maru@s500plus
❯ ./test.sh
**** Modifying Kubernetes resources file for test ****
(mounting current Ozone directory to the containers, scheduling containers to one node, ...)
WARNING: this test can be executed only with local Kubernetes cluster
(source dir should be available from K8s nodes)
**** Deleting existing k8s resources ****
No resources found
No resources found
No resources found
service "kubernetes" deleted
configmap "kube-root-ca.crt" deleted
No resources found
No resources found
No resources found
**** Applying k8s resources from getting-started ****
configmap/config created
service/datanode-public created
service/datanode created
statefulset.apps/datanode created
service/om-public created
service/om created
statefulset.apps/om created
service/s3g-public created
service/s3g created
statefulset.apps/s3g created
service/scm-public created
service/scm created
statefulset.apps/scm created
**** Waiting until the k8s cluster is running ****
No resources found in default namespace.
-1 pods are running. Waiting for more.
1 'all_pods_are_running' is failed...
5 pods are running out from the 6
2 'all_pods_are_running' is failed...
5 pods are running out from the 6
3 'all_pods_are_running' is failed...
5 pods are running out from the 6
4 'all_pods_are_running' is failed...
1 'grep_log scm-0 SCM exiting safe mode.' is failed...
2 'grep_log scm-0 SCM exiting safe mode.' is failed...
3 'grep_log scm-0 SCM exiting safe mode.' is failed...
4 'grep_log scm-0 SCM exiting safe mode.' is failed...
5 'grep_log scm-0 SCM exiting safe mode.' is failed...
6 'grep_log scm-0 SCM exiting safe mode.' is failed...
7 'grep_log scm-0 SCM exiting safe mode.' is failed...
8 'grep_log scm-0 SCM exiting safe mode.' is failed...
9 'grep_log scm-0 SCM exiting safe mode.' is failed...
10 'grep_log scm-0 SCM exiting safe mode.' is failed...
11 'grep_log scm-0 SCM exiting safe mode.' is failed...
12 'grep_log scm-0 SCM exiting safe mode.' is failed...
13 'grep_log scm-0 SCM exiting safe mode.' is failed...
2022-01-14 08:56:36 INFO SCMSafeModeManager:248 - SCM exiting safe mode.
2022-01-14 08:56:22 INFO BaseHttpServer:329 - HTTP server of ozoneManager listening at http://0.0.0.0:9874
**** Cluster is up and running ****
**** Executing robot tests scm-0 ****
Defaulted container "scm" out of: scm, init (init)
Defaulted container "scm" out of: scm, init (init)
Defaulted container "scm" out of: scm, init (init)
==============================================================================
Basic :: Smoketest ozone cluster startup
==============================================================================
Check webui static resources | PASS |
------------------------------------------------------------------------------
Start freon testing | PASS |
------------------------------------------------------------------------------
Basic :: Smoketest ozone cluster startup | PASS |
2 tests, 2 passed, 0 failed
==============================================================================
Output: /tmp/report/output.xml
Log: /tmp/report/log.html
Report: /tmp/report/report.html
Defaulted container "scm" out of: scm, init (init)
tar: Removing leading `/' from member names
rm: cannot remove 'result/output.xml': No such file or directory
../testlib.sh: line 145: rebot: command not found
configmap "config" deleted
service "datanode-public" deleted
service "datanode" deleted
statefulset.apps "datanode" deleted
service "om-public" deleted
service "om" deleted
statefulset.apps "om" deleted
service "s3g-public" deleted
service "s3g" deleted
statefulset.apps "s3g" deleted
service "scm-public" deleted
service "scm" deleted
statefulset.apps "scm" deleted
**** Regenerating original Kubernetes resource files ****
~/IdeaProjects/ozone/hadoop-ozone/dist/target/ozone-1.3.0-SNAPSHOT/kubernetes/examples/getting-started master* maru@s500plus 1m 7s
❯
@kmizumar
Copy link
Author 

~/IdeaProjects/ozone/hadoop-ozone/dist/target/ozone-1.3.0-SNAPSHOT/kubernetes/examples/getting-started master* maru@s500plus 1m 7s
❯ diff -r ../getting-started ~/IdeaProjects/ozone/hadoop-ozone/dist/src/main/k8s/examples/getting-started
diff -r ../getting-started/config-configmap.yaml /home/maru/IdeaProjects/ozone/hadoop-ozone/dist/src/main/k8s/examples/getting-started/config-configmap.yaml
30d29
<   OZONE-SITE.XML_ozone.datanode.pipeline.limit: "1"
diff -r ../getting-started/datanode-statefulset.yaml /home/maru/IdeaProjects/ozone/hadoop-ozone/dist/src/main/k8s/examples/getting-started/datanode-statefulset.yaml
44c44
<         image: pfnmaru/ozone:1.3.0-SNAPSHOT
---
>         image: '@docker.image@'
diff -r ../getting-started/Flekszible /home/maru/IdeaProjects/ozone/hadoop-ozone/dist/src/main/k8s/examples/getting-started/Flekszible
22c22
<       image: "pfnmaru/ozone:1.3.0-SNAPSHOT"
---
>       image: "@docker.image@"
30c30
<       image: "pfnmaru/ozone:1.3.0-SNAPSHOT"
---
>       image: "@docker.image@"
diff -r ../getting-started/freon/freon-deployment.yaml /home/maru/IdeaProjects/ozone/hadoop-ozone/dist/src/main/k8s/examples/getting-started/freon/freon-deployment.yaml
37c37
<         image: pfnmaru/ozone:1.3.0-SNAPSHOT
---
>         image: '@docker.image@'
Only in ../getting-started: logs
diff -r ../getting-started/om-statefulset.yaml /home/maru/IdeaProjects/ozone/hadoop-ozone/dist/src/main/k8s/examples/getting-started/om-statefulset.yaml
44c44
<         image: pfnmaru/ozone:1.3.0-SNAPSHOT
---
>         image: '@docker.image@'
Only in ../getting-started: result
diff -r ../getting-started/s3g-statefulset.yaml /home/maru/IdeaProjects/ozone/hadoop-ozone/dist/src/main/k8s/examples/getting-started/s3g-statefulset.yaml
38c38
<         image: pfnmaru/ozone:1.3.0-SNAPSHOT
---
>         image: '@docker.image@'
diff -r ../getting-started/scm-statefulset.yaml /home/maru/IdeaProjects/ozone/hadoop-ozone/dist/src/main/k8s/examples/getting-started/scm-statefulset.yaml
44c44
<         image: pfnmaru/ozone:1.3.0-SNAPSHOT
---
>         image: '@docker.image@'
57c57
<         image: pfnmaru/ozone:1.3.0-SNAPSHOT
---
>         image: '@docker.image@'

~/IdeaProjects/ozone/hadoop-ozone/dist/target/ozone-1.3.0-SNAPSHOT/kubernetes/examples/getting-started master* maru@s500plus
❯ diff ../testlib.sh ~/IdeaProjects/ozone/hadoop-ozone/dist/src/main/k8s/examples/testlib.sh                                                                                                                                                         ✘ 1 
113c113
<     OZONE_ROOT=$(realpath ../../../../../target/ozone-1.3.0-SNAPSHOT)
---
>     OZONE_ROOT=$(realpath ../../../../../target/ozone-${version})
119c119
<   flekszible generate -t image:image=pfnmaru/ozone:1.3.0-SNAPSHOT -t ozone/onenode
---
>   flekszible generate -t mount:hostPath="$OZONE_ROOT",path=/opt/hadoop -t image:image=apache/ozone-runner:20200420-1 -t ozone/onenode

~/IdeaProjects/ozone/hadoop-ozone/dist/target/ozone-1.3.0-SNAPSHOT/kubernetes/examples/getting-started master* maru@s500plus
❯                                                                                                                                                                                                                                                    ✘ 1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment