FailedConsole Output

Skipping 7,335 KB.. Full Log
BpkDgMEMDIxMFQUlDCw2Ogn2QEAspZgwYsAAAA=maven-surefire-plugin:3.0.0-M3:test (test) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- scalatest-maven-plugin:2.0.0:test (test) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:3.1.2:test-jar (prepare-test-jar) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Building jar: /home/jenkins/workspace/spark-master-test-python-arm/external/kinesis-asl-assembly/target/spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT-tests.jar
[INFO] 
[INFO] --- maven-jar-plugin:3.1.2:jar (default-jar) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Building jar: /home/jenkins/workspace/spark-master-test-python-arm/external/kinesis-asl-assembly/target/spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT.jar
[INFO] 
[INFO] --- maven-site-plugin:3.5.1:attach-descriptor (attach-descriptor) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] 
[INFO] --- maven-shade-plugin:3.2.1:shade (default) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Including org.apache.spark:spark-streaming-kinesis-asl_2.12:jar:3.0.0-SNAPSHOT in the shaded jar.
[INFO] Including com.amazonaws:amazon-kinesis-client:jar:1.12.0 in the shaded jar.
[INFO] Including com.amazonaws:aws-java-sdk-dynamodb:jar:1.11.655 in the shaded jar.
[INFO] Including com.amazonaws:aws-java-sdk-s3:jar:1.11.655 in the shaded jar.
[INFO] Including com.amazonaws:aws-java-sdk-kms:jar:1.11.655 in the shaded jar.
[INFO] Including com.amazonaws:aws-java-sdk-kinesis:jar:1.11.655 in the shaded jar.
[INFO] Including com.amazonaws:aws-java-sdk-cloudwatch:jar:1.11.655 in the shaded jar.
[INFO] Including org.apache.commons:commons-lang3:jar:3.9 in the shaded jar.
[INFO] Including commons-logging:commons-logging:jar:1.1.3 in the shaded jar.
[INFO] Including com.amazonaws:aws-java-sdk-sts:jar:1.11.271 in the shaded jar.
[INFO] Including com.amazonaws:aws-java-sdk-core:jar:1.11.271 in the shaded jar.
[INFO] Including org.apache.httpcomponents:httpclient:jar:4.5.6 in the shaded jar.
[INFO] Including org.apache.httpcomponents:httpcore:jar:4.4.12 in the shaded jar.
[INFO] Including software.amazon.ion:ion-java:jar:1.0.2 in the shaded jar.
[INFO] Including joda-time:joda-time:jar:2.10.5 in the shaded jar.
[INFO] Including com.amazonaws:jmespath-java:jar:1.11.271 in the shaded jar.
[INFO] Including com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.10.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-tags_2.12:jar:3.0.0-SNAPSHOT in the shaded jar.
[INFO] Including com.thoughtworks.paranamer:paranamer:jar:2.8 in the shaded jar.
[INFO] Including javax.activation:activation:jar:1.1.1 in the shaded jar.
[INFO] Including org.scala-lang:scala-library:jar:2.12.10 in the shaded jar.
[INFO] Including com.fasterxml.jackson.core:jackson-core:jar:2.10.0 in the shaded jar.
[INFO] Including com.google.protobuf:protobuf-java:jar:2.6.1 in the shaded jar.
[INFO] Including commons-cli:commons-cli:jar:1.2 in the shaded jar.
[INFO] Including commons-io:commons-io:jar:2.4 in the shaded jar.
[INFO] Including org.apache.commons:commons-compress:jar:1.4.1 in the shaded jar.
[INFO] Including org.mortbay.jetty:jetty-util:jar:6.1.26 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-client:jar:2.7.4 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-api:jar:2.7.4 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-common:jar:2.7.4 in the shaded jar.
[INFO] Including javax.xml.bind:jaxb-api:jar:2.2.2 in the shaded jar.
[INFO] Including javax.xml.stream:stax-api:jar:1.0-2 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-jaxrs:jar:1.9.13 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-xc:jar:1.9.13 in the shaded jar.
[INFO] Including org.tukaani:xz:jar:1.5 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.13 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13 in the shaded jar.
[INFO] Including commons-codec:commons-codec:jar:1.10 in the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[WARNING] Discovered module-info.class. Shading will break its strong encapsulation.
[WARNING] Discovered module-info.class. Shading will break its strong encapsulation.
[WARNING] spark-streaming-kinesis-asl_2.12-3.0.0-SNAPSHOT.jar, spark-tags_2.12-3.0.0-SNAPSHOT.jar, unused-1.0.0.jar define 1 overlapping classes: 
[WARNING]   - org.apache.spark.unused.UnusedStubClass
[WARNING] maven-shade-plugin has detected that some class files are
[WARNING] present in two or more JARs. When this happens, only one
[WARNING] single version of the class is copied to the uber jar.
[WARNING] Usually this is not harmful and you can skip these warnings,
[WARNING] otherwise try to manually exclude artifacts based on
[WARNING] mvn dependency:tree -Ddetail=true and the above output.
[WARNING] See http://maven.apache.org/plugins/maven-shade-plugin/
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jenkins/workspace/spark-master-test-python-arm/external/kinesis-asl-assembly/target/spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT.jar with /home/jenkins/workspace/spark-master-test-python-arm/external/kinesis-asl-assembly/target/spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jenkins/workspace/spark-master-test-python-arm/external/kinesis-asl-assembly/dependency-reduced-pom.xml
[INFO] 
[INFO] --- maven-source-plugin:3.1.0:jar-no-fork (create-source-jar) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Building jar: /home/jenkins/workspace/spark-master-test-python-arm/external/kinesis-asl-assembly/target/spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT-sources.jar
[INFO] 
[INFO] --- maven-source-plugin:3.1.0:test-jar-no-fork (create-source-jar) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Building jar: /home/jenkins/workspace/spark-master-test-python-arm/external/kinesis-asl-assembly/target/spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT-test-sources.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 3.0.0-SNAPSHOT:
[INFO] 
[INFO] Spark Project Parent POM ........................... SUCCESS [  2.865 s]
[INFO] Spark Project Tags ................................. SUCCESS [  6.679 s]
[INFO] Spark Project Sketch ............................... SUCCESS [  7.689 s]
[INFO] Spark Project Local DB ............................. SUCCESS [  1.606 s]
[INFO] Spark Project Networking ........................... SUCCESS [  3.419 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [  1.279 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [  9.766 s]
[INFO] Spark Project Launcher ............................. SUCCESS [  1.570 s]
[INFO] Spark Project Core ................................. SUCCESS [02:58 min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 39.171 s]
[INFO] Spark Project GraphX ............................... SUCCESS [ 50.064 s]
[INFO] Spark Project Streaming ............................ SUCCESS [01:31 min]
[INFO] Spark Project Catalyst ............................. SUCCESS [03:59 min]
[INFO] Spark Project SQL .................................. SUCCESS [06:04 min]
[INFO] Spark Project ML Library ........................... SUCCESS [04:50 min]
[INFO] Spark Project Tools ................................ SUCCESS [ 14.911 s]
[INFO] Spark Project Hive ................................. SUCCESS [03:14 min]
[INFO] Spark Project REPL ................................. SUCCESS [ 40.990 s]
[INFO] Spark Project YARN Shuffle Service ................. SUCCESS [  9.655 s]
[INFO] Spark Project YARN ................................. SUCCESS [01:37 min]
[INFO] Spark Project Mesos ................................ SUCCESS [01:27 min]
[INFO] Spark Project Hive Thrift Server ................... SUCCESS [01:34 min]
[INFO] Spark Project Assembly ............................. SUCCESS [  4.180 s]
[INFO] Kafka 0.10+ Token Provider for Streaming ........... SUCCESS [ 45.597 s]
[INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [01:04 min]
[INFO] Kafka 0.10+ Source for Structured Streaming ........ SUCCESS [01:52 min]
[INFO] Spark Kinesis Integration .......................... SUCCESS [01:05 min]
[INFO] Spark Project Examples ............................. SUCCESS [01:20 min]
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [  5.229 s]
[INFO] Spark Avro ......................................... SUCCESS [01:25 min]
[INFO] Spark Project Kinesis Assembly ..................... SUCCESS [  9.068 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  38:23 min
[INFO] Finished at: 2020-01-20T15:10:50+08:00
[INFO] ------------------------------------------------------------------------
+ echo '=========== PySpark test ==========='
=========== PySpark test ===========
+ source /home/jenkins/venv-test/py36/bin/activate
/tmp/hudson1788095580537591160.sh: line 9: /home/jenkins/venv-test/py36/bin/activate: No such file or directory
Build step 'Execute shell' marked build as failure
Archiving artifacts
Finished: FAILURE