SuccessChanges

Summary

  1. [SPARK-23010][K8S] Initial checkin of k8s integration tests. (commit: f433ef786770e48e3594ad158ce9908f98ef0d9a) (details)
Commit f433ef786770e48e3594ad158ce9908f98ef0d9a by mcheah
[SPARK-23010][K8S] Initial checkin of k8s integration tests.
These tests were developed in the
https://github.com/apache-spark-on-k8s/spark-integration repo by several
contributors. This is a copy of the current state into the main apache
spark repo. The only changes from the current spark-integration repo
state are:
* Move the files from the repo root into
resource-managers/kubernetes/integration-tests
* Add a reference to these tests in the root README.md
* Fix a path reference in dev/dev-run-integration-tests.sh
* Add a TODO in include/util.sh
## What changes were proposed in this pull request?
Incorporation of Kubernetes integration tests.
## How was this patch tested?
This code has its own unit tests, but the main purpose is to provide the
integration tests. I tested this on my laptop by running
dev/dev-run-integration-tests.sh --spark-tgz
~/spark-2.4.0-SNAPSHOT-bin--.tgz
The spark-integration tests have already been running for months in
AMPLab, here is an example:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-scheduled-spark-integration-master/
Please review http://spark.apache.org/contributing.html before opening a
pull request.
Author: Sean Suchter <sean-github@suchter.com> Author: Sean Suchter
<ssuchter@pepperdata.com>
Closes #20697 from ssuchter/ssuchter-k8s-integration-tests.
(commit: f433ef786770e48e3594ad158ce9908f98ef0d9a)
The file was addedresource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/IntegrationTestBackend.scala
The file was addedresource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/ProcessUtils.scala
The file was addedresource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/config.scala
The file was addedresource-managers/kubernetes/integration-tests/dev/spark-rbac.yaml
The file was addedresource-managers/kubernetes/integration-tests/scripts/setup-integration-test-env.sh
The file was addedresource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/minikube/MinikubeTestBackend.scala
The file was addedresource-managers/kubernetes/integration-tests/README.md
The file was addedresource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/minikube/Minikube.scala
The file was addedresource-managers/kubernetes/integration-tests/pom.xml
The file was modifiedpom.xml (diff)
The file was modifieddev/tox.ini (diff)
The file was addedresource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/Utils.scala
The file was addedresource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/constants.scala
The file was addedresource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/SparkReadinessWatcher.scala
The file was modifiedREADME.md (diff)
The file was addedresource-managers/kubernetes/integration-tests/dev/dev-run-integration-tests.sh
The file was addedresource-managers/kubernetes/integration-tests/src/test/resources/log4j.properties
The file was addedresource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/KubernetesSuite.scala
The file was addedresource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/KubernetesTestComponents.scala