SuccessChanges

Summary

  1. Move docker image management and test entrypoint to Maven (#31) (commit: c6511276016f9b46beb709dd9b6ac1c7d1a72450) (details)
Commit c6511276016f9b46beb709dd9b6ac1c7d1a72450 by ramanathana
Move docker image management and test entrypoint to Maven (#31)
* Use an nginx server for remote jars tests.

* Moves all integration test setup logic to Maven and scripts.
The Kubernetes integration tests now always expect an image to be
pre-built, so we no longer build images with Scala code. Maven's
pre-integration-test invokes a single script to bootstrap the
environment with the built images, etc. In the transition we try to keep
as much of the same semantics as possible.

* Update documentation

* Remove unnecessary .gitignore entries

* Use $IMAGE_TAG instead of $TAG

* Don't write image tag file twice

* Remove using nginx file server

* Remove some lines

* Split building Spark for dev environment from build reactor

* Small docs fix

* Docs formatting fix

* Spark TGZ can be empty instead of N/A, throw an error if not provided.


* Remove extraneous --skip-building-docker-images flag.

* Switch back to using the N/A placeholder

* Remove extraneous code

* Remove maven args because they don't work

* Fix scripts

* Don't get Maven if it's already there

* Put quotes everywhere

* Minor formatting

* Hard set Minikube binary location.

* Run Minikube from bash -c
(commit: c6511276016f9b46beb709dd9b6ac1c7d1a72450)
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/Utils.scala
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/config.scala
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/KubernetesSuite.scala
The file was modified.gitignore (diff)
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/SparkReadinessWatcher.scala
The file was removede2e/runner.sh
The file was modifiedREADME.md (diff)
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/Logging.scala
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/minikube/Minikube.scala
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/minikube/MinikubeTestBackend.scala
The file was removede2e/e2e-prow.sh
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/KubernetesSuite.scala
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/SparkReadinessWatcher.scala
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/minikube/MinikubeTestBackend.scala
The file was removedintegration-test/pom.xml
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/KubernetesTestComponents.scala
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/constants.scala
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/constants.scala
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/config.scala
The file was addedbuild/mvn
The file was addedpom.xml
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/Logging.scala
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/GCE/GCETestBackend.scala
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/ProcessUtils.scala
The file was addedsrc/test/resources/log4j.properties
The file was addedscripts/setup-integration-test-env.sh
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/KubernetesTestComponents.scala
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/IntegrationTestBackend.scala
The file was addeddev/dev-run-integration-tests.sh
The file was removedintegration-test/src/test/resources/log4j.properties
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/GCE/GCETestBackend.scala
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/Utils.scala
The file was removede2e/e2e-minikube.sh
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/docker/KubernetesSuiteDockerManager.scala
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/minikube/Minikube.scala
The file was removedintegration-test/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/IntegrationTestBackend.scala
The file was addedsrc/test/scala/org/apache/spark/deploy/k8s/integrationtest/ProcessUtils.scala