Jenkins: Our Dutiful Software Butler

Error: Unable to create directory uploads/2023/03. Is its parent directory writable by the server?

Jenkins LogoAs the pace of development on the Berkeley Data Analytics Stack (BDAS) increases and the number of contributors grows, we recognize the importance of keeping code quality high. In order to automate testing, we’ve setup Jenkins: a system to monitor and test every checkin to our source repositories.

We’re making our installation of Jenkins available to everyone and welcome any feedback you have on the system. There’s also a link in the footer of our web site to help you find Jenkins in the future.

If you’re an open-source contributor, you’ll notice that Jenkins now tests each github pull request and posts a comment with results (as github user AmplabJenkins). This system will allow us to be more responsive to pull requests and handle the increased volume of development.

What you see now is just the beginning. We currently have automated tests for Spark, Mesos and Tachyon and we’ll be adding more BDAS components soon. In addition, thanks to generous support from Amazon Web Service and VMware, we’ll be running scaling and performance tests on clusters in-house and in the cloud soon. We’ve also had a number of companies offer to do coordinated testing using their infrastructure.

I’d also like to thank Thomas Marshall, Jey Kottalam, Haoyuan Li and Jon Kuroda for the work they did to bring up Jenkins and expand the test coverage for our stack. The AMPLab is committed to turning the research software developed at Berkeley into production-ready software.