How can we more easily run performance benchmarks against Java SDKs and analyze and compare results? What information is coming out of some common open-source benchmarks and why might it be interesting? How can you incorporate performance tests into your continuous delivery pipeline? This talk addresses all of these questions and more as it surveys the performance testing story at AdoptOpenJDK and Eclipse OpenJ9. In this presentation, the common user story of determining whether a code change caused a performance regression guides us through the delivery pipeline at AdoptOpenJDK, but also introduces how you can leverage the automation from that open-source projects for your own testing requirements.