DevConf.US 2022 has ended
Registration is now OPEN! Please register HERE as soon as possible!

DevConf.US 2022 is the 5th annual, free, Red Hat sponsored technology conference for community project and professional contributors to Free and Open Source technologies coming to Boston this August!!
Friday, August 19 • 13:30 - 13:55
When To Stop: Optimize Test Runtimes Using AI4CI

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

In this era of automation and streamlining systems by removing human involvement, GitHub makes it easy to automate all your software development workflows, now with world-class CI/CD. Build, test, and deploy your code right from GitHub. However, every new Pull Request to a repository with new code changes is subjected to an automated set of builds and tests before being merged. Some tests may run for longer durations than expected. Longer running tests are often painful as they can block the CI/CD process for lengthy periods of time. How can we optimize the running time of our tests and prevent bottlenecks in our CI/CD pipeline? By understanding the test failure times from historical data, we aim to predict an Optimal Stopping Point for a test/build to help developers and managers better allocate the development resources, and ensure efficiency, consistency, and transparency for manual and time-consuming processes. With the help of machine learning and statistical models, we can predict the optimal stopping point for a given test and build. In this talk, we will demonstrate how you can leverage Operate First, an open source cloud platform consisting of various tools to collect open CI/CD data from various sources such as GitHub, Prow, TestGrid, etc, analyze it, and visualize key performance indicator metrics on a Superset dashboard to gain greater insights into your software development process. We will use Jupyter notebooks to train an ML model for predicting the optimal stopping point for tests. Finally, we will see how to package our prediction pipeline and deploy it as a service using Seldon Core on OpenShift.

avatar for Aakanksha Duggal

Aakanksha Duggal

Senior Data Scientist, Red Hat Inc
Aakanksha Duggal is a Senior Data Scientist in the Emerging Technologies Group at Red Hat. She is a part of the Data Science team and works on developing open source software that uses AI and machine learning applications to solve engineering problems.
avatar for Hema Veeradhi

Hema Veeradhi

Senior Data Scientist, Red Hat
Hema Veeradhi is a Senior Data Scientist working in the Emerging Technologies team part of the office of the CTO at Red Hat. Her work primarily focuses on implementing innovative open AI and machine learning solutions to help solve business and engineering problems. Hema is a staunch... Read More →

Friday August 19, 2022 13:30 - 13:55 EDT
East Balcony