DevConf.US 2022

Ray is quickly gaining momentum as a parallel computing environment that provides a scalable cluster model pioneered by tools such as Spark and Flink, yet also supports a lightweight Serverless style workflow designed natively for modern container platforms. Open Data Hub (ODH) is a flexible and customizable federation of open source data science tools that is a great fit for taking advantage of Ray compute clusters. In this talk, Erik will explain how to integrate Ray with Open Data Hub, by configuring ODH profiles that deploy on-demand Ray clusters for Jupyter notebooks. He’ll demonstrate Ray in action as a compute resource for ODH. Along the way he’ll also discuss the logistics of adapting Ray to OpenShift’s security features. Attendees will learn about the basics of Ray’s compute model, how it fits with Open Data Hub’s architecture, and how to leverage the power of ODH customization features.

Talk video:
https://youtu.be/QxeGrJpy2H0?t=68