PyData Global 2022

Kurt Schelfthout

Kurt has worked in a variety of application domains, from logistics to most recently finance. He's currently working on Meadowrun (https://meadowrun.io), to make cloud compute more easily accessible for data scientists and data engineers.

Kurt writes software engineering and computing science deep dives at Get Code (https://getcode.substack.com), and hot takes on Twitter as @kurt2001 (https://twitter.com/kurt2001) or Mastodon as @kurts (https://mastodon.online/@kurts).

The speaker's profile picture

Sessions

12-01
20:30
90min
Lightning Talks
Brian Skinn, Kacper Ɓukawski, Kurt Schelfthout, Richard Lee, Allan Campopiano, Eyal Kazin, Ziheng Wang, Caroline Arnold

Lightning Talks are short 5-10 minute sessions presented by community members on a variety of interesting topics.

Lightning Talks
Talk Track II
10min
Introducing Meadowrun: write code locally, run on the cloud
Kurt Schelfthout, Richard Lee

This talk introduces Meadowrun, which is an open source library that makes it easy to run your python code on the cloud.

Meadowrun is for data scientists and engineers that want to write python code locally that can seamlessly run on cloud resources. Process large datasets in parallel, or take advantage of powerful GPUs without giving up the flexibility of writing code on your laptop. Meadowrun takes care of the tedious details of creating EC2 instances and setting them up with your code and libraries.

This talk will be a demo of Meadowrun processing a dataset quickly using cloud resources. Along the way, we will cover the most important aspects of how Meadowrun is implemented.

Meadowrun currently targets EC2, Azure VMs, and Kubernetes. This talk will focus on the EC2 experience.