Richard Lee
Sessions
Lightning Talks are short 5-10 minute sessions presented by community members on a variety of interesting topics.
This talk introduces Meadowrun, which is an open source library that makes it easy to run your python code on the cloud.
Meadowrun is for data scientists and engineers that want to write python code locally that can seamlessly run on cloud resources. Process large datasets in parallel, or take advantage of powerful GPUs without giving up the flexibility of writing code on your laptop. Meadowrun takes care of the tedious details of creating EC2 instances and setting them up with your code and libraries.
This talk will be a demo of Meadowrun processing a dataset quickly using cloud resources. Along the way, we will cover the most important aspects of how Meadowrun is implemented.
Meadowrun currently targets EC2, Azure VMs, and Kubernetes. This talk will focus on the EC2 experience.