Rehan Durrani
Rehan Durrani is one of the core developers of Modin and a founding engineer at Ponder. Rehan studied Electrical Engineering and Computer Science at UC Berkeley and has contributed to leading open source research projects including Modin and Ray, as well as lead open source research projects like Clipper. His work on Modin has been published in leading publications, including VLDB.
Sessions
pandas has rapidly become one of the most popular tools for data analysis, but is limited by its inability to scale to large datasets. We developed Modin, a scalable, drop-in alternative to pandas, that preserves the dynamic and flexible behavior of pandas dataframes while enhancing the scalability.
This talk will walk you through our team’s research at UC Berkeley, which enabled the development of Modin. We’ll also discuss our latest publication at VLDB, which covers a novel approach to parallelization and metadata management techniques for dataframes.