Learn Python with Talk Python's Python courses

Parallelizing computation with Dask

Episode #207, published Sun, Apr 14, 2019, recorded Wed, Feb 20, 2019.

This episode is carbon neutral.
What if you could write standard numpy and pandas code but have it run on a distributed computing grid for incredible parallel processing right from Python? How about just splitting it across multiprocessing to escape the limitations of the GIL on your local machine? That's what Dask was built to do.

On this episode, you'll meet Matthew Rocklin to talk about its origins, use-cases, and a whole bunch of other interesting topics.

Links from the show

Dask: dask.org
Matthew on Twitter: @mrocklin
Matthew's website: matthewrocklin.com
Dask examples: github.com
PyCon presentation: youtube.com
PyCon presentation slides: matthewrocklin.com/slides
Episode transcripts: talkpython.fm

Want to go deeper? Check out our courses

Matthew Rocklin
Matthew Rocklin
Episode sponsored by
Ads served ethically
Click to show comments

Individuals can support this podcast directly via Patreon. Corporate sponsorship opportunities available here.
Become a friend of the show
Stay in the know and get a chance to win our contests.
See our privacy statement about email communications.