Learn Python with Talk Python's Python courses

Parallelizing computation with Dask

Episode #207, published Sun, Apr 14, 2019, recorded Wed, Feb 20, 2019.

This episode is carbon neutral.
What if you could write standard numpy and pandas code but have it run on a distributed computing grid for incredible parallel processing right from Python? How about just splitting it across multiprocessing to escape the limitations of the GIL on your local machine? That's what Dask was built to do.

On this episode, you'll meet Matthew Rocklin to talk about its origins, use-cases, and a whole bunch of other interesting topics.

Links from the show

Dask: dask.org
Matthew on Twitter: @mrocklin
Matthew's website: matthewrocklin.com
Dask examples: github.com
PyCon presentation: youtube.com
PyCon presentation slides: matthewrocklin.com/slides
Episode transcripts: talkpython.fm

Stay in touch with us
Subscribe on YouTube (for live streams): youtube.com
Follow Talk Python on Twitter: @talkpython
Follow Michael on Twitter: @mkennedy

Want to go deeper? Check out our courses

Matthew Rocklin
Matthew Rocklin
Episode sponsored by
Ads served ethically
X
Become a friend of the show
Stay in the know and get a chance to win our contests.
See our privacy statement about email communications.