Learn Python with Talk Python's Python courses

Scaling Python and Jupyter with ZeroMQ

Episode #306, published Fri, Mar 5, 2021, recorded Thu, Feb 11, 2021.

This episode is carbon neutral.
When we talk about scaling software threading and async get all the buzz. And while they are powerful, using asynchronous queues can often be much more effective. You might think this means creating a Celery server, maybe running RabbitMQ or Redis as well.

What if you wanted this async ability and many more message exchange patterns like pub/sub. But you wanted to do zero of that server work? Then you should check out ZeroMQ.

ZeroMQ is to queuing what Flask is to web apps. A powerful and simple framework for you to build just what you need. You're almost certain to learn some new networking patterns and capabilities in this episode with our guest Min Ragan-Kelley to discuss using ZeroMQ from Python as well as how ZeroMQ is central to the internals of Jupyter Notebooks.



Links from the show

Min on Twitter: @minrk
Simula Lab: simula.no
Talk Python Binder episode: talkpython.fm/256
The ZeroMQ Guide: zguide.zeromq.org
Binder: mybinder.org
IPython for parallel computing: ipyparallel.readthedocs.io
Messaging in Jupyter: jupyter-client.readthedocs.io
DevWheel Package: pypi.org
cibuildwheel: pypi.org

YouTube Live Stream: youtube.com
PyCon Ticket Contest: talkpython.fm/pycon2021
Episode transcripts: talkpython.fm

Stay in touch with us
Subscribe on YouTube (for live streams): youtube.com
Follow Talk Python on Twitter: @talkpython
Follow Michael on Twitter: @mkennedy

Want to go deeper? Check out our courses

Min Ragan-Kelley
Min Ragan-Kelley
Min is a Senior Research Engineer and head of the department of Scientific Computing and Numerical Analysis at Simula Research Lab in Oslo, Norway. Min has been a core member of the widely used open source project now known as Jupyter since 2006.
Episode sponsored by
Ads served ethically
X
Become a friend of the show
Stay in the know and get a chance to win our contests.
See our privacy statement about email communications.