Monitor performance issues & errors in your code

Test-Driven Prompt Engineering for LLMs with Promptimize

Episode #417, published Tue, May 30, 2023, recorded Mon, May 22, 2023

Large language models and chat-based AIs are kind of mind blowing at the moment. Many of us are playing with them for working on code or just as a fun alternative to search. But others of us are building applications with AI at the core. And when doing that, the slightly unpredictable nature and probabilistic nature of LLMs make writing and testing Python code very tricky. Enter promptimize from Maxime Beauchemin and Preset. It's a framework for non-deterministic testing of LLMs inside our applications. Let's dive inside the AIs with Max.

Watch this episode on YouTube
Play on YouTube
Watch the live stream version

Links from the show

Max on Twitter: @mistercrunch
Introducing Promptimize ("the blog post"):
Apache Superset: Modern Data Exploration Platform episode:
Microsoft Security Copilot:
Midjourney generated pytest tips thumbnail:
Midjourney generated radio astronomy thumbnail:
Prompt engineering:
Michael's ChatGPT result for scraping Talk Python episodes:
Apache Airflow:
Apache Superset:
Tay AI Goes Bad:
LangChain Cookbook:
Promptimize Python Examples:
AI Tool List:
Watch this episode on YouTube:
Episode transcripts:

--- Stay in touch with us ---
Subscribe to us on YouTube:
Follow Talk Python on Mastodon: talkpython
Follow Michael on Mastodon: mkennedy

Want to go deeper? Check out our courses

Talk Python's Mastodon Michael Kennedy's Mastodon