Monitor performance issues & errors in your code

Test-Driven Prompt Engineering for LLMs with Promptimize

Episode #417, published Tue, May 30, 2023, recorded Mon, May 22, 2023

Large language models and chat-based AIs are kind of mind blowing at the moment. Many of us are playing with them for working on code or just as a fun alternative to search. But others of us are building applications with AI at the core. And when doing that, the slightly unpredictable nature and probabilistic nature of LLMs make writing and testing Python code very tricky. Enter promptimize from Maxime Beauchemin and Preset. It's a framework for non-deterministic testing of LLMs inside our applications. Let's dive inside the AIs with Max.

Watch this episode on YouTube
Play on YouTube
Watch the live stream version

Links from the show

Max on Twitter: @mistercrunch
Promptimize: github.com
Introducing Promptimize ("the blog post"): preset.io
Preset: preset.io
Apache Superset: Modern Data Exploration Platform episode: talkpython.fm
ChatGPT: chat.openai.com
LeMUR: assemblyai.com
Microsoft Security Copilot: blogs.microsoft.com
AutoGPT: github.com
Midjourney: midjourney.com
Midjourney generated pytest tips thumbnail: talkpython.fm
Midjourney generated radio astronomy thumbnail: talkpython.fm
Prompt engineering: learnprompting.org
Michael's ChatGPT result for scraping Talk Python episodes: github.com
Apache Airflow: github.com
Apache Superset: github.com
Tay AI Goes Bad: theverge.com
LangChain: github.com
LangChain Cookbook: github.com
Promptimize Python Examples: github.com
TLDR AI: tldr.tech
AI Tool List: futuretools.io
Watch this episode on YouTube: youtube.com
Episode transcripts: talkpython.fm

--- Stay in touch with us ---
Subscribe to us on YouTube: youtube.com
Follow Talk Python on Mastodon: talkpython
Follow Michael on Mastodon: mkennedy

Want to go deeper? Check out our courses

Talk Python's Mastodon Michael Kennedy's Mastodon