Local AI (LLMs, RAG, more)

Currently Playing: If You’re Serious About Building AI Agents, This is Your Secret Weapon

A lot of AI agent development these days is just guesswork - it’s clear that most people aren’t serious about building AI agents that are useful in the real world. Want to stand out and actually build production ready AI agents? Well then I have your secret weapon to do so - Langfuse. Langfuse is an LLM engineering platform that allows you to monitor every action your agent is taking, the cost of each request, how long each response and action takes, and every conversation users are having with your agent. Without a platform like Langfuse, you’ll be flying completely blind when you agent is of running in the wild. When it fails, you’ll often have no idea why. You won’t know how much you’re spending, and most importantly, you won’t know how to iterate on your agent to improve it. So in this video, I show you how to use Langfuse to solve for all of this. Note that this video is NOT sponsored by Langfuse - I genuinely like them the most out of all agent observability platforms (especially since they are open source) and I have been wanting to add Langfuse to the local AI package for a long time now! ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ I'm hosting a special Q&A livestream this Saturday (the 26th) at 9:00 AM CDT in celebration of the launch of our Dynamous AI Mastery Community! Enable notifications by visiting the scheduled stream here: https://www.youtube.com/watch?v=jSDLMYZAfac The Local AI Package with Langfuse: https://github.com/coleam00/local-ai-packaged My Langfuse examples (including the Pydantic AI template): https://github.com/coleam00/ottomator-agents/tree/main/pydantic-ai-langfuse Langfuse Documentation: https://langfuse.com/docs Langfuse Self-Hosting Guide: https://langfuse.com/self-hosting ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 00:00 - Introducing Langfuse 01:32 - So Many Video Ideas for Langfuse! 02:01 - Platform Overview 03:27 - Self-Hosting Langfuse (including the Local AI Package) 04:35 - Langfuse Demo (So Many Features!) 07:30 - Langfuse Quickstart (Basic Example) 10:02 - Basic Example in Action 11:42 - Integrating Langfuse into Pydantic AI Agents 14:18 - Monitoring a Pydantic AI Agent Demo 16:50 - Main Pydantic AI + Langfuse Template 19:55 - Monitoring Example with MANY Tool Calls 24:02 - Sessions and Users in Langfuse 25:21 - Langfuse + n8n 27:09 - Outro ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Join me as I push the limits of what is possible with AI. I'll be uploading videos at least two times a week - Sundays and Wednesdays at 7:00 PM CDT!