Local AI (LLMs, RAG, more)

Currently Playing: Local vs. Cloud LLMs/RAG - Let's FINALLY End this Debate

Artificial Intelligence is no doubt the future of not just software development but the whole world. And I'm on a mission to master it - focusing first on mastering AI Agents. In this video I walk you through the decision of deciding if you should go with a local or cloud (managed services) solution for your AI application. This includes your LLMs, RAG pipeline, databases, etc. Managed services (GPT, Claude, Pinecone, etc.) are NOT always the best answer, but neither is local (Ollama, HuggingFace, Chroma, etc.). There IS a time and place for both! A hybrid approach is also great. Lot to cover here so let's dive in! Cloud === Managed Services - I just use "Cloud" in the title + thumbnail since it's more concise. 00:00 - 01:12 - Intro 01:13 - 02:23 - Local Tech Stack 02:24 - 03:12 - Cloud Tech Stack 03:13 - 09:12 - Local vs. Cloud Decision Tree 09:13 - 10:13 - Outro ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ You can download the local vs. managed services decision tree here: https://github.com/coleam00/ai-agents-masterclass/tree/main/local-or-managed-llm-rag And view the decision tree diagram easily with this link: https://drive.google.com/file/d/1Tj_WupPososWl4_r5dj0c1shzYB1ojIx/view ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Join me as I push the limits of what is possible with AI. I'll be uploading videos twice a week - Sundays and Wednesdays at 7:00 PM CDT!