Uploads from Programming Throwdown

Currently Playing: 177: Vector Databases

Intro topic: Buying a Car News/Links: * Cognitive Load is what Matters * https://github.com/zakirullin/cognitive-load ( https://github.com/zakirullin/cognitive-load ) * Diffusion models are Real-Time Game Engines * https://gamengen.github.io/ ( https://gamengen.github.io/ ) * Your Company Needs Junior Devs * https://softwaredoug.com/blog/2024/09/07/your-team-needs-juniors ( https://softwaredoug.com/blog/2024/09/07/your-team-needs-juniors ) * Seamless Streaming / Fish Speech / LLaMA Omni * Seamless: https://huggingface.co/facebook/seamless-streaming ( https://huggingface.co/facebook/seamless-streaming ) * Fish: https://github.com/fishaudio/fish-speech ( https://github.com/fishaudio/fish-speech ) * LLaMA Omni: https://github.com/ictnlp/LLaMA-Omni ( https://github.com/ictnlp/LLaMA-Omni ) Book of the Show * Patrick: * Thought Emporium Youtube * https://youtu.be/8X1_HEJk2Hw?si=T8EaHul-QMahyUvQ ( https://youtu.be/8X1_HEJk2Hw?si=T8EaHul-QMahyUvQ ) * Jason: * Novel Minds * https://www.novelminds.ai/ ( https://www.novelminds.ai/ ) Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h ( https://www.patreon.com/programmingthrowdown?ty=h ) Tool of the Show * Patrick: * Escape Simulator * https://pinestudio.com/games/escape-simulator/ ( https://pinestudio.com/games/escape-simulator/ ) * Jason: * Cursor IDE * https://www.cursor.com/ ( https://www.cursor.com/ ) Topic: Vector Databases (~54 min) * How computers represent data traditionally * ASCII values * RGB values * How traditional compression works * Huffman encoding (tree structure) * Lossy example: Fourier Transform & store coefficients * How embeddings are computed * Pairwise (contrastive) methods * Forward models (self-supervised) * Similarity metrics * Approximate Nearest Neighbors (ANN) * Sub-Linear ANN * Clustering * Space Partitioning (e.g. K-D Trees) * What a vector database does * Perform nearest-neighbors with many different similarity metrics * Store the vectors and the data structures to support sub-linear ANN * Handle updates, deletes, rebalancing/reclustering, backups/restores * Examples * pgvector: a vector-database plugin for postgres * Weaviate, Pinecone * Milvus Programming Throwdown Episode 177 November 4, 2024 ★ Episode details: https://share.transistor.fm/s/72129a79 ★ Additional episodes: https://www.programmingthrowdown.com/