Watch and track your favorite playlist.
Curated by: VictoryCat (71 videos)
In this video we compare the merits of running a lower parameter model at a higher resolution, vs a higher parameter model at a much more aggressive quant. Timeline: 0:00 - Intro 0:40 - How quantization works 4:01 - Pros and cons of each system 4:55 - Side by side comparison 8:20 - Which model is right for you? #educational #localllm #localai #quantization #aiquality