Gemma 3 12B: a small local model that's great for text extraction
SoftwareGemma 3 12B (local model)
Quote
If all you need is to interpret some text, the smaller models will do great. They're just fine. And they'll fit in a 24 gig Ram system easily. And so if you just need a small model, something like Gemma three, 12 B is a very good model.
Episode 252: Joy Robber (episode page, opens in a new tab) 01:17:29 (play audio from this timestamp, opens in a new tab)
Voice-matched
Summary
If all you need is to interpret text, Dave says the smaller models do great. Gemma 3 12B was the one that worked for his invoice-extraction pipeline after trying ten models. It fits easily in a 24 GB RAM system, runs locally, and processes a page of text in about three seconds.