Model training is 90% preparing the data
Quote
is the process of model training. is that a good 90% of the work of model training goes into preparing your data correctly. training data set.
Episode 258: Perceptron (episode page, opens in a new tab) 00:53:45 (play audio from this timestamp, opens in a new tab)
Voice-matched
Summary
From building a spam/slop classifier for the Podcast Index, Dave learned that about 90% of model-training work is preparing an excellent training set. A poor, too-small or too-big set makes the model memorize, so you need lots of back-end testing to confirm it generalizes (king is to man as queen is to woman) instead of memorizing (queen = Elizabeth).
Also said
Episode 258: Perceptron (episode page, opens in a new tab) 01:08:27 (play audio from this timestamp, opens in a new tab)
You have to do it. You have to do. a lot of testing to set to Make sure that it's not just memorizing.
Voice-matched