Wisdom

LLMs live in the uncanny valley of accuracy

Quote

But then the closer something gets to actually looking real human, you begin to note all the little flaws become more pronounced and you become more and more uncomfortable.

Episode 209: Pick Your Porthole (episode page, opens in a new tab) 00:38:56 (play audio from this timestamp, opens in a new tab)

Voice-matched

Summary

A cartoon character is fine because it's obviously not human. As something gets closer to real, every small flaw becomes more unsettling. Dave says LLMs are the same: being close to accurate is almost worse than being completely wrong, because they tell you the wrong thing so convincingly.

Also said

  1. Episode 116: Cryptotarians (episode page, opens in a new tab) 00:08:25 (play audio from this timestamp, opens in a new tab)

    It's, it's in the this is on the upswing of the uncanny valley. It's just, it's just, which is almost the worst place to be

    Voice-matched

  2. Episode 209: Pick Your Porthole (episode page, opens in a new tab) 00:39:32 (play audio from this timestamp, opens in a new tab)

    Because they, they're so, they, they tell you the wrong thing in such a convincing way.

    Voice-matched