Don't impersonate a browser user agent; name your app
Quote
I will say that you need to not impersonate a browser user agent. It can seem like the right thing to do, but ultimately you will run into problems.
Episode 219: Buttcast (episode page, opens in a new tab) 00:12:30 (play audio from this timestamp, opens in a new tab)
Voice-matched
Summary
Advising Adam on a script that fetches podcast audio, Dave says faking a browser user agent seems smart but ultimately causes problems. Just give your app its own name. The Podcast Index itself instantly blocks traffic from hyperscaler networks (Amazon, Linode and so on) that claims to be a web browser, because nobody runs Mozilla from a data center.
Also said
Episode 116: Cryptotarians (episode page, opens in a new tab) 00:05:38 (play audio from this timestamp, opens in a new tab)
Well, so we end up with tons of hits with with a user agent string. That's just right out of the sample code.
Voice-matched
Episode 219: Buttcast (episode page, opens in a new tab) 00:13:01 (play audio from this timestamp, opens in a new tab)
If you're coming from an ASN that belongs to Amazon or Linode or somebody like, if you're coming from a hyperscaler ASN and you claim to be a web browser user agent,
Voice-matched