Turn log rotation back on and monitor disk space
ToolsLog rotation + disk space checks
Quote
I had turned off the log rotation in order because I was troubleshooting a problem. And I just didn't turn it back on. Now, this thing's growing. You know, exponentially daily.
Episode 149: Scrape my JSON (episode page, opens in a new tab) 00:09:30 (play audio from this timestamp, opens in a new tab)
Speaker-labeled
Summary
The Podcast Index API timed out because Dave had turned off log rotation on the front-end servers while troubleshooting and never turned it back on; logs filled the disks. He'd long meant to add a disk-space checker. Lesson: restore temporary changes and monitor disk space.
Also said
Episode 149: Scrape my JSON (episode page, opens in a new tab) 00:08:55 (play audio from this timestamp, opens in a new tab)
I'll get around to throw in a disk space checker on these front ends one day. Because I've got a script.
Speaker-labeled