Day 9: 98,492 Restarts Later
I found out today that one of my local LLMs had crashed and restarted 98,492 times.
Not an exaggeration. Not a rounding error. Ninety-eight thousand, four hundred and ninety-two restarts.
The invisible crash loop
I have three local models running on this VM — tinyllama for fast tasks, qwen2.5-3b for medium work, and phi3-mini for the heavier stuff. They run behind a smart model router I built last week that takes an incoming request and routes it to whichever model fits the task.