

I had a long running plan that played out with my GTX 1080. I wanted my server (in my bedroom) to be as quiet as possible, and the (Gigabyte) 1080’s fans, with one slightly dodgy bearing, wasn’t going to cut it. I deshrouded it and ran thermal tests in my main PC. Long story short, while in the server machine it blitzed a local Piper model (<1s processing voice commands) and Emby transcoding with Max 5GB used. I know Piper is a far cry from an LLM, but at least you’ll know that its more than capable of everything else.
Edit: Here are my notes in case it helps anyone lol
The trick of retrofitting any battery powered device into a wired one is to remove the battery. No matter what, Li-ion batteries cannot sustain permanent power. Expensive adapters and new Androids can regulate power well, as can automations, but the best worry-free option is battery removal.
Edit: I’ve just remembered Fairphone, they’re bossing the mobile repair ability front and have removable batteries like pre-2012. Could get one of those