I also recently got into selfhosting LLM. Having an AMD card meant I had to scourge for solutions since everything expects to have CUDA suppport which means having Nvidia cards. Koboldcpp has a fork with ROCM support which works on my machine, so I’m content with that for now.

I shudder imagining that a stupid company could make .cum domains actually happen. Looking at you Google and your .zip trolling.

There has to be a cultural shift as well. It’s not the early 2000s anymore where a substantial portion of internet users could tinker around their desktop computers. I recently got fiber at home and we’re locked behind CGNAT. I could look for a solution for myself since I grew up opening ports on my router, but imagine someone who grew up with bubble-wrapped smartphones trying to navigate their way through that bs.

So that explains why it’s so cheap.

Porkbun has been fair to me. Recommended.