This but just JF instead of Navidrome

^Prompt Engineer

Its a leap to say “nvidia AI support on Linux is bad” when you mean a very particular set of circumstances (which don’t apply to someone who would just be getting into it as they’re using consumer grade hardware) causes issues.

I have a 3080ti and run 8b - 12b all in VRAM just fine, which is what a majority of people getting into it would be doing as well, again to my point about pulling an 18 wheeler trailer with a horse, you’ve got worse problems then nvidia on Linux (if you’re trying to run a 70b model on consumer hardware).

No shit lmao, are you going to tell me a horse can’t pull an 18 wheeler trailer next?

Disagree on Linux nvidia support, it works fine

Great guides https://www.simplehomelab.com/

Even though I don’t use the extra stuff in nextcloud, it runs perfectly fine on my hardware and is great as a replacement for onedrive functionality

I am not sure how it works with authentik and the navidrome mobile apps, but I with Authelia and Immich, I basically had to add a header bypass to the traefik config and in the immich mobile app, maybe something similar is possible?

Mobile apps that aren’t supported lose functionality quicker then webUI alternatives (since web standards stick around longer I’d guess)

Learning about quant level was helpful as well

Thanks for the reminder, done as well :)

Coming up on a year of self hosting the worst I’ve had happen is a copyright letter from my isp from dry downloading torrents lmao. Threw I behind a vpn and it’s been fine since.

Idk most of the time I just dcpull dcup (aliases ftw)

Ofc had some stuff break occasionally if there’s a breaking change but the same could happen through apt no?

I prefer it to dependency hell personally lol

Just replace Apt update with docker pull 🤷‍♂️

It’s really nice once it’s going, especially if you link them together in a compose and farm out all the individual ymls for each service, or use something like dockage to do it.

I went with proxmox and various LXCs for either individual services or docker stacks with several things on a minimal os (I’m comfortable with Ubuntu server so that’s what I go with generally as the unpriv LXC)

For logs dozzle is also fantastic, and you can do “agents” if you have multiple docker nodes and connect them togetherb

Proxmox with Ubuntu as the LXC, essentially only docker containers on it.

The biggest challenge I ran into is keeping the drivers in sync between the host and the LXC, since one is Deb and the other is Ubuntu, the LXC tends to want to update sooner and sometimes that can break the communication.

You edit the LXCs config in proxmox to do it, sec.

Edit: This guide would probably be better then what I did a earlier this year: https://www.virtualizationhowto.com/2025/05/how-to-enable-gpu-passthrough-to-lxc-containers-in-proxmox/

I run a majority of my docker containers within an unprivileged LXC, even gpu pass through and it works great.