Another upvote for forgeo. So easy to get set up and running. Can run it in docker itself. I tried to host gitlab and got so frustrated with the pages and pages of ruby configs. Forgejo is so much cleaner.

Yup, just one of those posts that could of course work in either

checks the community to make sure I’m in programmer humor

Yeah that checks out

"7z-wasm": "^1.0.2",

Ah, knew we were looking at a wrapper of my faithful companion here

I have more devices sent over, so for me I just pass through /dev/disk and /run/udev along with the configs. Could start there?

oh freaking awesome, this looks amazing! Thank you so much for this!

For most of you suggesting hosting a repository - yes but,

Host forgejo. Just host the git mirror. It comes with a package repo out of the box. Then you have the source code and the docker images

Generally there are not LLMs that do this, but you start building up a workflow. You speak, one service reads in the audio and translates it to text. Then you feed that into an LLM, it responds in text, and you have another service translate that into audio.

Home Assistant is the easiest way to get them all put together.

https://www.home-assistant.io/integrations/assist_pipeline

Edit agree with others below. Use the apps that are made for it.

• Whisper for STT
• Any hosted LLM can work, text-generation-webui or tabbyapi
• I use xttsv2 for TTS

This post is written as if there’s only one “community”. Why does there need to be a primary? I’m here and I’m happy. If I have questions I search online or ask here, same as any other community

Seconded with Matrix. All I’m wanting for it is for someone to make a Discord/Revolt UI frontend for Matrix 2.0 and it’ll be a drop in replacement

Oh yeah, critical component. And vram, in fact I would only consider LLMs on a 3000+ card right now, they require quite a bit of vram

NVidia is great in a server, drivers are a pain but do-able. I have a 3000 series that I use regularly and pass into my kubernetes cluster. NVidia on a gaming rig linux is fine, but there is more overhead with the drivers.

AMD is great in gaming servers, but doesn’t have CUDA, so it’s not as useful in a server environment in my experience - if you’re thinking of doing CUDA workloads like hosting LLMs.

1060 will be a noticeable step in Jellyfin

DNS is of course the preferred approach

I wouldn’t worry about mounting your nfs shares directly to those host unless you need to. Compose has an operator similar to k8s that lets docker itself manage the shares, which is insanely useful if you lose your host. Then you don’t have to have piles of scripts to mount them.

https://stackoverflow.com/questions/45282608/how-to-directly-mount-nfs-share-volume-in-container-using-docker-compose-v3

version: "3.2"

services:
  rsyslog:
    image: jumanjiman/rsyslog
    ports:
      - "514:514"
      - "514:514/udp"
    volumes:
      - type: volume
        source: example
        target: /nfs
        volume:
          nocopy: true
volumes:
  example:
    driver_opts:
      type: "nfs"
      o: "addr=10.40.0.199,nolock,soft,rw"
      device: ":/docker/example"

LLMs use a ton of VRAM, the more VRAM you have the better.

If you just need an API, then TabbyAPI is pretty great.

If you need a full UI, then Oogabooga’s TextGenration WebUI is a good place to start

Personally, if you’re considering it already, kubernetes might be something to look into. It’s a lot. Like a lot to learn. But I can honestly say I could do it for a job now with how much I’ve learned. Then it’s less about how to set up machines and more about just reapplying your infrastructure.

Is this really feature flags as a service? FFAAS?

Tried it and it works pretty well! I’ll have to keep playing with it, but so far so good!

How well do you find it works? I’m not afraid of the fee, but I don’t want to spend time setting it up and paying the fee to only find out that it won’t do most things

The number one thing that most of these don’t do well for me is the connection with banks. You mentioned that there is bank syncing, how well does that work? Can I say, just click my bank and do an oauth connection, and it will store it? I really loved Mint, and essentially want it to be done the same way