• 0 Posts
  • 29 Comments
Joined 6 months ago
cake
Cake day: May 28th, 2024

help-circle
  • So, I migrated to 5.x and I don’t know if it was just me, or a change in the WebUI or something, but Sonarr stopped wanting to pull files in. I’ve been holding out on the Sonarr upgrade because last I looked at it, it wouldn’t auto-migrate you over, etc.

    But when I went to upgrade it - it said that now auto-migrates, and it does. However, the old migrated rules looked kinda dirty, so I was panicking a little. The imported/converted stuff all worked, mind you, I just didn’t like how they looked. In the end, I ended up really really liking the new Sonarr system, though I did have to ask an LLM how to format some new regex.





  • If your “FIRST STEP” is to choose an OS: Fuck that.

    You should never have to change your OS just to use this crap. It’s all written in Python. It should work on every OS available. Your first step is installing the prerequisites.

    If you’re using something like Continue for local coding tasks, CodeQwen is awesome, and you’ll generally want a context window of 120k or so because for coding, you want all the code context - or else the LLM starts spitting out repetitious stuff, or can’t ingest all of your context so it’ll rewrite stuff that’s already there.





      • Learning. If you ever found yourself tired of learning new things, your life is basically done.
      • Cost. You already have an internet connection at home. It’s practically a necessity these days. The connection is likely fast enough for most things. Renting even the most piddly of VPS is wildly expensive. Just throw a spare machine at it and go wild.
      • Freedom. Your own data is constantly being collected, regurgitated, and sold back to you. More people need to care about this incessant invasion of our lives.
      • Backups. 3 copies, on different forms of storage, in multiple PHYSICALLY distinct locations. Just when you have that teeny little imp in the back of your mind say “hmm, I should probably back up soon” – stop everything you’re doing and run a backup.
      • Test your recovery! Backups are only good if you can recover from them. Many have lost data because they failed to ever fail-test their backups.
      • Google. Legitimately the best skill you can ever attain is simply being able to search effectively and be able to learn jargon quickly. Once you have the lingo down, searches become clearer, quicker, more precise.




  • kitnaht@lemmy.worldtoSelfhosted@lemmy.worldUses for local AI?
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    4 months ago

    Those were statements. Statements of fact.

    Once the models are already trained, it takes almost no power to use them.

    Yes, TRAINING the models uses an immense amount of power - but utilizing the training datasets locally consumes almost nothing. I can run the llama 7b set on a 15w Raspberry Pi for example. Just leaving my PC on uses 400w. This is all local – Nothing entering or leaving the Pi. No communication to an external server, nothing being done on anybody else’s server or any AWS instances, etc.