• 0 Posts
  • 21 Comments
Joined 1 year ago
cake
Cake day: June 9th, 2023

help-circle




  • It abstracts away llama.cpp in a way that, frankly, leaves a lot of performance and quality on the table.

    OP, do you have any telemetry you can show us comparing the performance difference between what you setup on this guide and an Ollama setup? Otherwise, at face value, I’m going to assume this is another thing on the internet i have to assume is uncorroborated bullshit. Apologies for sounding rude.

    I don’t like some things about the devs. I won’t rant, but I especially don’t like the hint they’re cooking up something commercial.

    This concerns me. Please provide links for us to read here about this. I would like any excuse to uninstall Ollama. Thank you!



  • I’m self hosting Vaultwarden and my home server got killed by the hurricane, yet I can still access my passwords just fine on the app because it stores them locally encrypted on my phone from the last time it synced. I just can’t update or change anything until I can bring everything back on.

    So, host your own shit you cowards, it’ll be fine.