MasterNerd@lemm.eetoSelfhosted@lemmy.world•Is it possible to run a LLM on a mini-pc like the GMKtec K8 and K9?English
5·
5 months agoLook into ollama. It shouldn’t be an issue if you stick to 7b parameter models
Look into ollama. It shouldn’t be an issue if you stick to 7b parameter models
I don’t have any experience with them honestly so I can’t help you there