minus-squareMixel@feddit.detoSelfhosted@lemmy.world•What's the best affordable pre-built mini server?linkfedilinkEnglisharrow-up1·6 months agoOllama is a big thing, do you want it to be fast? You will need a GPU, how large is the model you will be running be? 7/8B with CPU not as fast but no problem. 13B slow with CPU but possible linkfedilink
Ollama is a big thing, do you want it to be fast? You will need a GPU, how large is the model you will be running be? 7/8B with CPU not as fast but no problem. 13B slow with CPU but possible