GolfFoxtrotLima@sh.itjust.works to Programmer Humor@programming.dev · 6 days agoMy home server was a totally justified purchaselemmy.worldimagemessage-square41linkfedilinkarrow-up1451arrow-down12file-textcross-posted to: linuxmemes@lemmy.world
arrow-up1449arrow-down1imageMy home server was a totally justified purchaselemmy.worldGolfFoxtrotLima@sh.itjust.works to Programmer Humor@programming.dev · 6 days agomessage-square41linkfedilinkfile-textcross-posted to: linuxmemes@lemmy.world
minus-squareMika@piefed.calinkfedilinkEnglisharrow-up1·5 days agoWhy not llama.cpp? Ollama is just a wrapper over it.
minus-squareTropicalDingdong@lemmy.worldlinkfedilinkarrow-up1·5 days agoMostly time. I didn’t buy the machine to run someone else’s models. I bought it to run my own models and the machine has a job to do. Tinkering with self hosting llms, I guess. I appreciate them as models. But my machine has a day job.
Why not llama.cpp? Ollama is just a wrapper over it.
Mostly time. I didn’t buy the machine to run someone else’s models. I bought it to run my own models and the machine has a job to do. Tinkering with self hosting llms, I guess. I appreciate them as models. But my machine has a day job.