BeatTakeshi@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · edit-24 days agoI have a RTX A1000 (8GB) with 64GB DRR5, what would you recommend for a newbie?message-squaremessage-square32linkfedilinkarrow-up124arrow-down12file-text
arrow-up122arrow-down1message-squareI have a RTX A1000 (8GB) with 64GB DRR5, what would you recommend for a newbie?BeatTakeshi@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · edit-24 days agomessage-square32linkfedilinkfile-text
I’m new to local llms, i’m running Debian on this machine. Where should I start and what model(s) could I get testing on it?
minus-squarehendrik@palaver.p3x.delinkfedilinkEnglisharrow-up2·4 days agoYou could try KoboldCpp with the All-in-one Starter Pack V2. Or go through their newbie-templates.
minus-squareBeatTakeshi@lemmy.worldOPlinkfedilinkEnglisharrow-up2·3 days agoMany thanks, these all in one solutions really interest me, I don’t think I’d have the time to learn how to deploy and connected all individual elements of a full stack myself
You could try KoboldCpp with the All-in-one Starter Pack V2. Or go through their newbie-templates.
Many thanks, these all in one solutions really interest me, I don’t think I’d have the time to learn how to deploy and connected all individual elements of a full stack myself