Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 6 months agoWant a more private ChatGPT alternative that runs offline? Check out Janbgr.comexternal-linkmessage-square73fedilinkarrow-up1400arrow-down118
arrow-up1382arrow-down1external-linkWant a more private ChatGPT alternative that runs offline? Check out Janbgr.comLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 6 months agomessage-square73fedilink
minus-square🇸🇵🇪🇨🇺🇱🇦🇹🇪🇷@lemmy.worldlinkfedilinkEnglisharrow-up5·6 months agoI think a good 13B model running on 12GB of VRAM can do pretty well. But I’d be hard pressed to believe anything under 33B would beat 3.5.
minus-squarejune@lemmy.worldlinkfedilinkEnglisharrow-up2arrow-down3·6 months ago3.5 fuckin sucks though. That’s a pretty low bar to set imo.
Local LLMs can beat GPT 3.5 now.
I think a good 13B model running on 12GB of VRAM can do pretty well. But I’d be hard pressed to believe anything under 33B would beat 3.5.
3.5 fuckin sucks though. That’s a pretty low bar to set imo.