TheCornCollector@piefed.zip to LocalLLaMA@sh.itjust.worksEnglish · edit-230 days agoQwen3.6 27B releasedhuggingface.coexternal-linkmessage-square23linkfedilinkarrow-up163arrow-down11file-text
arrow-up162arrow-down1external-linkQwen3.6 27B releasedhuggingface.coTheCornCollector@piefed.zip to LocalLLaMA@sh.itjust.worksEnglish · edit-230 days agomessage-square23linkfedilinkfile-text
minus-squareSuspciousCarrot78@lemmy.worldlinkfedilinkEnglisharrow-up3·edit-219 days agodeleted by creator
minus-squarevenusaur@lemmy.worldlinkfedilinkEnglisharrow-up2·28 days agoAre you running llama.cpp via Docker or you compiled on your machine?
minus-squareSuspciousCarrot78@lemmy.worldlinkfedilinkEnglisharrow-up2·edit-219 days agodeleted by creator
minus-squarevenusaur@lemmy.worldlinkfedilinkEnglisharrow-up1·27 days agocool, i’m doing the same. i thought you had to run it via Docker, but I’m running via powershell and the web UI.
minus-squarevenusaur@lemmy.worldlinkfedilinkEnglisharrow-up1·28 days agoGot it. I’ve built simple webpages and opened those files in my browser to preview them, but didn’t know those would connect to anything. I’ll check out Jan and Llama and see which works for me. Thanks!!
deleted by creator
Are you running llama.cpp via Docker or you compiled on your machine?
deleted by creator
cool, i’m doing the same. i thought you had to run it via Docker, but I’m running via powershell and the web UI.
Got it. I’ve built simple webpages and opened those files in my browser to preview them, but didn’t know those would connect to anything.
I’ll check out Jan and Llama and see which works for me.
Thanks!!