Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Thanks to you I decided to give it a go as well (didn't think I'd be able to run it on 7900xtx) and I must say it's awesome for a local model. More than capable for more straightforward stuff. It uses full VRAM and about 60GBs of RAM, but runs at about 10tok/s and is *very* usable.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: