New best story on News: Llama.cpp 30B runs with only 6GB of RAM now

Llama.cpp 30B runs with only 6GB of RAM now
529 by msoad | 148 comments .


No comments:

Post a Comment

New best story on News: AI is forcing us to pay off 40 years of technical debt

AI is forcing us to pay off 40 years of technical debt 599 by pseudolus | 390 comments on News.