It doesn't work well at all. (Also alpaca.cpp uses 8GB of RAM for a 4GB model, p... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

astrange on March 24, 2023 | parent | context | favorite | on: Transformer architecture optimized for Apple Silic...

It doesn't work well at all. (Also alpaca.cpp uses 8GB of RAM for a 4GB model, possibly because they don't know how mmap works.)

dachryn on March 24, 2023 [–]

alpaca lora is quite capable actually and is suddenly gaining a hell of a lot of traction in the corporate world

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact