Port of Facebook's LLaMA model in C/C++ - /dev/zine

Calcish: calculate with JavaScript, use local LLMs.

Link

# Port of Facebook's LLaMA model in C/C++

Impressive. It runs fine on my M1 MacBook Air with 8 GB RAM.

Simon Willison wrote a post on how to use it.

12 March 2023 / #ai / #cpp