LLaMa

Running LLaMA on Raspberry Pi: Cost-Effective Fine-Tuning

by
Running LLaMA on Raspberry Pi: Cost-Effective Fine-Tuning

picture tloen/alpaca-lorahttps://github.com/tloen/alpaca-lora Stars: 18.2k License: Apache-2.0 Alpaca-lora is a project for fine-tuning the LLaMA model on consumer-grade hardware. The main features, key characteristics, and core advantages of this project include: Provides an Instruct model that can run on Raspberry Pi, with quality similar to text-davinci-003, and the code is easy to extend to 13b, 30b, … Read more

Running Large Models on Mobile Devices Made Easy

by
Running Large Models on Mobile Devices Made Easy

Reporting by Machine Heart, Machine Heart Editorial Team For some inference tasks of large models, the bottleneck is not computational power (FLOPS). Recently, many people in the open-source community have been exploring optimization methods for large models. A project called llama.cpp has rewritten the inference code of LLaMa in pure C++, achieving excellent results and … Read more