logo

Llamafile, Mozilla’s portable LLM runner, gets GPU support and a rebuilt core

ID: 93229fea-8bec-55db-9661-947728ce2e7b

STIX ID: report--93229fea-8bec-55db-9661-947728ce2e7b

Feed Name: Help Net Security

Date Published: 2026-03-20

Date Updated: 2026-04-28

Author: Anamarija Pogorelec

...
...

Llamafile 0.10.0 is a major rewrite focused on portability and bundling model weights, reintroducing GPU acceleration (CUDA on Linux, Metal on macOS), adding a terminal UI, server and CLI modes, multimodal and speech support (including Whisper), updating llama.cpp for new model support, simplifying the build system, and shipping several example llamafiles while noting remaining unported features and missing Windows GPU support.

Your team is not currently subscribed to this feed. You must subscribe to it in order to see this post.