Loading listing…
llama-cpp
Security scan passedRuns LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware.
Part of AI Research Skills (Orchestra)Pack · 98 skills
by Orchestra-Research· AI & agentsUnclaimed · Yours? Claim it
What llama-cpp does
About
Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU.
Install llama-cpp
More from AI & agents
Skills people install alongside llama-cpp.
