Loading listing…
gguf-quantization
Security scan passedGGUF format and llama.cpp quantization for efficient CPU/GPU inference.
Part of AI Research Skills (Orchestra)Pack · 98 skills
by Orchestra-Research· AI & agentsUnclaimed · Yours? Claim it
What gguf-quantization does
About
GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.
Install gguf-quantization
More from AI & agents
Skills people install alongside gguf-quantization.
