Local models, honestly.
Point Kayon at a Windows machine with an NVIDIA card. It reads the hardware, tells you which models will actually run before you spend a gigabyte downloading them, and keeps every token on your own GPU. No account. No cloud. Nothing to trust but the math.
Not file_size < VRAM. A real memory model.
You download a 13 GB model at 4 MB/s. Forty minutes later it loads, then answers at two tokens a second because it quietly spilled into shared system memory. The tool swore it would fit.
It had compared a file size to your VRAM. Every local-LLM app makes that guess, and it fails exactly when it costs you most. Kayon runs the real numbers per quant instead: weights, KV cache at your context length, compute buffers, and the headroom Windows needs, all against true dedicated free VRAM. You read the verdict for your GPU before the download starts.
What makes Kayon different.
Honest fit
One verdict per quant: fits fully, fits tight, GPU+CPU split, CPU-only, or exceeds this machine. The pick that runs best on your GPU leads the page, so the fastest first move is usually the right one.
Adopt from Ollama
Already have a shelf of models in Ollama? Kayon links them in place with NTFS hard links. Zero bytes copied, zero re-downloaded. Delete Kayon's link later and Ollama's copy stays right where it was.
Private by construction
No account. No cloud. Telemetry stays off until you switch it on, and then Kayon shows you the literal payload before anything leaves the machine. Every outbound request lands in a log you can read.
The core
Explainable down to the gigabyte.
A verdict is never just a color. Open any quant and Kayon shows exactly how it got there.
Weights from the GGUF header, KV cache at your context length (GQA-aware, reading the model's real key_length instead of a naive division), plus compute buffers and CUDA overhead, all measured against true dedicated free VRAM. No shared-memory spill hiding behind a green light.
Verdict breakdown · Q6_K @ 8K ctx
Probe your hardware
NVML reads your GPU, VRAM, driver, CPU, RAM and disk directly, live at 1 Hz. No supported GPU? Kayon still runs and computes verdicts against system RAM.
See what fits
Browse a signed, verified catalog. Every quant shows an honest verdict for your machine, and the computed best pick leads. It is never a hardcoded default.
Download, checksummed
Resumable downloads with a disk pre-flight and SHA-256 verification against the pinned checksum. A mismatch gets quarantined and never enters your library.
Load & chat
One press loads a model through a managed llama.cpp runtime. You get streaming, reasoning, and tool calling wherever the model supports it, with live tokens per second.
No macOS or AMD in v1. No fine-tuning, no server mode, no multi-agent orchestration. Kayon does one thing: run local models honestly and privately, and do it well.
Stop downloading models that won't run.
Free, offline by default, and entirely yours. Point Kayon at your GPU and find out what it can actually do.