townsendmerino/goinfer

Pure-Go, no-cgo local LLM inference — run Gemma, Qwen, Llama and friends from safetensors or GGUF in a single static binary.

View on GitHub
Go
Stars 16
Forks 5
License MIT
Open Issues 0
Updated 7m ago