rwilliamspbg-ops/Ghostlink

Distributed LLM inference fabric for heterogeneous local clusters. Features zero-copy SPSC ring buffers, automated tuning, and an OpenAI-compatible API.

View on GitHub
Rust
Stars 46
Forks 8
License MIT
Open Issues 0
Updated 7m ago