Point an existing OpenAI, Claude, or Ollama client at one endpoint. Requests route to a node that already has the model loaded.
Open models it can run
The idea
Models sharded across nodes, placed by topology.
Anyone can run a node. Any open model.
Pipeline and tensor parallelism; RDMA over Thunderbolt.
Verifiable execution. Not built yet.
Run a node locally, or call the managed endpoint. The same OpenAI-compatible API either way.