pi-llama-infra
Discovery, metrics and control of llama.cpp-family servers and OpenAI-compatible servers for pi (llama.cpp, ZINC, DwarfStar/ds4, lucebox, LM Studio, vLLM, SGLang, TGI, halogen): scan machines (localhost, LAN, Tailscale), register models, read real context
Version 1.8.1 License MIT
Keywords
pi-packagellamacppllama.cpplocal-modelsdiscoverymetricstailscalevisionthinkinglm-studiolmstudiovllmsglangtgihalogen
INSTALL