pi-llama-infra

pi-llama-infra JS library on GitHub pi-llama-infra JS library on npm Download pi-llama-infra JS library

Discovery, metrics and control of llama.cpp-family servers and OpenAI-compatible servers for pi (llama.cpp, ZINC, DwarfStar/ds4, lucebox, LM Studio, vLLM, SGLang, TGI, halogen): scan machines (localhost, LAN, Tailscale), register models, read real context

Version 1.8.1 License MIT
pi-llama-infra has no homepage
pi-llama-infra JS library on GitHub
pi-llama-infra JS library on npm
Download pi-llama-infra JS library
Keywords
pi-packagellamacppllama.cpplocal-modelsdiscoverymetricstailscalevisionthinkinglm-studiolmstudiovllmsglangtgihalogen