pi-prefix-cache-compaction

pi-prefix-cache-compaction JS library on GitHub pi-prefix-cache-compaction JS library on npm Download pi-prefix-cache-compaction JS library

Pi compaction that reuses the model server's prefix cache (vLLM, SGLang, llama.cpp, or hosted APIs with automatic caching such as DeepSeek; Anthropic Messages and OpenAI Chat Completions): no cold re-prefill of the history, a warm-up so the next turn star

Version 0.5.0 License MIT
pi-prefix-cache-compaction has no homepage
pi-prefix-cache-compaction JS library on GitHub
pi-prefix-cache-compaction JS library on npm
Download pi-prefix-cache-compaction JS library
Keywords
pi-packagepipi-extensionpi-coding-agentcoding-agentextensioncompactioncontext-compactionauto-compactprefix-cacheprompt-cachekv-cachekv-cache-reuseanthropic-messageschat-completions