pi-prefix-cache-compaction
jagdeepsinghdev esm
Pi compaction that reuses the server's prefix cache (vLLM / SGLang / llama.cpp Anthropic endpoints): no cold re-prefill of the history, and a warm-up so the next turn starts from cache.
Version 0.2.0 License MIT
Keywords
pi-packagepipi-extensionpi-coding-agentcoding-agentextensioncompactioncontext-compactionauto-compactprefix-cacheprompt-cachekv-cachekv-cache-reuseanthropic-messagesvllm
INSTALL
Requests 0
Bandwidth 0
Top version - 0
Full pi-prefix-cache-compaction Download Stats 
ShareKeywords
pi-package
pi
pi-extension
pi-coding-agent
coding-agent
extension
compaction
context-compaction
auto-compact
prefix-cache
prompt-cache
kv-cache
kv-cache-reuse
anthropic-messages
vllm
sglang
llama.cpp
qwen
local-llm
self-hosted
Get a badge for your package
