Oryn reference application
Local streaming chat
Checking Oryn runtime…
Message
Explain KV cache in one sentence.
Maximum response length
Short · 96 tokens
Medium · 256 tokens
Long · 512 tokens
Generate locally