Inputs
| Parameter | Description | Data Type | Required | Range |
|---|---|---|---|---|
model | The model to apply KV Cache optimization on. | MODEL | Yes |
Outputs
| Output Name | Description | Data Type |
|---|---|---|
model | The patched model with KV Cache optimization enabled. | MODEL |
This documentation was AI-generated. If you find any errors or have suggestions for improvement, please feel free to contribute! Edit on GitHub
Source fingerprint (SHA-256):
bf2b19dd11336bec694a6eb586141fa850e3d0a5102c5d320455f7346738660c