compress_context_tool
Filter and compress text context using a local LLMLingua model, guided by a question, to reduce token count before sending to an LLM.
Instructions
Compress text context using LLMLingua with a local model.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| context | Yes | ||
| question | Yes | ||
| target_tokens | No | ||
| rate | No |