compress_context_tool
Compress text context by removing irrelevant information relative to a user question, significantly reducing context size while retaining key content for LLM processing.
Instructions
Compress text context using LLMLingua with a local model.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| context | Yes | ||
| question | Yes | ||
| target_tokens | No | ||
| rate | No |