[BUG] Cannot configure context window usage

[eureka0928]

Project

cortex

Description

No way to limit context window usage for cost control.

Error Message

Debug Logs

System Information

Windows 10/11
Version Tested: v0.1.1

Screenshots

No response

Steps to Reproduce

1. Check config options

Expected Behavior

max_context_tokens or context_budget configuration

Actual Behavior

No context limit options

Additional Context

No response

[echobt]

Thank you for reporting this issue! We've confirmed the problem and submitted a fix.

The issue you described has been addressed - you'll now be able to configure context window limits directly in the configuration file to help manage costs. The configuration options include the ability to set a maximum context window size and a token limit that triggers automatic compaction of older messages.

The fix is now under review: CortexLM/cortex-cli#113

Once the fix is merged, it will be available in the next release. To use these new options, run cortex config --edit and you'll see the documented configuration options.

Thanks for helping us improve!