Skip to content

Response trimming options #181

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
toby opened this issue Apr 8, 2025 · 1 comment
Open

Response trimming options #181

toby opened this issue Apr 8, 2025 · 1 comment

Comments

@toby
Copy link
Member

toby commented Apr 8, 2025

Many of the responses from the API are very large and eat valuable context window. We should think through strategies on how to give the model options for smaller results. That might be *_small tools that return trimmed results or possibly the option for the model to pass in a nested set of keys to select.

@JanProvaznik
Copy link

This blocks a use case of using the GH mcp with GH copilot agent mode, which I'd expect to integrate well.

Example of what happens now:
I give GHC Agent mode in vscode the GH mcp server, ask it for summarizing issues with a label, it queries github, receives 200k tokens as a response, everything else falls out of the context window and it forgets what is it doing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants