Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DSPy] Capture messages, token counts in the instrumentation #532

Open
mikeldking opened this issue Jun 18, 2024 · 0 comments
Open

[DSPy] Capture messages, token counts in the instrumentation #532

mikeldking opened this issue Jun 18, 2024 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed language: python Related to Python integration triage Issues that require triage

Comments

@mikeldking
Copy link
Contributor

Token counts can be missing since the DSPy instrumentor only instruments the LM module but should attempt to capture the tokens as part of the instrumentation process for all built-in llms

@mikeldking mikeldking added enhancement New feature or request triage Issues that require triage language: python Related to Python integration help wanted Extra attention is needed labels Jun 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed language: python Related to Python integration triage Issues that require triage
Projects
Status: 📘 Todo
Development

No branches or pull requests

1 participant