Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Logging metrics for agents #4172

Open
fniedtner opened this issue Nov 13, 2024 · 0 comments
Open

Logging metrics for agents #4172

fniedtner opened this issue Nov 13, 2024 · 0 comments
Assignees
@ekzhu @jackgerrits
Labels
proj-agentchat proj-core
Milestone
0.4.0

Comments

@fniedtner
Copy link
Collaborator

fniedtner commented Nov 13, 2024 •
edited by ekzhu
Loading

support following metrics for parity with 0.2:

  • Agent Conversation History
  • No of Call to the LLM
  • LLM Latency
  • Request and Response Token count
  • Agent Interaction Count
  • LLM Request and Response Payload
@jackgerrits jackgerrits added this to the 0.4.0 milestone Nov 13, 2024
@ekzhu ekzhu changed the title metrics Tracking metrics for agents Dec 3, 2024
@ekzhu ekzhu added the proj-core label Dec 3, 2024
@ekzhu ekzhu changed the title Tracking metrics for agents Logging metrics for agents Dec 3, 2024
@ekzhu ekzhu mentioned this issue Dec 16, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ekzhu ekzhu

@jackgerrits jackgerrits

Labels
proj-agentchat proj-core
Projects
None yet
Milestone
0.4.0
Development

No branches or pull requests
3 participants
@ekzhu @jackgerrits @fniedtner