-
Notifications
You must be signed in to change notification settings - Fork 2.9k
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Describe the bug
Traceback (most recent call last):
File "/home/luca/.cache/pypoetry/virtualenvs/<NAME>-p2Ot1sDh-py3.12/bin/oaieval", line 8, in <module>
sys.exit(main())
^^^^^^
File "/home/luca/.cache/pypoetry/virtualenvs/<NAME>-p2Ot1sDh-py3.12/lib/python3.12/site-packages/evals/cli/oaieval.py", line 304, in main
run(args)
File "/home/luca/.cache/pypoetry/virtualenvs/<NAME>-p2Ot1sDh-py3.12/lib/python3.12/site-packages/evals/cli/oaieval.py", line 227, in run
add_token_usage_to_result(result, recorder)
File "/home/luca/.cache/pypoetry/virtualenvs/<NAME>-p2Ot1sDh-py3.12/lib/python3.12/site-packages/evals/cli/oaieval.py", line 279, in add_token_usage_to_result
key: sum(u[key] if u[key] is not None else 0 for u in usage_events)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: unsupported operand type(s) for +: 'int' and 'dict'
To Reproduce
Run any eval
Code snippets
No response
OS
macOS
Python version
v3.12
Library version
3.0.1.post1
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working