Skip to content

Initial stab at moving benchmark logic to python.#1301

Draft
erikfrey wants to merge 2 commits intogoogle-deepmind:mainfrom
erikfrey:benchmark_python
Draft

Initial stab at moving benchmark logic to python.#1301
erikfrey wants to merge 2 commits intogoogle-deepmind:mainfrom
erikfrey:benchmark_python

Conversation

@erikfrey
Copy link
Copy Markdown
Collaborator

Cleans up testspeed to be only human readable output. Moves benchmark running to benchmarks/run.py with example in humanoid.

Cleans up testspeed to be only human readable output.  Moves
benchmark running to benchmarks/run.py with example in humanoid.
@erikfrey erikfrey requested a review from thowell April 20, 2026 18:35
@@ -0,0 +1,16 @@
BENCHMARKS = [
Copy link
Copy Markdown
Collaborator

@thowell thowell Apr 20, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is the plan to add an __init__.py file for every directory in benchmarks?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes! I'm going to do aloha next because I want to add asset fetching next to this approach.

"mjcf": "humanoid.xml",
"nworld": 8192,
"nconmax": 24,
"njmax": 72,
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is it intential to change the value of this parameter?

humanoid humanoid/humanoid.xml 8192 24 64 - -

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was getting overflow warnings, weirdly. I'll reconcile whether something changed at HEAD or whether I broke something (and then fix it) as part of this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants