Skip to content

[MISC] Aggregate speed benchmark wandb uploads into a single run.#2482

Merged
duburcqa merged 5 commits intoGenesis-Embodied-AI:mainfrom
hughperkins:hp/wandb-aggregate-runs
Mar 3, 2026
Merged

[MISC] Aggregate speed benchmark wandb uploads into a single run.#2482
duburcqa merged 5 commits intoGenesis-Embodied-AI:mainfrom
hughperkins:hp/wandb-aggregate-runs

Conversation

@hughperkins
Copy link
Copy Markdown
Collaborator

@hughperkins hughperkins commented Feb 28, 2026

Instead of creating a separate wandb run per benchmark test case, upload all speed/FPS results via upload_benchmarks_table_to_wandb.py after all benchmarks complete, matching the memory benchmark approach.

Instead of creating a separate wandb run per benchmark test case,
upload all speed/FPS results via upload_benchmarks_table_to_wandb.py
after all benchmarks complete, matching the memory benchmark approach.

Made-with: Cursor
Switch speed data fetching from WandbParserOldFormat (one run per test
in genesis-benchmarks project) to WandbParserNewFormat (single run with
speed- prefix in genesis-benchmarks-2 project), matching the change in
production.yml. Remove now-unused WandbParserOldFormat class.

Made-with: Cursor
@github-actions
Copy link
Copy Markdown

⚠️ Abnormal Benchmark Result Detected ➡️ Report

@duburcqa duburcqa changed the title [MISC] Aggregate speed benchmark wandb uploads into a single run [MISC] Aggregate speed benchmark wandb uploads into a single run. Feb 28, 2026
@hughperkins hughperkins marked this pull request as ready for review February 28, 2026 23:48
@hughperkins
Copy link
Copy Markdown
Collaborator Author

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Mar 1, 2026

⚠️ Abnormal Benchmark Result Detected ➡️ Report

@duburcqa duburcqa merged commit b9a8c2e into Genesis-Embodied-AI:main Mar 3, 2026
22 of 24 checks passed
@hughperkins hughperkins deleted the hp/wandb-aggregate-runs branch March 23, 2026 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants