Skip to content

Add a script that launches a benchmark from a yaml file or a set of parameters#573

Open
R-Palazzo wants to merge 7 commits intoissue-532-define-yaml-filesfrom
issue-546-benchmark-generator
Open

Add a script that launches a benchmark from a yaml file or a set of parameters#573
R-Palazzo wants to merge 7 commits intoissue-532-define-yaml-filesfrom
issue-546-benchmark-generator

Conversation

@R-Palazzo
Copy link
Collaborator

Resolve #546
CU-86b8h63t2

@R-Palazzo R-Palazzo self-assigned this Mar 11, 2026
@R-Palazzo R-Palazzo requested a review from a team as a code owner March 11, 2026 14:18
@sdv-team
Copy link
Contributor

@R-Palazzo R-Palazzo removed the request for review from a team March 11, 2026 14:18
@R-Palazzo R-Palazzo force-pushed the issue-546-benchmark-generator branch from fe78012 to 6913f4f Compare March 11, 2026 14:35
@codecov
Copy link

codecov bot commented Mar 11, 2026

Codecov Report

❌ Patch coverage is 98.05825% with 2 lines in your changes missing coverage. Please review.
✅ Project coverage is 83.37%. Comparing base (5c42adb) to head (e74bae6).

Files with missing lines Patch % Lines
sdgym/_benchmark_launcher/script.py 98.05% 2 Missing ⚠️
Additional details and impacted files
@@                       Coverage Diff                       @@
##           issue-532-define-yaml-files     #573      +/-   ##
===============================================================
+ Coverage                        82.91%   83.37%   +0.45%     
===============================================================
  Files                               38       39       +1     
  Lines                             3301     3404     +103     
===============================================================
+ Hits                              2737     2838     +101     
- Misses                             564      566       +2     
Flag Coverage Δ
integration 46.38% <0.00%> (-1.45%) ⬇️
unit 78.78% <98.05%> (+0.60%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Comment on lines +19 to +20
parser.add_argument('--datasets', type=str, default=None)
parser.add_argument('--synthesizers', type=str, default=None)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this be nargs instead of strings ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants