MAINT Add run_initializers_async, Entra auth, and config-file support by romanlutz · Pull Request #1418 · Azure/PyRIT

romanlutz · 2026-03-01T13:02:31Z

Add run_initializers_async to pyrit.setup for programmatic initialization
Add --config-file flag to pyrit_backend CLI
Use PyRIT configuration loader in FrontendCore and pyrit_backend

The changes in the following are simply waiting for #1404 and will disappear from this PR:

Switch AIRTInitializer to Entra (Azure AD) auth, removing API key requirements
Update AIRTTargetInitializer with new target types

- Add run_initializers_async to pyrit.setup for programmatic initialization - Switch AIRTInitializer to Entra (Azure AD) auth, removing API key requirements - Add --config-file flag to pyrit_backend CLI - Use PyRIT configuration loader in FrontendCore and pyrit_backend - Update AIRTTargetInitializer with new target types Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot

Pull request overview

This PR extends PyRIT’s initialization flow to support a lighter-weight “run initializers only” step, adds backend CLI support for YAML config files, and updates AIRT initialization to use Entra ID-based auth (with additional target configuration support).

Changes:

Add run_initializers_async to pyrit.setup and refactor initialization to reuse it.
Add --config-file support to pyrit_backend and migrate CLI core flows to use ConfigurationLoader.
Update AIRT initializer/targets (Entra auth in AIRTInitializer, extra kwargs support + GPT-5 high-reasoning target in AIRTTargetInitializer) and adjust tests accordingly.

Reviewed changes

Copilot reviewed 10 out of 10 changed files in this pull request and generated 5 comments.

Show a summary per file

File	Description
`pyrit/setup/initialization.py`	Adds `run_initializers_async` and makes `initialize_pyrit_async` delegate initializer execution to it.
`pyrit/setup/__init__.py`	Re-exports `run_initializers_async` from the `pyrit.setup` public API.
`pyrit/cli/frontend_core.py`	Switches to configuration-driven initialization; separates “initialize registries/memory” from “run initializers”.
`pyrit/cli/pyrit_backend.py`	Adds `--config-file` and uses `FrontendCore` for initialization + initializer execution before starting Uvicorn.
`pyrit/setup/initializers/airt.py`	Migrates AIRT initialization to Entra auth token providers (DefaultAzureCredential-based flow).
`pyrit/setup/initializers/airt_targets.py`	Adds `extra_kwargs` support for target construction and introduces a GPT-5 high-reasoning Responses target configuration.
`tests/unit/cli/test_pyrit_backend.py`	Adds unit tests for `pyrit_backend` argument parsing and config-file forwarding to `FrontendCore`.
`tests/unit/cli/test_frontend_core.py`	Updates unit tests for the new frontend initialization and initializer-running behavior.
`tests/unit/setup/test_airt_initializer.py`	Updates tests for Entra auth (removes API key requirements from required env var assertions).
`tests/unit/setup/test_airt_targets_initializer.py`	Adds coverage for the new GPT-5 high-reasoning target extra body parameters.

Copilot · 2026-03-01T13:06:48Z

pyrit/setup/initializers/airt_targets.py

-from dataclasses import dataclass
-from typing import Any, Optional
+from dataclasses import dataclass, field
+from typing import Any, Dict, List, Optional, Type


List and Type are imported but unused, which will fail linting (ruff F401) in this repository. Please remove unused imports or use them (e.g., if you intended to type TARGET_CONFIGS/target_class).

Suggested change

from typing import Any, Dict, List, Optional, Type

from typing import Any, Dict, Optional

Copilot · 2026-03-01T13:06:48Z

pyrit/setup/initializers/airt_targets.py

+        endpoint_var="OPENAI_VIDEO_ENDPOINT",
+        key_var="OPENAI_VIDEO_KEY",
+        model_var="OPENAI_VIDEO_MODEL",
    ),


The video target config was renamed and switched from AZURE_OPENAI_VIDEO_* env vars to OPENAI_VIDEO_*. This breaks existing configs and is inconsistent with the rest of the repo (integration tests and docs still reference AZURE_OPENAI_VIDEO_ENDPOINT/KEY/MODEL). Consider keeping the AZURE_OPENAI_VIDEO_* variables (and azure_openai_video registry name) or supporting both sets for backward compatibility; also update the docstring section that still mentions AZURE_OPENAI_VIDEO_* accordingly.

Suggested change

),

),

TargetConfig(

registry_name="azure_openai_video",

target_class=OpenAIVideoTarget,

endpoint_var="AZURE_OPENAI_VIDEO_ENDPOINT",

key_var="AZURE_OPENAI_VIDEO_KEY",

model_var="AZURE_OPENAI_VIDEO_MODEL",

),

Copilot · 2026-03-01T13:06:48Z

pyrit/setup/initialization.py

+async def run_initializers_async(
+    *,
+    initializers: Optional[Sequence["PyRITInitializer"]] = None,
+    initialization_scripts: Optional[Sequence[Union[str, pathlib.Path]]] = None,
+) -> None:
+    """
+    Run initializers and initialization scripts without re-initializing memory or environment.
+
+    This is useful when memory and environment are already set up (e.g. via
+    :func:`initialize_pyrit_async`) and only the initializer step needs to run.
+
+    Args:
+        initializers: Optional sequence of PyRITInitializer instances to execute directly.
+        initialization_scripts: Optional sequence of Python script paths containing
+            PyRITInitializer classes.
+
+    Raises:
+        ValueError: If initializers are invalid or scripts cannot be loaded.
+    """
    all_initializers = list(initializers) if initializers else []

-    # Load additional initializers from scripts
    if initialization_scripts:
        script_initializers = _load_initializers_from_scripts(script_paths=initialization_scripts)
        all_initializers.extend(script_initializers)

-    # Execute all initializers (sorted by execution_order)
    if all_initializers:
        await _execute_initializers_async(initializers=all_initializers)


run_initializers_async is a new public API surface but there are no unit tests covering its behavior (e.g., that it loads initializers from scripts, executes in execution_order, and does not reset defaults / reinitialize memory). Since initialize_pyrit_async already has orchestration tests, consider adding focused tests for this new function as well.

Copilot · 2026-03-01T13:06:49Z

pyrit/setup/initialization.py

+            PyRITInitializer classes.
+
+    Raises:
+        ValueError: If initializers are invalid or scripts cannot be loaded.


The run_initializers_async docstring says it raises ValueError when scripts cannot be loaded, but _load_initializers_from_scripts() can also raise FileNotFoundError (and potentially other exceptions during import). Please update the Raises: section to reflect the actual exception types callers should handle.

Suggested change

ValueError: If initializers are invalid or scripts cannot be loaded.

ValueError: If one or more provided initializers are invalid.

FileNotFoundError: If an initialization script path does not exist.

Exception: If an error occurs while importing initialization scripts or executing initializers.

Copilot · 2026-03-01T13:06:49Z

tests/unit/cli/test_frontend_core.py


        assert context._database == frontend_core.SQLITE
        assert context._initialization_scripts is None
-        assert context._initializer_names is None
+        assert context._initializer_names == ["airt", "airt_targets"]
        assert context._log_level == logging.WARNING


test_init_with_defaults asserts FrontendCore()._initializer_names == ["airt", "airt_targets"], but ConfigurationLoader.load_with_overrides() defaults to an empty initializer list when ~/.pyrit/.pyrit_conf does not exist. That means _initializer_names will typically be None, making this test dependent on a developer machine’s home directory state and likely to fail on CI. Consider patching pyrit.setup.configuration_loader.DEFAULT_CONFIG_PATH.exists() to False (or passing an explicit temporary config_file) and asserting the deterministic default instead.

Copilot AI review requested due to automatic review settings March 1, 2026 13:02

Copilot started reviewing on behalf of romanlutz March 1, 2026 13:03 View session

Copilot AI reviewed Mar 1, 2026

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

MAINT Add run_initializers_async, Entra auth, and config-file support#1418

MAINT Add run_initializers_async, Entra auth, and config-file support#1418
romanlutz wants to merge 1 commit intoAzure:mainfrom
romanlutz:romanlutz/initializer-entra-auth

romanlutz commented Mar 1, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Mar 1, 2026

Uh oh!

Copilot AI Mar 1, 2026

Uh oh!

Copilot AI Mar 1, 2026

Uh oh!

Copilot AI Mar 1, 2026

Uh oh!

Copilot AI Mar 1, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

	from typing import Any, Dict, List, Optional, Type
	from typing import Any, Dict, Optional

-    ),
+    ),
+    TargetConfig(
+        registry_name="azure_openai_video",
+        target_class=OpenAIVideoTarget,
+        endpoint_var="AZURE_OPENAI_VIDEO_ENDPOINT",
+        key_var="AZURE_OPENAI_VIDEO_KEY",
+        model_var="AZURE_OPENAI_VIDEO_MODEL",
+    ),

-        ValueError: If initializers are invalid or scripts cannot be loaded.
+        ValueError: If one or more provided initializers are invalid.
+        FileNotFoundError: If an initialization script path does not exist.
+        Exception: If an error occurs while importing initialization scripts or executing initializers.

Conversation

romanlutz commented Mar 1, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Mar 1, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 1, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 1, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 1, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 1, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants