Skip to content

Add Fermi sanity check validation gate (#88)#225

Open
neoneye wants to merge 1 commit intomainfrom
feature/88-fermi-validation-gate
Open

Add Fermi sanity check validation gate (#88)#225
neoneye wants to merge 1 commit intomainfrom
feature/88-fermi-validation-gate

Conversation

@neoneye
Copy link
Member

@neoneye neoneye commented Mar 9, 2026

Summary

  • Adds a rule-based validation gate that audits distilled plan assumptions for common failure modes
  • Checks for: missing quantification (no numbers/bounds), implausibly wide range spans (>100x ratio), and low-confidence language without evidence references
  • Runs as a pipeline task (FermiSanityCheckTask) after DistillAssumptionsTask — no LLM calls, fast execution
  • Outputs both raw JSON and markdown report (003-12-fermi_sanity_check_raw.json, 003-13-fermi_sanity_check.md)

Implements proposal #88.

Test plan

  • Syntax check passes for all modified files
  • Standalone module runs correctly with sample assumptions
  • Pipeline integration test in Docker

🤖 Generated with Claude Code

Rule-based validation that audits distilled assumptions for common
failure modes: missing quantification, implausibly wide ranges (>100x
span ratio), and low-confidence claims without evidence references.
Runs as a pipeline task after DistillAssumptionsTask with no LLM calls.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@neoneye neoneye deleted the branch main March 10, 2026 00:48
@neoneye neoneye closed this Mar 10, 2026
@neoneye neoneye reopened this Mar 10, 2026
@neoneye neoneye changed the base branch from feature/plan-resume-tool to main March 10, 2026 01:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant