Summary
PR #334 added 4 dbt assessors with a combined 26% weight (10+10+3+3). Need to verify that non-dbt projects are unaffected when these assessors return is_applicable=False.
Question
How does the scoring engine handle assessors that return is_applicable=False?
- If it skips them and re-normalizes weights: no impact (correct behavior)
- If it includes them with a 0 score: every non-dbt project's overall score drops
What to check
- Look at the scoring aggregation logic (likely in
src/agentready/services/ or the assessment pipeline)
- Confirm
is_applicable=False assessors are excluded from weight normalization
- Run a before/after comparison on a non-dbt repo (e.g., any Python project on the leaderboard)
Context
The Tier 1 assessor count went from 6 to 10 with this PR. If weights aren't re-normalized, Tier 1 now sums to more than intended.
Found in
PR #334 — Feature/add dbt support
🤖 Generated with Claude Code
Summary
PR #334 added 4 dbt assessors with a combined 26% weight (10+10+3+3). Need to verify that non-dbt projects are unaffected when these assessors return
is_applicable=False.Question
How does the scoring engine handle assessors that return
is_applicable=False?What to check
src/agentready/services/or the assessment pipeline)is_applicable=Falseassessors are excluded from weight normalizationContext
The Tier 1 assessor count went from 6 to 10 with this PR. If weights aren't re-normalized, Tier 1 now sums to more than intended.
Found in
PR #334 — Feature/add dbt support
🤖 Generated with Claude Code