Skip to content

update intrinsic tests #1029

@jakelorocco

Description

@jakelorocco
  1. add tests (especially the canned input / output, json file tests) for requirement-check
  2. add tests (same as above) for uncertainty
  3. make tests resilient to future adapter changes:
    a. record the versions for current adapters
    b. if adapter version changes, xfail the test for the given adapter only if the test actually fails
    c. have a test that doesn't run during CICD, that always fails when versions change (this will be run in nightlies and alert us)

Metadata

Metadata

Assignees

Labels

area/intrinsicsGranite intrinsic adapters: RAG, Guardian, Corearea/stdlibCore abstractions: Context, MOT, SamplingStrategy, formatters, serializationenhancementNew feature or request

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions