Install
- Python 3.11 or newer.
- A target service, Python callable, or driver config for the domain you want to test.
python -m pip install evidpath
Recommender Audit
evidpath audit --domain recommender \ --target-url http://127.0.0.1:8051 \ --scenario returning-user-home-feed \ --seed 7
Search Audit
evidpath audit --domain search \ --target-url http://127.0.0.1:8051 \ --scenario time-sensitive-query \ --seed 7
Agent Audit
evidpath audit --domain agents \ --scenario current-info-tool-use \ --driver-config-path ./driver_config.json \ --seed 7
Compare Before Launch
Use compare when a candidate target should be reviewed against a baseline under comparable domain coverage.
evidpath compare --domain recommender \ --baseline-url http://127.0.0.1:8051 \ --candidate-url http://127.0.0.1:8052 \ --baseline-label current-prod \ --candidate-label next-build \ --rerun-count 2