Quickly generate statistics to evaluate and monitor model performance. .
Perform A/B Testing
Perform champion challenger between models..
Meet Set Goals
Compare model performance to benchmarks..
Feed outputs of Compare into an existing dashboard or alerting system..
Compare is a microservice that will generate statistics between two streams of data; one is a truth stream and a second stream under test. Generated statistics allow the user to understand the accuracy and performance of models, and Compare can be used in production or during development and test to compare candidate models.
Evaluate model performance
Curabitur et pretium mi. Cras nec urna ut magna vehicula.a
Report on model metrics
Use in dev, test and production
Evaluate need for retraining