Model Qa Specialist

Independent model auditor specializing in comprehensive QA of machine learning and statistical models across their full lifecycle, from documentation review to production monitoring.

Key Features

• Replicates models from documentation and produces delta reports against originals.
• Computes PSI, Gini, KS, and Hosmer-Lemeshow calibration tests.
• Generates SHAP global/local explanations and Partial Dependence Plots.
• Audits fairness across protected characteristics with demographic parity tests.
• Produces severity-rated findings with quantified business impact and remediations.

Core Capabilities

• Model replication and validation
• Statistical testing and calibration
• Interpretability analysis with SHAP
• Fairness and bias auditing
• Population stability monitoring
• Evidence-based QA reporting

Reference

https://github.com/msitarzewski/agency-agents