.truncate { white-space: nowrap; text-overflow: ellipsis; }

Improving Machine-Learning Transparency with Model Cards

Walter Ullon and Amit Rath

The use and adoption of A.I.-integrated solutions and Machine Learning models has not always come hand-in-hand with efforts to increase their transparency. Model Cards aim to encapsulate all the relevant information needed to complete an audit in a succinct, easy-to-understand format.

In addition to greatly facilitating the model governance/risk and compliance approval process, Model Cards can encourage model democratization and reproducibility across the organization by detailing “the recipe” within the model itself rather than containing it with an individual or group of individuals.

Image of model governance framework

We recommend providing the following type of information for a good Model Card:

  • Model ownership. Which groups within the organization will leverage the model?
  • Intended use/scope. Loan risk assessment, forecasting, anomaly detection, trade break classification)
  • Ethical considerations. Could the model’s predictions seriously impact people’s lives?
  • Evaluation metrics. Accuracy, f-score, recall, precision
  • Required libraries and their corresponding versions. Has compliance checked the licensing of these?
  • Training/creation date
  • Hyper-parameters used in training: Can we recreate the results?
  • Overview of training data. Should include:  target labels, number of records, features used, etc.

EZOPS’ Model Cards Expedite the Approval of Models

We embedded Model Cards into the EZOPS A.I. Control Hub. Each model trained in our application can generate the requisite Model Card with a simple click of a button. Anyone with permissions to the model can quickly export the report on demand as a pdf and access the information contained therein to review the different components.

This facilitates model reporting by automating the generation of accompanying documents for all trained machine learning models and, in turn, expedites the review, audit, and approval of models, removing some of the burden typically associated with the sourcing and gathering of each of its underlying components.

Image of model summary
Image of data summary

For more information on EZOPS’ Model Cards or how our machine learning capabilities can boost your organization’s productivity contact sales@ezops.com.

Begin Your Automation Journey
Contact us