Best model interpretability AI tools

dmodel.ai is an AI research and deployment company offering tools for model interpretability, monitoring, and control. It helps businesses understand, steer, and retrain their AI models, ensuring reliability, safety, and alignment for enterprise-grade deployments.

Captum is an open-source model interpretability and explainability library for PyTorch. It provides state-of-the-art algorithms to help developers and researchers understand which features influence a model's predictions. Supporting multi-modal data like text, vision, and more, Captum makes it easy to debug models, improve transparency, and benchmark new interpretability techniques within the PyTorch ecosystem.

Transluce is an independent research lab developing open, scalable technology to understand AI systems. They build tools like Docent and Monitor to analyze, evaluate, and intervene in AI agent behavior, promoting responsible AI development through enhanced interpretability and safety.