IRINA WOLF
Designing for AI: streamlining issue detection with human-centered design
I led UX for an AI/ML anomaly detection tool at a major manufacturer. I designed workflows, dashboards, and feedback systems that helped engineers catch quality issues earlier—cutting down false positives, building
trust in AI, and saving $200M+ in potential costs.
Fortune 500 Corp AI/ML Enterprise B2B Web App
Company/Industry
Fortune 500 Corp,
manufacturing
Role
Lead UX Product Designer (Solo Designer)
Team
3 POs, PM, data scientists, tech anchor, software engineers
Timeline
2022-2024
.png)
Business Context
Catching quality problems early is crucial to reducing warranty costs and recalls. A new internal AI/ML anomaly detection app was developed to help engineers detect quality issues during production.
When I joined, the tool had already launched but adoption was low. The AI model was in its early stages — highly prone to false positives, unreliable patterns, and poor explainability. As a result, engineers, responsible for production quality and who used the new AI tool, were now challenged with having to manage even more alerts, leading to distrust, frustration, and workflow bottlenecks .
Key Challenges
1. False Positives & Negatives
-
Engineers were flooded with irrelevant anomaly alerts.
-
They lacked tools to prioritize which anomalies mattered.
2. The "Black Box" Problem
-
AI detected where anomalies were happening — but not why.
-
Users couldn’t see the bigger picture across parts, trends, or root causes.
3. Workflow Fragmentation
-
Feedback and collaboration happened outside the tool (Outlook, Excel, Teams).
-
No way to track what was investigated, resolved, or needed escalation.
My Role & Scope
As the sole UX Designer on the cross-functional team (Product Owner, PM, Software Engineers, Data Scientists, and Technical Architects), I led:
-
User research & synthesis to identify role-based pain points.
-
End-to-end design of new features, dashboards, and feedback loops.
-
Design validation through user feedback, prototyping, and iteration.
-
Collaboration with engineering and AI/ML teams to ensure feasibility.
Key Design Solutions (problem > solution > impact)
-
Prioritization Tools – confidence scores, filtering, and tailored dashboards to cut noise.
-
Feedback Loops – human in the loop feedback to improve AI and trust.
-
AI Black Box Transparency – anomaly patterns, warranty traceback, case management to increase AI model explainability.
Impact
Adoption & Behavior Change
-
Users migrated from temporary POC app to fully integrated Angular AI app as new features were delivered.
-
Engineers began trusting the tool enough to move from manual anomaly review → automatic production line actions.
Business Impact & Recognition
-
$200M cost avoidance, $30K → 155 suspect engine reduction, Ford Global Tech Excellence Awards.