60 Billion Predictions Daily: Inside Credit Karma’s Agentic Data Layer with Maddie Daianu

Описание: What does MLOps look like when you are deploying 22,000 models a month?

Maddie Daianu, Head of Data and AI at Intuit Credit Karma, joins the Data Bros to pull back the curtain on one of the most high-volume data environments in FinTech. With a 100-person team serving 140 million members, standard data practices break down.

Maddie shares how her team manages terabytes of daily data on Google Cloud and explains the massive strategic pivot they are undertaking right now: The move from "Information" to "Agency."

Chapters:

[00:00] - Intro
[00:23] - From Biomedical Engineering to Leading Data & AI at Credit Karma
[00:04:56] - Building Data Infrastructure for 140 Million Members
[00:08:25] - Streaming vs. Batch: Balancing Real-Time and Accuracy
[00:09:29] - Feature Stores and 60 Billion Daily Predictions
[00:11:09] - Compliance-First ML: Pairing Traditional Models with GenAI
[00:13:21] - The Unified Consumer Profile and Agentic Data Layers
[00:16:06] - Cloud-Agnostic Architecture Across Google Cloud and AWS
[00:17:47] - Intuit's Generative AI Operating System
[00:21:09] - Key Takeaways & Final Thoughts

If you enjoyed this episode, make sure to subscribe, rate, and review it on Apple Podcasts, Spotify, and YouTube Podcasts. Instructions on how to do this are here: https://www.fame.so/follow-rate-review

Resources

Connect on LinkedIn:

Maddie Daianu -   / maddie-daianu  
Benjamin Wagner -   / wagjamin  
Eldad Farkash -   / eldadfarkash  

Websites:
Credit Karma - https://www.creditkarma.com/

Tools & Platforms:

BigQuery – Data warehouse for processing multiple terabytes of information daily
Bigtable – Operational serving layer for real-time data access
Vertex AI – Machine learning platform for model training and deployment
Alchemy – Feature online feature store for real-time transformations and aggregations
Generative AI Operating System – Centralized platform for democratizing Gen AI adoption across Intuit products

Products & Services Mentioned:

TurboTax – Tax preparation and filing software
Debt Agent – AI-powered tool for debt consolidation and management assistance
Unified Consumer Profile – Semantic graph depicting financial journey across Credit Karma and TurboTax