Fabric Data Engineering with AI-Assisted Development

Описание: 👩‍💻 Speaker: Dr. Estera Kot (  / esterakot  )
Dr. Estera Kot is the CTO at Clouds On Mars, driving innovation in Data & AI strategy and execution. A former Principal Product Manager at Microsoft, she played a key role in building performance-critical components of Azure Synapse Analytics and Microsoft Fabric, with a Ph.D. in Computer Science specializing in machine learning for medical imaging. Estera is a respected educator, speaker at events like FabCon and the World Woman Davos Agenda, and is passionate about building scalable, real-world AI solutions with impact over hype.

She’ll be coding live, sharing real-world patterns and performance insights from serious Fabric deployments.

What to expect:

We'll explore how data engineers can accelerate development in Fabric using Fabric MCP and GitHub Copilot, moving from natural language prompts to production-ready pipelines.
✔ When to use notebooks, Spark Job Definitions, and pipelines in Fabric
✔ Live demo: AI-assisted pipeline and Spark development
✔ Using Fabric MCP to speed up engineering workflows
✔ Optimizing Spark workloads for production:
→ Native Execution Engine
→ High Concurrency mode
→ Compute cluster & executor sizing
→ Shuffle partitions & common performance anti-patterns
This is a deep technical session focused on how Fabric actually behaves in real production scenarios.