Building Planetary-Scale Data Systems with Venice • Felix GV & Olimpiu Pop • GOTO 2026
Автор: GOTO Conferences
Загружено: 2026-01-26
Просмотров: 315
Описание:
This interview was recorded for GOTO Unscripted. #GOTOcon #GOTOunscripted
https://gotopia.tech
Check out more here:
https://gotopia.tech/articles/421
Félix GV - Current Interests: Multi-Planetary Databases, Data Sovereignty & Lifelogging @felixgv @VeniceDB
Olimpiu Pop - Technologist & Tech Journalist
RESOURCES
Félix
https://bsky.app/profile/felixgv.ninja
https://github.com/FelixGV
/ felixgv
Olimpiu
https://x.com/olimpiupop
https://github.com/zroll
/ olimpiupop
Links
https://venicedb.org
https://github.com/linkedin/venice
https://rocksdb.org
https://duckdb.org
• Apache Kafka Meets Apache Iceberg: Real-Ti...
• Apache Pulsar: Event Streaming in The Clou...
• Patterns of Distributed Systems • Unmesh J...
• Serverless Apps on Cloudflare • Ashley Pea...
• Not Just Code Monkeys • Martin Fowler • GO...
• Making Kafka Queryable with Apache Pinot •...
• Thinking Asynchronously: App Integration P...
• A Short Summary of the Last Decades of Dat...
• Building Modern Software at Scale: Archite...
• Why Are Distributed Systems so Hard? • Den...
• DuckDB: Crunching Data Anywhere, From Lapt...
• Building Modern Databases with the FDAP St...
• Lexical, Vector & Hybrid Search with Elast...
• Building a Debugger • Sy Brand & Tim Misia...
DESCRIPTION
Félix GV, a former engineer at LinkedIn and architect of the Venice database system, discusses the complexity of building planetary-scale data systems. He explains Venice's unbundled architecture where each component—from Kafka-based pub/sub to RocksDB-powered servers—operates as an independent distributed system. Félix details their rigorous chaos engineering practices, including regular load tests that push data centers beyond normal capacity to ensure reliability.
The discussion covers fundamental distributed systems concepts like the CAP theorem and the trade-offs between consistency and availability in multi-region deployments. He also explains why Venice, as a derived data system, deliberately sacrifices strong consistency for high throughput and availability, and concludes by discussing their experimental integration of DuckDB for SQL-based analytics and data exploration capabilities.
TIMECODES
00:00 Intro
00:55 The architecture of Venice: An unbundled database
06:09 Multi-region reliability & chaos engineering
09:54 Data flow: Writing & reading in Venice
15:15 Understanding the CAP Theorem
22:34 Integrating DuckDB: Adding SQL capabilities
27:31 Outro
RECOMMENDED BOOKS
Kasun Indrasiri & Danesh Kuruppu • gRPC: Up and Running • https://amzn.to/3sBGBJJ
Tomer Shiran, Jason Hughes & Alex Merced • Apache Iceberg: The Definitive Guide • https://amzn.to/488Z30k
William Smith • Arrow Flight Protocols and Practices • https://amzn.to/4o2Q2fd
Adi Polak • Scaling Machine Learning with Spark • https://amzn.to/3N9vx1H
Mark Needham, Michael Hunger & Michael Simons • DuckDB in Action • https://amzn.to/45QwSli
Simon Aubury & Ned Letcher • Getting Started with DuckDB • https://amzn.to/3VPk4q
https://bsky.app/profile/gotocon.com
/ gotocon
/ goto-
/ goto_con
/ gotoconferences
#VeniceDB #RocksDB #DuckDB #ApacheKafka #ApacheHelix #ApachePinot #ApacheIceberg #Zookeeper #OpenSource #DatabaseDevelopment #CAPTheorem #DistributedSystems #DistributedData #DataProcessing #Programming #TodayInTech #FelixGV #OlimpiuPop
CHANNEL MEMBERSHIP BONUS
Join this channel to get early access to videos & other perks:
/ @goto-
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech
Sign up for updates and specials at https://gotopia.tech/newsletter
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
https://www.youtube.com/user/GotoConf...
Повторяем попытку...
Доступные форматы для скачивания:
Скачать видео
-
Информация по загрузке: