How CockroachDB helped Spreedly migrate their data from chaos to consensus | RoachFest 2023

Описание: Payments orchestration company Spreedly had the unique opportunity to migrate from an antiquated key value datastore that fell into non support. The resulting aging of the system as a whole led to the creation of entire data storage subsystems and supporting systems leading to data that went in circles to become available to the primary application.

As a result, their team worked with Cockroach Labs to migrate into a single logical data layer that meets above and beyond the application and analysis needs of their data and consolidates 6 systems into 1 efficient standard datastore.

Join Senior Software Architect Scott Traver as he discusses strategies and tactics for migrating to distributed SQL database CockroachDB and covers topics including:
✔️ Using a source of truth migration strategy
✔️ How to let your database manage the IDs
✔️ The importance of read through migrations
✔️ Why you should use a datastore managed data retention policy
✔️ Why single responsibility = simplicity
✔️ Using integration tools to unify your ecosystem

How CockroachDB helped Spreedly migrate their data from chaos to consensus:
00:00 Intro: A tale of modernization in 3 lessons
00:31 About Spreedly's flexible payment platform
00:55 Payments orchestration vs Payments optimization
01:35 What did Spreedly think their data needs were?
02:17 What were Spreedly's actual data needs? (Application data, vaulted data, transaction data)
03:12 How system level tech debt can accrue
04:35 Why modernization is a responsibility, not a necessity
05:06 Spreedly's architecture before CockroachDB
06:31 With great power comes great on call rotations, operational costs, failovers, late nights, burnout...
07:25 Lesson 1: De-risk the migration by taking it slow
09:28 Lesson 2: Don't migrate data which you don't need to
11:40 Lesson 3: Data is an ecosystem not a database
13:22 Behind Spreedly's CockroachDB migration project
14:40 Closing notes: Modernization is not a spectator sport