Distributed SQLite: Twelve Years From Open Source to Services
In September 2014, rqlite launched as the first open-source system combining SQLite with Raft consensus replication. The project solved a concrete problem: replicating data across clustered systems without risk of loss when a node failed. Today the category spans roughly a dozen projects, several venture-funded and some acquired, though the space remained nearly dormant for years after rqlite’s debut.
The design space has evolved along three distinct architectural approaches. Consensus-based systems like rqlite and dqlite prioritize strong consistency through a leader orchestrating writes across a cluster. Litestream pioneered an alternative in 2021, streaming SQLite’s write-ahead log to cloud storage for single-writer recovery without clustering. cr-sqlite and related projects pursued a third path using CRDTs, enabling multiple writers with eventual consistency. By 2022, companies like Cloudflare and Turso transformed the category from self-run infrastructure into managed cloud platforms.
At least eight independent teams chose to add replication around SQLite, validating the core approach. However, where rqlite, dqlite, and Litestream remained open source and free, the projects capturing venture funding or achieving acquisition were those that commercialized replicated SQLite as a managed service. The open-source phase lasted eight years before monetization began.
Read the full article
Continue reading at Hacker News →This is an AI-generated summary. Read the original for the full story.