TL;DR
PgDog, an open-source proxy that enables horizontal scaling of Postgres, has announced funding and is now available for deployment. It aims to address Postgres’s scaling limitations and is already in use in production environments.
PgDog, an open-source proxy designed to enable horizontal scaling of Postgres databases, has announced its funding and availability for deployment. The project aims to address long-standing scaling limitations of Postgres, making it suitable for large-scale, high-query environments. This development is significant for organizations relying on Postgres for mission-critical applications.
According to a post on Hacker News by Lev Kokotov, PgDog is a proxy layer that sits in front of Postgres, allowing it to scale horizontally across multiple nodes. The project has already demonstrated the ability to serve more than 2 million queries per second in production, with deployments spanning over 20 TB of data. It is open source, with over 1.4 million Docker pulls, and new versions are released weekly.
Funding of $5.5 million has been secured from investors including Basis Set, YC, and Pioneer Fund. The team behind PgDog is a small startup composed of infrastructure and application engineers with extensive experience scaling Postgres at companies like Instacart. They emphasize that PgDog is not a pivot but a core effort to make Postgres scalable at any size, whether on-premises or in the cloud. An enterprise edition with SLA-backed support is also in development to facilitate easier deployment in AWS environments.
Implications for Large-Scale Data Infrastructure
This development could significantly impact how organizations handle large-scale data workloads. By enabling Postgres to scale horizontally without complex sharding or expensive hardware, PgDog offers a more accessible, cost-effective solution for high-volume applications. Its open-source nature and active community suggest widespread adoption could follow, potentially transforming the database landscape for enterprise and startup alike.
PostgreSQL: Programmazione avanzata (Programmare con Python) (Italian Edition)
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Postgres Scaling Challenges and Industry Needs
Postgres has traditionally been limited in scaling horizontally, prompting the rise of alternative databases like MongoDB and DynamoDB for high-scale applications. Over the past decade, many organizations have faced difficulties in scaling Postgres efficiently, often resorting to complex sharding or proprietary solutions. The emergence of PgDog aims to address these challenges by providing a transparent, open-source proxy that extends Postgres’s capabilities, reflecting a broader industry need for scalable, reliable relational databases.
“PgDog is serving more than 2 million queries per second, in production, across dozens of deployments.”
— an anonymous researcher on Hacker News
database horizontal scaling tools
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Unresolved Questions About PgDog’s Adoption
While PgDog has demonstrated impressive performance in existing deployments, it remains unclear how widely it will be adopted outside early users and community testing. Details about enterprise support, long-term stability, and compatibility with various cloud providers are still emerging. Additionally, the scalability limits and potential challenges in complex, multi-tenant environments are yet to be fully tested and documented.
As an affiliate, we earn on qualifying purchases.
Next Steps for Deployment and Community Growth
The team plans to release an enterprise edition with SLA-backed support to facilitate adoption in larger organizations. They are also actively engaging with the community through their Discord and GitHub repositories, encouraging more deployments and feedback. Future updates will likely focus on enhancing stability, adding features, and expanding enterprise integrations, with a broader rollout expected over the coming months.
PostgreSQL 18 for Developers: Build High-Performance Databases with SQL, Database Design, Query Optimization, JSONB, Security, Docker, Cloud Deployment, and Hands-On Projects
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Key Questions
How does PgDog improve Postgres scalability?
PgDog acts as a proxy layer that distributes queries across multiple Postgres nodes, enabling horizontal scaling without complex sharding.
Is PgDog open source?
Yes, PgDog is open source, with over 1.4 million Docker pulls, and is available for anyone to deploy.
Can I run PgDog on my cloud provider?
Yes, PgDog can be deployed on-premises, in your cloud account, or locally, making it flexible for different environments.
What is the future roadmap for PgDog?
The team plans to release an enterprise edition with SLA support, improve stability, and expand features based on community feedback.
Will PgDog support multi-tenant environments?
Details about multi-tenant support are still emerging; future updates may address this based on user needs and testing.
Source: Hacker News
