Postgres has long been a database that easily scales vertically. It has also supported durable and reliable binary replication.
In the last two years, work on HA, clustering and extensions to our MVCC system has produced clustering features that help Postgres efficiently scale across many smaller systems.
This talk will start with a demo of the latest Postgres replication features. Then, we'll walk through open source and commercially-supported stacks that supporting the most demanding applications backed by Postgres.
In version 9.1, Postgres added streaming and synchronous replication that can be configured in about 5 steps. In 9.2 (to be released in 2012), we're adding cascaded replication and optimizations for common developer requests.
These features set the stage for a fast, efficient and distributed SQL cluster -- one that has configurable durability, is easy to administer and supported by "cloud" and virtualization vendors.
What's New in Teams Calling, Meetings and Devices March 2024
Pg92 HA, LCA 2012, Ballarat
1. Scaling Data: Postgres,
The Stack and the
Future of Replication
Selena Deckelmann
selena@postgresql.org
@selenamarie
So
mL
SeC
CA
CL
Ao
E0
2 f1
ne
1r2
0e
xn
e c
3. Postgres disrupts
the rest of the
commercial relational
database industry.
So
OmS
LeC
CC
OAo
N0
2f
ne
2r2
10e
1n
1ce
4. Disruptive forces
Licensing
“Enterprise” Web development
Proprietary DBA Career Path
So
OmS
LeC
CC
OAo
N0
2f
ne
2r2
10e
1n
1ce
5. Licensing
Drop-in replacement for custom application
development on proprietary DBs.
Cheap Data Warehousing
Ecosystem!
So
OmS
LeC
CC
OAo
N0
2f
ne
2r2
10e
1n
1ce
6. “Enterprise”
Web development
Postgres is a “Developers database” -
Extension is encouraged
Database of choice for Django
Oracle wants PHP developers
So
OmS
LeC
CC
OAo
N0
2f
ne
2r2
10e
1n
1ce
7. “Visit the Ruby and Python Topic
for more information pertaining
to Ruby/RoR, Python and other
non-PHP scripting languages.”
So
OmS
LeC
CC
OAo
N0
2f
ne
2r2
10e
1n
1ce
8. DBA Career path
Companies can’t hire Postgres DBAs fast
enough.
Postgres is close enough to Oracle, that
Oracle DBAs can jump in.
What we do better: Data loading,
automation, TUI and GUI admin tools
So
OmS
LeC
CC
OAo
N0
2f
ne
2r2
10e
1n
1ce
9. And... Stability
Support major releases for at least 5 years.
Commits to HEAD are stable.
Bugs reported are fixed in <48 hrs.
So
OmS
LeC
CC
OAo
N0
2f
ne
2r2
10e
1n
1ce
10. Demo!
• Demo here!
https://github.com/selenamarie/
pg_replication_demo
So
mL
SeC
CA
CL
Ao
E0
2 f1
ne
1r2
0e
xn
e c
11. Old problems
• Replication is hard
• Sharding is hard
• Slow in “the cloud”
So
mL
SeC
CA
CL
Ao
E0
2 f1
ne
1r2
0e
xn
e c
12. Solutions
• Streaming, cascaded replication
new!
• Sharding is still hard
• Index-only scans
new!
So
mL
SeC
CA
CL
Ao
E0
2 f1
ne
1r2
0e
xn
e c
13. The Good
• Community starting to really address Ops/
performance concerns:
• AVOIDING REINDEXING ON ALTER
TYPE OF INDEXED COLUMN
• NOT VALID CHECKS
• pg_basebackup
So
mL
SeC
CA
CL
Ao
E0
2 f1
ne
1r2
0e
xn
e c
14. The Bad
• Installation of Postgres harder than SQLite
• psql is powerful, not very friendly
• HA Ops support could be way better
So
mL
SeC
CA
CL
Ao
E0
2 f1
ne
1r2
0e
xn
e c
15. What’s happening now
• Heroku -> postgres.heroku.com
400 million write-transactions/day
• VMWare -> for managing lots of instances
• More interest in PaaS (like what MySQL
support has been for a long time)
So
mL
SeC
CA
CL
Ao
E0
2 f1
ne
1r2
0e
xn
e c
16. Next in HA?
• Continued usability improvements
• Cascaded Failover
• Multi-master with synchronous rep
So
mL
SeC
CA
CL
Ao
E0
2 f1
ne
1r2
0e
xn
e c