SlideShare una empresa de Scribd logo
1 de 16
Descargar para leer sin conexión
Scaling Data: Postgres,
                        The Stack and the
                      Future of Replication
                              Selena Deckelmann
                            selena@postgresql.org
                                @selenamarie
So
  mL
   SeC
    CA
      CL
       Ao
         E0
         2 f1
         ne
             1r2
              0e
               xn
                e c
1ce
               1n
            10e
            2r2
         ne
         2f
        N0
      OAo
     CC
   LeC
 OmS
So
Postgres disrupts
                         the rest of the
                      commercial relational
                        database industry.
So
 OmS
   LeC
     CC
      OAo
        N0
         2f
         ne
            2r2
            10e
               1n
                1ce
Disruptive forces

                      Licensing

                      “Enterprise” Web development

                      Proprietary DBA Career Path
So
 OmS
   LeC
     CC
      OAo
        N0
         2f
         ne
            2r2
            10e
               1n
                1ce
Licensing

                      Drop-in replacement for custom application
                      development on proprietary DBs.

                      Cheap Data Warehousing

                      Ecosystem!
So
 OmS
   LeC
     CC
      OAo
        N0
         2f
         ne
            2r2
            10e
               1n
                1ce
“Enterprise”
                        Web development
                      Postgres is a “Developers database” -
                      Extension is encouraged

                      Database of choice for Django

                      Oracle wants PHP developers
So
 OmS
   LeC
     CC
      OAo
        N0
         2f
         ne
            2r2
            10e
               1n
                1ce
“Visit the Ruby and Python Topic
                        for more information pertaining
                         to Ruby/RoR, Python and other
                      non-PHP scripting languages.”
So
 OmS
   LeC
     CC
      OAo
        N0
         2f
         ne
            2r2
            10e
               1n
                1ce
DBA Career path
                      Companies can’t hire Postgres DBAs fast
                      enough.

                      Postgres is close enough to Oracle, that
                      Oracle DBAs can jump in.

                      What we do better: Data loading,
                      automation, TUI and GUI admin tools
So
 OmS
   LeC
     CC
      OAo
        N0
         2f
         ne
            2r2
            10e
               1n
                1ce
And... Stability

                      Support major releases for at least 5 years.

                      Commits to HEAD are stable.

                      Bugs reported are fixed in <48 hrs.
So
 OmS
   LeC
     CC
      OAo
        N0
         2f
         ne
            2r2
            10e
               1n
                1ce
Demo!


                      • Demo here!
                        https://github.com/selenamarie/
                        pg_replication_demo
So
  mL
   SeC
    CA
      CL
       Ao
         E0
         2 f1
         ne
             1r2
              0e
               xn
                e c
Old problems

                      • Replication is hard
                      • Sharding is hard
                      • Slow in “the cloud”
So
  mL
   SeC
    CA
      CL
       Ao
         E0
         2 f1
         ne
             1r2
              0e
               xn
                e c
Solutions

                      • Streaming, cascaded replication
                      new!




                      • Sharding is still hard
                      • Index-only scans
                      new!
So
  mL
   SeC
    CA
      CL
       Ao
         E0
         2 f1
         ne
             1r2
              0e
               xn
                e c
The Good
                      • Community starting to really address Ops/
                        performance concerns:
                       • AVOIDING REINDEXING ON ALTER
                          TYPE OF INDEXED COLUMN
                       • NOT VALID CHECKS
                       • pg_basebackup
So
  mL
   SeC
    CA
      CL
       Ao
         E0
         2 f1
         ne
             1r2
              0e
               xn
                e c
The Bad

                      • Installation of Postgres harder than SQLite
                      • psql is powerful, not very friendly
                      • HA Ops support could be way better
So
  mL
   SeC
    CA
      CL
       Ao
         E0
         2 f1
         ne
             1r2
              0e
               xn
                e c
What’s happening now

                      • Heroku -> postgres.heroku.com
                        400 million write-transactions/day
                      • VMWare -> for managing lots of instances
                      • More interest in PaaS (like what MySQL
                        support has been for a long time)
So
  mL
   SeC
    CA
      CL
       Ao
         E0
         2 f1
         ne
             1r2
              0e
               xn
                e c
Next in HA?

                      • Continued usability improvements
                      • Cascaded Failover
                      • Multi-master with synchronous rep
So
  mL
   SeC
    CA
      CL
       Ao
         E0
         2 f1
         ne
             1r2
              0e
               xn
                e c

Más contenido relacionado

Destacado

Natuk
NatukNatuk
Natukeka
 
Kõnepuue
KõnepuueKõnepuue
Kõnepuuekiq
 
Porla Paz
Porla PazPorla Paz
Porla Pazrbartel
 
1. imagen y discurso säarbrucken
1. imagen y discurso säarbrucken1. imagen y discurso säarbrucken
1. imagen y discurso säarbruckenJavier Ávila
 
Shadow Fighter The Movie
Shadow Fighter The MovieShadow Fighter The Movie
Shadow Fighter The Movieguest337e86
 
Challenging employeesmodernsamplefinal
Challenging employeesmodernsamplefinalChallenging employeesmodernsamplefinal
Challenging employeesmodernsamplefinalAndrew Schwartz
 
El Vagón Del Amor (Carabajal, cáceres, Vasquez y Rovaretti)
El Vagón Del Amor (Carabajal, cáceres, Vasquez y Rovaretti)El Vagón Del Amor (Carabajal, cáceres, Vasquez y Rovaretti)
El Vagón Del Amor (Carabajal, cáceres, Vasquez y Rovaretti)producciones
 

Destacado (14)

Cmb
CmbCmb
Cmb
 
Natuk
NatukNatuk
Natuk
 
Kõnepuue
KõnepuueKõnepuue
Kõnepuue
 
Porla Paz
Porla PazPorla Paz
Porla Paz
 
1. imagen y discurso säarbrucken
1. imagen y discurso säarbrucken1. imagen y discurso säarbrucken
1. imagen y discurso säarbrucken
 
Shadow Fighter The Movie
Shadow Fighter The MovieShadow Fighter The Movie
Shadow Fighter The Movie
 
Challenging employeesmodernsamplefinal
Challenging employeesmodernsamplefinalChallenging employeesmodernsamplefinal
Challenging employeesmodernsamplefinal
 
El Vagón Del Amor (Carabajal, cáceres, Vasquez y Rovaretti)
El Vagón Del Amor (Carabajal, cáceres, Vasquez y Rovaretti)El Vagón Del Amor (Carabajal, cáceres, Vasquez y Rovaretti)
El Vagón Del Amor (Carabajal, cáceres, Vasquez y Rovaretti)
 
Src Voc
Src VocSrc Voc
Src Voc
 
Matkalla metaverseen?
Matkalla metaverseen?Matkalla metaverseen?
Matkalla metaverseen?
 
морфология
морфологияморфология
морфология
 
2007p&o1milieu
2007p&o1milieu2007p&o1milieu
2007p&o1milieu
 
Durga
DurgaDurga
Durga
 
Lamai Si Zahar
Lamai Si ZaharLamai Si Zahar
Lamai Si Zahar
 

Similar a Pg92 HA, LCA 2012, Ballarat

Harder, better, faster, stronger: PostgreSQL 9.1
Harder, better, faster, stronger: PostgreSQL 9.1Harder, better, faster, stronger: PostgreSQL 9.1
Harder, better, faster, stronger: PostgreSQL 9.1Selena Deckelmann
 
Tanel Poder - Performance stories from Exadata Migrations
Tanel Poder - Performance stories from Exadata MigrationsTanel Poder - Performance stories from Exadata Migrations
Tanel Poder - Performance stories from Exadata MigrationsTanel Poder
 
Drilling Deep Into Exadata Performance
Drilling Deep Into Exadata PerformanceDrilling Deep Into Exadata Performance
Drilling Deep Into Exadata PerformanceEnkitec
 
Mistakes were made - LCA 2012
Mistakes were made - LCA 2012Mistakes were made - LCA 2012
Mistakes were made - LCA 2012Selena Deckelmann
 
Five Years of EC2 Distilled
Five Years of EC2 DistilledFive Years of EC2 Distilled
Five Years of EC2 DistilledGrig Gheorghiu
 
Oracle 11G SCAN: Concepts and Implementation Experience Sharing
Oracle 11G SCAN: Concepts and Implementation Experience SharingOracle 11G SCAN: Concepts and Implementation Experience Sharing
Oracle 11G SCAN: Concepts and Implementation Experience SharingYury Velikanov
 
SQL Server: Now It's Everywhere You Want to Be
SQL Server: Now It's Everywhere You Want to BeSQL Server: Now It's Everywhere You Want to Be
SQL Server: Now It's Everywhere You Want to BeEd Leighton-Dick
 
Cómo construimos Oracle TimesTen
Cómo construimos Oracle TimesTenCómo construimos Oracle TimesTen
Cómo construimos Oracle TimesTenSoftware Guru
 
AWS to Bare Metal: Motivation, Pitfalls, and Results
AWS to Bare Metal: Motivation, Pitfalls, and ResultsAWS to Bare Metal: Motivation, Pitfalls, and Results
AWS to Bare Metal: Motivation, Pitfalls, and ResultsMongoDB
 
OOW09 Ebs Tuning Final
OOW09 Ebs Tuning FinalOOW09 Ebs Tuning Final
OOW09 Ebs Tuning Finaljucaab
 
OSCON Data 2011 -- NoSQL @ Netflix, Part 2
OSCON Data 2011 -- NoSQL @ Netflix, Part 2OSCON Data 2011 -- NoSQL @ Netflix, Part 2
OSCON Data 2011 -- NoSQL @ Netflix, Part 2Sid Anand
 
Performance Tuning: Pulling a Rabbit From a Hat - Atlassian Summit 2010
Performance Tuning: Pulling a Rabbit From a Hat - Atlassian Summit 2010Performance Tuning: Pulling a Rabbit From a Hat - Atlassian Summit 2010
Performance Tuning: Pulling a Rabbit From a Hat - Atlassian Summit 2010Atlassian
 
Engineered Systems: Oracle’s Vision for the Future
Engineered Systems: Oracle’s Vision for the FutureEngineered Systems: Oracle’s Vision for the Future
Engineered Systems: Oracle’s Vision for the FutureBob Rhubart
 
Building Asynchronous Applications
Building Asynchronous ApplicationsBuilding Asynchronous Applications
Building Asynchronous ApplicationsJohan Edstrom
 
Performance Oriented Design
Performance Oriented DesignPerformance Oriented Design
Performance Oriented DesignRodrigo Campos
 
Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...
Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...
Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...Ontico
 
Databases and the Cloud
Databases and the CloudDatabases and the Cloud
Databases and the CloudHenrik Ingo
 

Similar a Pg92 HA, LCA 2012, Ballarat (20)

Harder, better, faster, stronger: PostgreSQL 9.1
Harder, better, faster, stronger: PostgreSQL 9.1Harder, better, faster, stronger: PostgreSQL 9.1
Harder, better, faster, stronger: PostgreSQL 9.1
 
Tanel Poder - Performance stories from Exadata Migrations
Tanel Poder - Performance stories from Exadata MigrationsTanel Poder - Performance stories from Exadata Migrations
Tanel Poder - Performance stories from Exadata Migrations
 
Drilling Deep Into Exadata Performance
Drilling Deep Into Exadata PerformanceDrilling Deep Into Exadata Performance
Drilling Deep Into Exadata Performance
 
Mistakes were made - LCA 2012
Mistakes were made - LCA 2012Mistakes were made - LCA 2012
Mistakes were made - LCA 2012
 
Five Years of EC2 Distilled
Five Years of EC2 DistilledFive Years of EC2 Distilled
Five Years of EC2 Distilled
 
Oracle 11G SCAN: Concepts and Implementation Experience Sharing
Oracle 11G SCAN: Concepts and Implementation Experience SharingOracle 11G SCAN: Concepts and Implementation Experience Sharing
Oracle 11G SCAN: Concepts and Implementation Experience Sharing
 
SQL Server: Now It's Everywhere You Want to Be
SQL Server: Now It's Everywhere You Want to BeSQL Server: Now It's Everywhere You Want to Be
SQL Server: Now It's Everywhere You Want to Be
 
Cómo construimos Oracle TimesTen
Cómo construimos Oracle TimesTenCómo construimos Oracle TimesTen
Cómo construimos Oracle TimesTen
 
AWS to Bare Metal: Motivation, Pitfalls, and Results
AWS to Bare Metal: Motivation, Pitfalls, and ResultsAWS to Bare Metal: Motivation, Pitfalls, and Results
AWS to Bare Metal: Motivation, Pitfalls, and Results
 
OOW09 Ebs Tuning Final
OOW09 Ebs Tuning FinalOOW09 Ebs Tuning Final
OOW09 Ebs Tuning Final
 
OSCON Data 2011 -- NoSQL @ Netflix, Part 2
OSCON Data 2011 -- NoSQL @ Netflix, Part 2OSCON Data 2011 -- NoSQL @ Netflix, Part 2
OSCON Data 2011 -- NoSQL @ Netflix, Part 2
 
Performance Tuning: Pulling a Rabbit From a Hat - Atlassian Summit 2010
Performance Tuning: Pulling a Rabbit From a Hat - Atlassian Summit 2010Performance Tuning: Pulling a Rabbit From a Hat - Atlassian Summit 2010
Performance Tuning: Pulling a Rabbit From a Hat - Atlassian Summit 2010
 
Introducing JSR-283
Introducing JSR-283Introducing JSR-283
Introducing JSR-283
 
What's new in JSR-283?
What's new in JSR-283?What's new in JSR-283?
What's new in JSR-283?
 
Managing terabytes
Managing terabytesManaging terabytes
Managing terabytes
 
Engineered Systems: Oracle’s Vision for the Future
Engineered Systems: Oracle’s Vision for the FutureEngineered Systems: Oracle’s Vision for the Future
Engineered Systems: Oracle’s Vision for the Future
 
Building Asynchronous Applications
Building Asynchronous ApplicationsBuilding Asynchronous Applications
Building Asynchronous Applications
 
Performance Oriented Design
Performance Oriented DesignPerformance Oriented Design
Performance Oriented Design
 
Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...
Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...
Cистема распределенного, масштабируемого и высоконадежного хранения данных дл...
 
Databases and the Cloud
Databases and the CloudDatabases and the Cloud
Databases and the Cloud
 

Más de Selena Deckelmann

While we're here, let's fix computer science education
While we're here, let's fix computer science educationWhile we're here, let's fix computer science education
While we're here, let's fix computer science educationSelena Deckelmann
 
Postgres needs an aircraft carrier
Postgres needs an aircraft carrierPostgres needs an aircraft carrier
Postgres needs an aircraft carrierSelena Deckelmann
 
Letters from the open source trenches - Postgres community
Letters from the open source trenches - Postgres communityLetters from the open source trenches - Postgres community
Letters from the open source trenches - Postgres communitySelena Deckelmann
 
Own it: working with a changing open source community
Own it: working with a changing open source communityOwn it: working with a changing open source community
Own it: working with a changing open source communitySelena Deckelmann
 
Managing terabytes: When Postgres gets big
Managing terabytes: When Postgres gets bigManaging terabytes: When Postgres gets big
Managing terabytes: When Postgres gets bigSelena Deckelmann
 
Managing terabytes: When PostgreSQL gets big
Managing terabytes: When PostgreSQL gets bigManaging terabytes: When PostgreSQL gets big
Managing terabytes: When PostgreSQL gets bigSelena Deckelmann
 
How a bunch of normal people Used Technology To Repair a Rigged Election
How a bunch of normal people Used Technology To Repair a Rigged ElectionHow a bunch of normal people Used Technology To Repair a Rigged Election
How a bunch of normal people Used Technology To Repair a Rigged ElectionSelena Deckelmann
 
Open Source Bridge Opening Day
Open Source Bridge Opening DayOpen Source Bridge Opening Day
Open Source Bridge Opening DaySelena Deckelmann
 
What Assumptions Make: Filesystem I/O from a database perspective
What Assumptions Make: Filesystem I/O from a database perspectiveWhat Assumptions Make: Filesystem I/O from a database perspective
What Assumptions Make: Filesystem I/O from a database perspectiveSelena Deckelmann
 
Leading Without Being In Charge
Leading Without Being In ChargeLeading Without Being In Charge
Leading Without Being In ChargeSelena Deckelmann
 
Fun with PostgreSQL User Groups
Fun with PostgreSQL User GroupsFun with PostgreSQL User Groups
Fun with PostgreSQL User GroupsSelena Deckelmann
 

Más de Selena Deckelmann (20)

While we're here, let's fix computer science education
While we're here, let's fix computer science educationWhile we're here, let's fix computer science education
While we're here, let's fix computer science education
 
Algorithms are Recipes
Algorithms are RecipesAlgorithms are Recipes
Algorithms are Recipes
 
Hire the right way
Hire the right wayHire the right way
Hire the right way
 
Mistakes were made
Mistakes were madeMistakes were made
Mistakes were made
 
Postgres needs an aircraft carrier
Postgres needs an aircraft carrierPostgres needs an aircraft carrier
Postgres needs an aircraft carrier
 
Mistakes were made
Mistakes were madeMistakes were made
Mistakes were made
 
How to ask for money
How to ask for moneyHow to ask for money
How to ask for money
 
Letters from the open source trenches - Postgres community
Letters from the open source trenches - Postgres communityLetters from the open source trenches - Postgres community
Letters from the open source trenches - Postgres community
 
Own it: working with a changing open source community
Own it: working with a changing open source communityOwn it: working with a changing open source community
Own it: working with a changing open source community
 
Managing terabytes: When Postgres gets big
Managing terabytes: When Postgres gets bigManaging terabytes: When Postgres gets big
Managing terabytes: When Postgres gets big
 
Managing terabytes: When PostgreSQL gets big
Managing terabytes: When PostgreSQL gets bigManaging terabytes: When PostgreSQL gets big
Managing terabytes: When PostgreSQL gets big
 
Pdxpugday2010 pg90
Pdxpugday2010 pg90Pdxpugday2010 pg90
Pdxpugday2010 pg90
 
Making Software Communities
Making Software CommunitiesMaking Software Communities
Making Software Communities
 
Illustrated buffer cache
Illustrated buffer cacheIllustrated buffer cache
Illustrated buffer cache
 
Bucardo
BucardoBucardo
Bucardo
 
How a bunch of normal people Used Technology To Repair a Rigged Election
How a bunch of normal people Used Technology To Repair a Rigged ElectionHow a bunch of normal people Used Technology To Repair a Rigged Election
How a bunch of normal people Used Technology To Repair a Rigged Election
 
Open Source Bridge Opening Day
Open Source Bridge Opening DayOpen Source Bridge Opening Day
Open Source Bridge Opening Day
 
What Assumptions Make: Filesystem I/O from a database perspective
What Assumptions Make: Filesystem I/O from a database perspectiveWhat Assumptions Make: Filesystem I/O from a database perspective
What Assumptions Make: Filesystem I/O from a database perspective
 
Leading Without Being In Charge
Leading Without Being In ChargeLeading Without Being In Charge
Leading Without Being In Charge
 
Fun with PostgreSQL User Groups
Fun with PostgreSQL User GroupsFun with PostgreSQL User Groups
Fun with PostgreSQL User Groups
 

Último

What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 

Último (20)

What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 

Pg92 HA, LCA 2012, Ballarat

  • 1. Scaling Data: Postgres, The Stack and the Future of Replication Selena Deckelmann selena@postgresql.org @selenamarie So mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  • 2. 1ce 1n 10e 2r2 ne 2f N0 OAo CC LeC OmS So
  • 3. Postgres disrupts the rest of the commercial relational database industry. So OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  • 4. Disruptive forces Licensing “Enterprise” Web development Proprietary DBA Career Path So OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  • 5. Licensing Drop-in replacement for custom application development on proprietary DBs. Cheap Data Warehousing Ecosystem! So OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  • 6. “Enterprise” Web development Postgres is a “Developers database” - Extension is encouraged Database of choice for Django Oracle wants PHP developers So OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  • 7. “Visit the Ruby and Python Topic for more information pertaining to Ruby/RoR, Python and other non-PHP scripting languages.” So OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  • 8. DBA Career path Companies can’t hire Postgres DBAs fast enough. Postgres is close enough to Oracle, that Oracle DBAs can jump in. What we do better: Data loading, automation, TUI and GUI admin tools So OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  • 9. And... Stability Support major releases for at least 5 years. Commits to HEAD are stable. Bugs reported are fixed in <48 hrs. So OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  • 10. Demo! • Demo here! https://github.com/selenamarie/ pg_replication_demo So mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  • 11. Old problems • Replication is hard • Sharding is hard • Slow in “the cloud” So mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  • 12. Solutions • Streaming, cascaded replication new! • Sharding is still hard • Index-only scans new! So mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  • 13. The Good • Community starting to really address Ops/ performance concerns: • AVOIDING REINDEXING ON ALTER TYPE OF INDEXED COLUMN • NOT VALID CHECKS • pg_basebackup So mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  • 14. The Bad • Installation of Postgres harder than SQLite • psql is powerful, not very friendly • HA Ops support could be way better So mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  • 15. What’s happening now • Heroku -> postgres.heroku.com 400 million write-transactions/day • VMWare -> for managing lots of instances • More interest in PaaS (like what MySQL support has been for a long time) So mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  • 16. Next in HA? • Continued usability improvements • Cascaded Failover • Multi-master with synchronous rep So mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c