SlideShare una empresa de Scribd logo
1 de 23
TUI & qTest:
Why, How and Where Next
Phil Thomas: General Manager of QA & Test | 11th October 2017
About TUI UK& Ireland
TUI UK & Ireland is
the UK’s largest tour
operator with key
brands including
Thomson, First
Choice, and
Thomson Cruises
as well as Crystal
Ski and Thomson
Lakes & Mountains.
TUI UK & Ireland
has a team of more
than 10,000
employees and
serves over six
million customers
each year. TUI UK
and Ireland is a
member of TUI
Group.
TUI UK & Ireland’s
airline, Thomson
Airways is the UK’s
third largest airline
with 62 aircraft
operating to over 88
destinations in 30
countries.
UK’s largest
tour operator
UK 3rd largest
airline
10k employees
& 6m customers
Where are we now?
Where do we want to be?
System &
Integration
Automation &
Performance
Exploratory
& Smoke Testing
Regression &
OAT
UAT & Production
Projects,
Releases, BAU &
CR’s
Agile & Waterfall
In-house, 3rd Party
& Offshore
UK&I, Northern
Region & Group
Test Scope Delivery
DevOps & AWS….
Why Bother?
1.Lack of real time Test reporting
2.No integration with Rally & Jira
3.Consolidate on a single Tool
4.Lacked traceability
5.Not sufficiently intuitive
6.Not future proofed for DevOps & Cloud
7.TUI Test Mgrs lacked visibility of Test planning & execution
How did we choose
qTest?
Set-up a Team for the
DurationTUI Test Managers
UAT Managers
Sonata Test Managers
Delivery Manager
Scrum Master
Project Manager
 Within budget
 Handle multiple Business Portfolios
 Test Tool as cloud solution
 Real time MI dashboard reporting
 Real-time integration with Rally, Jira & CI/CD tools
 Capture and manage Business Priority & Risk
Top Requirements
Steps to choosing qTest
Business, UK IT & CIO
Approval
Evaluated the 7 against
Requirements
Resulted in remaining 3
Detailed POC & Commercials
Unanimous agreement
Agreed Requirements & Weighting
Suggestions shortlisted to 7
Scoring the Seven
Criteria
Cost (H) Average 3 Poor 1 Average 3 Average 2
Test Design &
Planning (H)
Good 4 Good 5 Good 5 Good 5
Traceability (H) Good 4 Good 5 Good 4 Good 5
Real Time MI (H) Average 3 Good 5 Good 5 Good 4
Integration
Capability (H)
Average 3 Average 3 Good 5 Good 3
Defect Mgt (H) Average 3 Good 5 Good 4 Good 4
Useability/User
Friendliness (H)
Good 5 Good 5 Good 5 Average 3
Result / Score Result / Score Result / Score Result / Score
PractiTest HP ALM/QC qTest QAComplete
JIRA/Zephyr qTest SpiraTest QA Complete PractiTest HP ALM/QC
89.5 88.1 86.5 86.3 69.6 N/A
How did we implement
qTest?
Implementation Overview
 Identified Stakeholders & Comms Plan
 Regular promotion across TUI & 3rd Parties
 Weekly calls with Matt, our QAS Success Champion
 Ensured Sonata fully engaged
 Issued TUI standards for qTest
 TUI training materials & training sessions
 Targeted training for the initial Projects Teams
 Completed data cleanse and migration
Implementing qTest
Set up 5 sub teams covering
1. Requirements & Test Planning
2. Test Design & Scripts
3. Defect Management
4. Reporting & MI Dashboards
5. Migration & Integration
 Cross team coordination for MVP
 Used an early Gold Copy instance
 Weekly meetings, including UAT and offshore
Implementing qTest: The
Plan Jan Feb March April May June July Aug Sept
Analysis
Initial Set-up
Pilot Training
Pilot 1
Pilot 2
Final Set-up
User Training
17.3 Release
Daily Standups
BAU
Cutover: Release 17.3 -
qTest
17.3:
Projects
Requiremen
ts Loaded
Initial
Scripts
Loaded
Scripts run
& defects
raised
Remaining
projects join
qTest
Regression
Pack & O/s
17.2 defects
Release 17.2: Bugzilla & TestOpia
On Going Training and Communications
Daily reviews and rapid issue resolution
Test Plan Hierarchy in qTest
Results from qTest
qTest – Results to far
Phase 1: Targets all met & Benefits realised
Exceeded expectations:
 qTest live a month early
 Integration to Rally & Jira
 Adopted by
o TUI Group projects
o E-Commerce scrums teams for SIT
o Airline Portfolio
Total active users 513
Logged once since 1st June 510
Logged once since 1st Aug 456
Logged once since last wk 320
Logged once since Monday 243
What Worked Well
 Selection Process
 Training
 MVP
 Collaboration
qTest – What Next?
qTest – Next Steps
 Further teams moving onto qTest
 Session Based Testing & Automation
 Reporting on Automation results
 Using qTest data to drive improvements
 UAT use of EggPlant
 DevOps: CI/CD
 Putting qTest front & centre of Nordics delivery
Thank you

Más contenido relacionado

La actualidad más candente

Quality Assurance to Test Engineering – Insights From our Journey by Oksana S...
Quality Assurance to Test Engineering – Insights From our Journey by Oksana S...Quality Assurance to Test Engineering – Insights From our Journey by Oksana S...
Quality Assurance to Test Engineering – Insights From our Journey by Oksana S...QA or the Highway
 
The digital shakeout in quality assurance and testing by Shiva Agolla and Sat...
The digital shakeout in quality assurance and testing by Shiva Agolla and Sat...The digital shakeout in quality assurance and testing by Shiva Agolla and Sat...
The digital shakeout in quality assurance and testing by Shiva Agolla and Sat...QA or the Highway
 
Jacques+g+official+cv+05 07-2016
Jacques+g+official+cv+05 07-2016Jacques+g+official+cv+05 07-2016
Jacques+g+official+cv+05 07-2016Jacques Quereau
 
Testing in a DevOps team
Testing in a DevOps teamTesting in a DevOps team
Testing in a DevOps teamLaurent PY
 
Software Testing Metrics with qTest Insights - QASymphony Webinar
Software Testing Metrics with qTest Insights  - QASymphony WebinarSoftware Testing Metrics with qTest Insights  - QASymphony Webinar
Software Testing Metrics with qTest Insights - QASymphony WebinarQASymphony
 
Top 10 Agile Metrics
Top 10 Agile MetricsTop 10 Agile Metrics
Top 10 Agile MetricsXBOSoft
 
Pooja shift left 1.0
Pooja shift left 1.0Pooja shift left 1.0
Pooja shift left 1.0Xebia India
 
Shift Left Quality Assurance: How to do it. Why it matters.
Shift Left Quality Assurance: How to do it. Why it matters.Shift Left Quality Assurance: How to do it. Why it matters.
Shift Left Quality Assurance: How to do it. Why it matters.Worksoft
 
Streamlining Automation Scripts and Test Data Management
Streamlining Automation Scripts and Test Data ManagementStreamlining Automation Scripts and Test Data Management
Streamlining Automation Scripts and Test Data ManagementQASymphony
 
Quality Index: A Composite Metric for the Voice of Testing
Quality Index: A Composite Metric for the Voice of TestingQuality Index: A Composite Metric for the Voice of Testing
Quality Index: A Composite Metric for the Voice of TestingTechWell
 
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...Tasktop
 
Agile Metrics for Senior Managers and Executives
Agile Metrics for Senior Managers and ExecutivesAgile Metrics for Senior Managers and Executives
Agile Metrics for Senior Managers and ExecutivesVersionOne
 
Driving Innovation with Kanban at Jaguar Land Rover
Driving Innovation with Kanban at Jaguar Land RoverDriving Innovation with Kanban at Jaguar Land Rover
Driving Innovation with Kanban at Jaguar Land RoverLeanKit
 
Agile Metrics - ASTQB Workshop by Philip Lew - XBOSoft
Agile Metrics - ASTQB Workshop by Philip Lew - XBOSoftAgile Metrics - ASTQB Workshop by Philip Lew - XBOSoft
Agile Metrics - ASTQB Workshop by Philip Lew - XBOSoftXBOSoft
 
The Case for Value Stream Architecture (Mik Kersten, Carmen DeArdo)
The Case for Value Stream Architecture (Mik Kersten, Carmen DeArdo)The Case for Value Stream Architecture (Mik Kersten, Carmen DeArdo)
The Case for Value Stream Architecture (Mik Kersten, Carmen DeArdo)Carmen DeArdo
 
Agile Base Camp - Agile metrics
Agile Base Camp - Agile metricsAgile Base Camp - Agile metrics
Agile Base Camp - Agile metricsSerge Kovaleff
 

La actualidad más candente (20)

Quality Assurance to Test Engineering – Insights From our Journey by Oksana S...
Quality Assurance to Test Engineering – Insights From our Journey by Oksana S...Quality Assurance to Test Engineering – Insights From our Journey by Oksana S...
Quality Assurance to Test Engineering – Insights From our Journey by Oksana S...
 
The digital shakeout in quality assurance and testing by Shiva Agolla and Sat...
The digital shakeout in quality assurance and testing by Shiva Agolla and Sat...The digital shakeout in quality assurance and testing by Shiva Agolla and Sat...
The digital shakeout in quality assurance and testing by Shiva Agolla and Sat...
 
Jacques+g+official+cv+05 07-2016
Jacques+g+official+cv+05 07-2016Jacques+g+official+cv+05 07-2016
Jacques+g+official+cv+05 07-2016
 
Testing in a DevOps team
Testing in a DevOps teamTesting in a DevOps team
Testing in a DevOps team
 
Software Testing Metrics with qTest Insights - QASymphony Webinar
Software Testing Metrics with qTest Insights  - QASymphony WebinarSoftware Testing Metrics with qTest Insights  - QASymphony Webinar
Software Testing Metrics with qTest Insights - QASymphony Webinar
 
Top 10 Agile Metrics
Top 10 Agile MetricsTop 10 Agile Metrics
Top 10 Agile Metrics
 
Pooja shift left 1.0
Pooja shift left 1.0Pooja shift left 1.0
Pooja shift left 1.0
 
Shift Left Quality Assurance: How to do it. Why it matters.
Shift Left Quality Assurance: How to do it. Why it matters.Shift Left Quality Assurance: How to do it. Why it matters.
Shift Left Quality Assurance: How to do it. Why it matters.
 
Streamlining Automation Scripts and Test Data Management
Streamlining Automation Scripts and Test Data ManagementStreamlining Automation Scripts and Test Data Management
Streamlining Automation Scripts and Test Data Management
 
Agile Metrics
Agile MetricsAgile Metrics
Agile Metrics
 
ClearPoint Profile
ClearPoint ProfileClearPoint Profile
ClearPoint Profile
 
Quality Index: A Composite Metric for the Voice of Testing
Quality Index: A Composite Metric for the Voice of TestingQuality Index: A Composite Metric for the Voice of Testing
Quality Index: A Composite Metric for the Voice of Testing
 
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...
 
Agile Metrics for Senior Managers and Executives
Agile Metrics for Senior Managers and ExecutivesAgile Metrics for Senior Managers and Executives
Agile Metrics for Senior Managers and Executives
 
Driving Innovation with Kanban at Jaguar Land Rover
Driving Innovation with Kanban at Jaguar Land RoverDriving Innovation with Kanban at Jaguar Land Rover
Driving Innovation with Kanban at Jaguar Land Rover
 
Agile Metrics - ASTQB Workshop by Philip Lew - XBOSoft
Agile Metrics - ASTQB Workshop by Philip Lew - XBOSoftAgile Metrics - ASTQB Workshop by Philip Lew - XBOSoft
Agile Metrics - ASTQB Workshop by Philip Lew - XBOSoft
 
The Case for Value Stream Architecture (Mik Kersten, Carmen DeArdo)
The Case for Value Stream Architecture (Mik Kersten, Carmen DeArdo)The Case for Value Stream Architecture (Mik Kersten, Carmen DeArdo)
The Case for Value Stream Architecture (Mik Kersten, Carmen DeArdo)
 
Sanitized tb swstmppp1516july
Sanitized tb swstmppp1516julySanitized tb swstmppp1516july
Sanitized tb swstmppp1516july
 
Agile Efficacy Presentation
Agile Efficacy PresentationAgile Efficacy Presentation
Agile Efficacy Presentation
 
Agile Base Camp - Agile metrics
Agile Base Camp - Agile metricsAgile Base Camp - Agile metrics
Agile Base Camp - Agile metrics
 

Destacado

Operate 24x7
Operate 24x7Operate 24x7
Operate 24x7Astegic
 
Manual Testing is Dead. Long Live Manual Testing
Manual Testing is Dead. Long Live Manual TestingManual Testing is Dead. Long Live Manual Testing
Manual Testing is Dead. Long Live Manual TestingQASymphony
 
Debugging Your Testing Team
Debugging Your Testing TeamDebugging Your Testing Team
Debugging Your Testing TeamQASymphony
 
Best practices for test case creation & maintenance
Best practices for test case creation & maintenanceBest practices for test case creation & maintenance
Best practices for test case creation & maintenance99tests
 
Succeeding as an Introvert
Succeeding as an IntrovertSucceeding as an Introvert
Succeeding as an IntrovertQASymphony
 
Moving QA from Reactive to Proactive with qTest
Moving QA from Reactive to Proactive  with qTestMoving QA from Reactive to Proactive  with qTest
Moving QA from Reactive to Proactive with qTestQASymphony
 
Best Practices In Exploratory Testing
Best Practices In Exploratory TestingBest Practices In Exploratory Testing
Best Practices In Exploratory Testing99tests
 
Whitebox Testing for Blackbox Testers: Simplifying API Testing
Whitebox Testing for Blackbox Testers: Simplifying API TestingWhitebox Testing for Blackbox Testers: Simplifying API Testing
Whitebox Testing for Blackbox Testers: Simplifying API TestingQASymphony
 
BHIM App Case Study
BHIM App Case StudyBHIM App Case Study
BHIM App Case Study99tests
 
Diving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the TechnologiesDiving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the TechnologiesQASymphony
 
Product Teardown for SaaS companies at #SaaSx4
Product Teardown for SaaS companies at #SaaSx4Product Teardown for SaaS companies at #SaaSx4
Product Teardown for SaaS companies at #SaaSx4ProductNation/iSPIRT
 
Future Of Software Testing
Future Of Software TestingFuture Of Software Testing
Future Of Software Testing99tests
 
RESTful API Testing using Postman, Newman, and Jenkins
RESTful API Testing using Postman, Newman, and JenkinsRESTful API Testing using Postman, Newman, and Jenkins
RESTful API Testing using Postman, Newman, and JenkinsQASymphony
 

Destacado (13)

Operate 24x7
Operate 24x7Operate 24x7
Operate 24x7
 
Manual Testing is Dead. Long Live Manual Testing
Manual Testing is Dead. Long Live Manual TestingManual Testing is Dead. Long Live Manual Testing
Manual Testing is Dead. Long Live Manual Testing
 
Debugging Your Testing Team
Debugging Your Testing TeamDebugging Your Testing Team
Debugging Your Testing Team
 
Best practices for test case creation & maintenance
Best practices for test case creation & maintenanceBest practices for test case creation & maintenance
Best practices for test case creation & maintenance
 
Succeeding as an Introvert
Succeeding as an IntrovertSucceeding as an Introvert
Succeeding as an Introvert
 
Moving QA from Reactive to Proactive with qTest
Moving QA from Reactive to Proactive  with qTestMoving QA from Reactive to Proactive  with qTest
Moving QA from Reactive to Proactive with qTest
 
Best Practices In Exploratory Testing
Best Practices In Exploratory TestingBest Practices In Exploratory Testing
Best Practices In Exploratory Testing
 
Whitebox Testing for Blackbox Testers: Simplifying API Testing
Whitebox Testing for Blackbox Testers: Simplifying API TestingWhitebox Testing for Blackbox Testers: Simplifying API Testing
Whitebox Testing for Blackbox Testers: Simplifying API Testing
 
BHIM App Case Study
BHIM App Case StudyBHIM App Case Study
BHIM App Case Study
 
Diving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the TechnologiesDiving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the Technologies
 
Product Teardown for SaaS companies at #SaaSx4
Product Teardown for SaaS companies at #SaaSx4Product Teardown for SaaS companies at #SaaSx4
Product Teardown for SaaS companies at #SaaSx4
 
Future Of Software Testing
Future Of Software TestingFuture Of Software Testing
Future Of Software Testing
 
RESTful API Testing using Postman, Newman, and Jenkins
RESTful API Testing using Postman, Newman, and JenkinsRESTful API Testing using Postman, Newman, and Jenkins
RESTful API Testing using Postman, Newman, and Jenkins
 

Similar a TUI & qTest: Why, How and Where Next

Baskaren Accomplishments Summary
Baskaren Accomplishments SummaryBaskaren Accomplishments Summary
Baskaren Accomplishments Summaryguest524810
 
Trip 3 of PMO Company's journey to Agile & Scrum savvyness
Trip 3  of PMO Company's journey to Agile & Scrum savvyness Trip 3  of PMO Company's journey to Agile & Scrum savvyness
Trip 3 of PMO Company's journey to Agile & Scrum savvyness Getjan Lammers
 
Outperform Presentation 1v3 App
Outperform Presentation 1v3 AppOutperform Presentation 1v3 App
Outperform Presentation 1v3 AppAndyMurray
 
How to Deliver a Successful Oracle E-Business Suite Upgrade
How to Deliver a Successful Oracle E-Business Suite UpgradeHow to Deliver a Successful Oracle E-Business Suite Upgrade
How to Deliver a Successful Oracle E-Business Suite UpgradeCapgemini
 
Logistics Case Study
Logistics Case StudyLogistics Case Study
Logistics Case StudyDonald Cross
 
Global Lean / Six Sigma
Global Lean / Six SigmaGlobal Lean / Six Sigma
Global Lean / Six Sigmarepner
 
Oakmont Consultancy Capabilties
Oakmont Consultancy CapabiltiesOakmont Consultancy Capabilties
Oakmont Consultancy CapabiltiesMurray Croft
 
20200429 PMI NYC Meetup Agile Governance Ariel Partners for Distribution
20200429 PMI NYC Meetup Agile Governance Ariel Partners for Distribution20200429 PMI NYC Meetup Agile Governance Ariel Partners for Distribution
20200429 PMI NYC Meetup Agile Governance Ariel Partners for DistributionCraeg Strong
 
Fmq lqos introduction npi rev 2
Fmq  lqos introduction npi rev 2Fmq  lqos introduction npi rev 2
Fmq lqos introduction npi rev 2amitsonuksms
 
Mrityunjay_MJ_Testing_Profile
Mrityunjay_MJ_Testing_ProfileMrityunjay_MJ_Testing_Profile
Mrityunjay_MJ_Testing_ProfileMrityunjay pandey
 
Prem_Papabathini_Resume_2016
Prem_Papabathini_Resume_2016Prem_Papabathini_Resume_2016
Prem_Papabathini_Resume_2016Prem Papabathini
 
Case Study-Indirect China Strategic Sourcing
Case Study-Indirect China Strategic SourcingCase Study-Indirect China Strategic Sourcing
Case Study-Indirect China Strategic SourcingJohn William
 
Lean pilots by Mariya Breyter from Dun & Bradstreet
Lean pilots by Mariya Breyter from Dun & BradstreetLean pilots by Mariya Breyter from Dun & Bradstreet
Lean pilots by Mariya Breyter from Dun & BradstreetInstitut Lean France
 

Similar a TUI & qTest: Why, How and Where Next (20)

Karthik Subbu Resume
Karthik Subbu ResumeKarthik Subbu Resume
Karthik Subbu Resume
 
Baskaren Accomplishments Summary
Baskaren Accomplishments SummaryBaskaren Accomplishments Summary
Baskaren Accomplishments Summary
 
Trip 3 of PMO Company's journey to Agile & Scrum savvyness
Trip 3  of PMO Company's journey to Agile & Scrum savvyness Trip 3  of PMO Company's journey to Agile & Scrum savvyness
Trip 3 of PMO Company's journey to Agile & Scrum savvyness
 
Outperform Presentation 1v3 App
Outperform Presentation 1v3 AppOutperform Presentation 1v3 App
Outperform Presentation 1v3 App
 
How to Deliver a Successful Oracle E-Business Suite Upgrade
How to Deliver a Successful Oracle E-Business Suite UpgradeHow to Deliver a Successful Oracle E-Business Suite Upgrade
How to Deliver a Successful Oracle E-Business Suite Upgrade
 
Logistics Case Study
Logistics Case StudyLogistics Case Study
Logistics Case Study
 
Install PRESTO KPI in 5 weeks
Install PRESTO KPI in 5 weeksInstall PRESTO KPI in 5 weeks
Install PRESTO KPI in 5 weeks
 
Global Lean / Six Sigma
Global Lean / Six SigmaGlobal Lean / Six Sigma
Global Lean / Six Sigma
 
Oakmont Consultancy Capabilties
Oakmont Consultancy CapabiltiesOakmont Consultancy Capabilties
Oakmont Consultancy Capabilties
 
20200429 PMI NYC Meetup Agile Governance Ariel Partners for Distribution
20200429 PMI NYC Meetup Agile Governance Ariel Partners for Distribution20200429 PMI NYC Meetup Agile Governance Ariel Partners for Distribution
20200429 PMI NYC Meetup Agile Governance Ariel Partners for Distribution
 
Neil Potter Presentation
Neil Potter Presentation Neil Potter Presentation
Neil Potter Presentation
 
Fmq lqos introduction npi rev 2
Fmq  lqos introduction npi rev 2Fmq  lqos introduction npi rev 2
Fmq lqos introduction npi rev 2
 
Guruprasad_Testing_TM_7.5yrs
Guruprasad_Testing_TM_7.5yrsGuruprasad_Testing_TM_7.5yrs
Guruprasad_Testing_TM_7.5yrs
 
Mrityunjay_MJ_Testing_Profile
Mrityunjay_MJ_Testing_ProfileMrityunjay_MJ_Testing_Profile
Mrityunjay_MJ_Testing_Profile
 
Prem_Papabathini_Resume_2016
Prem_Papabathini_Resume_2016Prem_Papabathini_Resume_2016
Prem_Papabathini_Resume_2016
 
CV_Thirumalai_1.0
CV_Thirumalai_1.0CV_Thirumalai_1.0
CV_Thirumalai_1.0
 
Case Study-Indirect China Strategic Sourcing
Case Study-Indirect China Strategic SourcingCase Study-Indirect China Strategic Sourcing
Case Study-Indirect China Strategic Sourcing
 
Lean pilots by Mariya Breyter from Dun & Bradstreet
Lean pilots by Mariya Breyter from Dun & BradstreetLean pilots by Mariya Breyter from Dun & Bradstreet
Lean pilots by Mariya Breyter from Dun & Bradstreet
 
Test Automation in Agile
Test Automation in AgileTest Automation in Agile
Test Automation in Agile
 
Giant Plc 2009
Giant Plc 2009Giant Plc 2009
Giant Plc 2009
 

Más de QASymphony

QASymphony Atlanta Customer User Group Fall 2017
QASymphony Atlanta Customer User Group Fall 2017QASymphony Atlanta Customer User Group Fall 2017
QASymphony Atlanta Customer User Group Fall 2017QASymphony
 
Making the Switch from HP Quality Center to qTest
Making the Switch from HP Quality Center to qTestMaking the Switch from HP Quality Center to qTest
Making the Switch from HP Quality Center to qTestQASymphony
 
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
Quality Jam 2017: Sheekha Singh "Millennials & Testing"Quality Jam 2017: Sheekha Singh "Millennials & Testing"
Quality Jam 2017: Sheekha Singh "Millennials & Testing"QASymphony
 
Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"
Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"
Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"QASymphony
 
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
Quality Jam 2017: Sheekha Singh "Millennials & Testing"Quality Jam 2017: Sheekha Singh "Millennials & Testing"
Quality Jam 2017: Sheekha Singh "Millennials & Testing"QASymphony
 
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"QASymphony
 
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...QASymphony
 
Quality Jam 2017: Keith Klain "Debugging Your Test Team"
Quality Jam 2017: Keith Klain "Debugging Your Test Team"Quality Jam 2017: Keith Klain "Debugging Your Test Team"
Quality Jam 2017: Keith Klain "Debugging Your Test Team"QASymphony
 
Where Testers & QA Fit in the Story of DevOps
Where Testers & QA Fit in the Story of DevOpsWhere Testers & QA Fit in the Story of DevOps
Where Testers & QA Fit in the Story of DevOpsQASymphony
 
Closing the Requirements and Testing Loop Webinar
Closing the Requirements and Testing Loop WebinarClosing the Requirements and Testing Loop Webinar
Closing the Requirements and Testing Loop WebinarQASymphony
 
Agile Testing Analytics
Agile Testing AnalyticsAgile Testing Analytics
Agile Testing AnalyticsQASymphony
 
Making the Move to Behavior Driven Development
Making the Move to Behavior Driven DevelopmentMaking the Move to Behavior Driven Development
Making the Move to Behavior Driven DevelopmentQASymphony
 
Using JIRA for Risk Based Testing - QASymphony Webinar
Using JIRA for Risk Based Testing  - QASymphony WebinarUsing JIRA for Risk Based Testing  - QASymphony Webinar
Using JIRA for Risk Based Testing - QASymphony WebinarQASymphony
 
Evolve or Die: Healthcare IT Testing | QASymphony Webinar
Evolve or Die: Healthcare IT Testing | QASymphony WebinarEvolve or Die: Healthcare IT Testing | QASymphony Webinar
Evolve or Die: Healthcare IT Testing | QASymphony WebinarQASymphony
 

Más de QASymphony (14)

QASymphony Atlanta Customer User Group Fall 2017
QASymphony Atlanta Customer User Group Fall 2017QASymphony Atlanta Customer User Group Fall 2017
QASymphony Atlanta Customer User Group Fall 2017
 
Making the Switch from HP Quality Center to qTest
Making the Switch from HP Quality Center to qTestMaking the Switch from HP Quality Center to qTest
Making the Switch from HP Quality Center to qTest
 
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
Quality Jam 2017: Sheekha Singh "Millennials & Testing"Quality Jam 2017: Sheekha Singh "Millennials & Testing"
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
 
Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"
Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"
Quality Jam 2017: Paul Merrill "Machine Learning & How it Affects Testers"
 
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
Quality Jam 2017: Sheekha Singh "Millennials & Testing"Quality Jam 2017: Sheekha Singh "Millennials & Testing"
Quality Jam 2017: Sheekha Singh "Millennials & Testing"
 
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
 
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
 
Quality Jam 2017: Keith Klain "Debugging Your Test Team"
Quality Jam 2017: Keith Klain "Debugging Your Test Team"Quality Jam 2017: Keith Klain "Debugging Your Test Team"
Quality Jam 2017: Keith Klain "Debugging Your Test Team"
 
Where Testers & QA Fit in the Story of DevOps
Where Testers & QA Fit in the Story of DevOpsWhere Testers & QA Fit in the Story of DevOps
Where Testers & QA Fit in the Story of DevOps
 
Closing the Requirements and Testing Loop Webinar
Closing the Requirements and Testing Loop WebinarClosing the Requirements and Testing Loop Webinar
Closing the Requirements and Testing Loop Webinar
 
Agile Testing Analytics
Agile Testing AnalyticsAgile Testing Analytics
Agile Testing Analytics
 
Making the Move to Behavior Driven Development
Making the Move to Behavior Driven DevelopmentMaking the Move to Behavior Driven Development
Making the Move to Behavior Driven Development
 
Using JIRA for Risk Based Testing - QASymphony Webinar
Using JIRA for Risk Based Testing  - QASymphony WebinarUsing JIRA for Risk Based Testing  - QASymphony Webinar
Using JIRA for Risk Based Testing - QASymphony Webinar
 
Evolve or Die: Healthcare IT Testing | QASymphony Webinar
Evolve or Die: Healthcare IT Testing | QASymphony WebinarEvolve or Die: Healthcare IT Testing | QASymphony Webinar
Evolve or Die: Healthcare IT Testing | QASymphony Webinar
 

Último

How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?AmeliaSmith90
 
Deep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - DatacampDeep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - DatacampVICTOR MAESTRE RAMIREZ
 
Kawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in TrivandrumKawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in TrivandrumKawika Technologies
 
20240330_고급진 코드를 위한 exception 다루기
20240330_고급진 코드를 위한 exception 다루기20240330_고급진 코드를 위한 exception 다루기
20240330_고급진 코드를 위한 exception 다루기Chiwon Song
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024Mind IT Systems
 
OpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorOpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorShane Coughlan
 
Webinar - IA generativa e grafi Neo4j: RAG time!
Webinar - IA generativa e grafi Neo4j: RAG time!Webinar - IA generativa e grafi Neo4j: RAG time!
Webinar - IA generativa e grafi Neo4j: RAG time!Neo4j
 
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Jaydeep Chhasatia
 
Mastering Kubernetes - Basics and Advanced Concepts using Example Project
Mastering Kubernetes - Basics and Advanced Concepts using Example ProjectMastering Kubernetes - Basics and Advanced Concepts using Example Project
Mastering Kubernetes - Basics and Advanced Concepts using Example Projectwajrcs
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...OnePlan Solutions
 
Growing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesGrowing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesSoftwareMill
 
online pdf editor software solutions.pdf
online pdf editor software solutions.pdfonline pdf editor software solutions.pdf
online pdf editor software solutions.pdfMeon Technology
 
IA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeIA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeNeo4j
 
ERP For Electrical and Electronics manufecturing.pptx
ERP For Electrical and Electronics manufecturing.pptxERP For Electrical and Electronics manufecturing.pptx
ERP For Electrical and Electronics manufecturing.pptxAutus Cyber Tech
 
Watermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security ChallengesWatermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security ChallengesShyamsundar Das
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIIvo Andreev
 
Your Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software TeamsYour Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software TeamsJaydeep Chhasatia
 
AI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human BeautyAI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human BeautyRaymond Okyere-Forson
 

Último (20)

Program with GUTs
Program with GUTsProgram with GUTs
Program with GUTs
 
How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?
 
Deep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - DatacampDeep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - Datacamp
 
Kawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in TrivandrumKawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in Trivandrum
 
20240330_고급진 코드를 위한 exception 다루기
20240330_고급진 코드를 위한 exception 다루기20240330_고급진 코드를 위한 exception 다루기
20240330_고급진 코드를 위한 exception 다루기
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024
 
OpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorOpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS Calculator
 
Webinar - IA generativa e grafi Neo4j: RAG time!
Webinar - IA generativa e grafi Neo4j: RAG time!Webinar - IA generativa e grafi Neo4j: RAG time!
Webinar - IA generativa e grafi Neo4j: RAG time!
 
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
 
Mastering Kubernetes - Basics and Advanced Concepts using Example Project
Mastering Kubernetes - Basics and Advanced Concepts using Example ProjectMastering Kubernetes - Basics and Advanced Concepts using Example Project
Mastering Kubernetes - Basics and Advanced Concepts using Example Project
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
 
Growing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesGrowing Oxen: channel operators and retries
Growing Oxen: channel operators and retries
 
online pdf editor software solutions.pdf
online pdf editor software solutions.pdfonline pdf editor software solutions.pdf
online pdf editor software solutions.pdf
 
Sustainable Web Design - Claire Thornewill
Sustainable Web Design - Claire ThornewillSustainable Web Design - Claire Thornewill
Sustainable Web Design - Claire Thornewill
 
IA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeIA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG time
 
ERP For Electrical and Electronics manufecturing.pptx
ERP For Electrical and Electronics manufecturing.pptxERP For Electrical and Electronics manufecturing.pptx
ERP For Electrical and Electronics manufecturing.pptx
 
Watermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security ChallengesWatermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security Challenges
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AI
 
Your Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software TeamsYour Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
 
AI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human BeautyAI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human Beauty
 

TUI & qTest: Why, How and Where Next

  • 1. TUI & qTest: Why, How and Where Next Phil Thomas: General Manager of QA & Test | 11th October 2017
  • 2. About TUI UK& Ireland TUI UK & Ireland is the UK’s largest tour operator with key brands including Thomson, First Choice, and Thomson Cruises as well as Crystal Ski and Thomson Lakes & Mountains. TUI UK & Ireland has a team of more than 10,000 employees and serves over six million customers each year. TUI UK and Ireland is a member of TUI Group. TUI UK & Ireland’s airline, Thomson Airways is the UK’s third largest airline with 62 aircraft operating to over 88 destinations in 30 countries. UK’s largest tour operator UK 3rd largest airline 10k employees & 6m customers
  • 4. Where do we want to be?
  • 5. System & Integration Automation & Performance Exploratory & Smoke Testing Regression & OAT UAT & Production Projects, Releases, BAU & CR’s Agile & Waterfall In-house, 3rd Party & Offshore UK&I, Northern Region & Group Test Scope Delivery DevOps & AWS….
  • 6. Why Bother? 1.Lack of real time Test reporting 2.No integration with Rally & Jira 3.Consolidate on a single Tool 4.Lacked traceability 5.Not sufficiently intuitive 6.Not future proofed for DevOps & Cloud 7.TUI Test Mgrs lacked visibility of Test planning & execution
  • 7. How did we choose qTest?
  • 8. Set-up a Team for the DurationTUI Test Managers UAT Managers Sonata Test Managers Delivery Manager Scrum Master Project Manager
  • 9.  Within budget  Handle multiple Business Portfolios  Test Tool as cloud solution  Real time MI dashboard reporting  Real-time integration with Rally, Jira & CI/CD tools  Capture and manage Business Priority & Risk Top Requirements
  • 10. Steps to choosing qTest Business, UK IT & CIO Approval Evaluated the 7 against Requirements Resulted in remaining 3 Detailed POC & Commercials Unanimous agreement Agreed Requirements & Weighting Suggestions shortlisted to 7
  • 11. Scoring the Seven Criteria Cost (H) Average 3 Poor 1 Average 3 Average 2 Test Design & Planning (H) Good 4 Good 5 Good 5 Good 5 Traceability (H) Good 4 Good 5 Good 4 Good 5 Real Time MI (H) Average 3 Good 5 Good 5 Good 4 Integration Capability (H) Average 3 Average 3 Good 5 Good 3 Defect Mgt (H) Average 3 Good 5 Good 4 Good 4 Useability/User Friendliness (H) Good 5 Good 5 Good 5 Average 3 Result / Score Result / Score Result / Score Result / Score PractiTest HP ALM/QC qTest QAComplete JIRA/Zephyr qTest SpiraTest QA Complete PractiTest HP ALM/QC 89.5 88.1 86.5 86.3 69.6 N/A
  • 12. How did we implement qTest?
  • 13. Implementation Overview  Identified Stakeholders & Comms Plan  Regular promotion across TUI & 3rd Parties  Weekly calls with Matt, our QAS Success Champion  Ensured Sonata fully engaged  Issued TUI standards for qTest  TUI training materials & training sessions  Targeted training for the initial Projects Teams  Completed data cleanse and migration
  • 14. Implementing qTest Set up 5 sub teams covering 1. Requirements & Test Planning 2. Test Design & Scripts 3. Defect Management 4. Reporting & MI Dashboards 5. Migration & Integration  Cross team coordination for MVP  Used an early Gold Copy instance  Weekly meetings, including UAT and offshore
  • 15. Implementing qTest: The Plan Jan Feb March April May June July Aug Sept Analysis Initial Set-up Pilot Training Pilot 1 Pilot 2 Final Set-up User Training 17.3 Release Daily Standups BAU
  • 16. Cutover: Release 17.3 - qTest 17.3: Projects Requiremen ts Loaded Initial Scripts Loaded Scripts run & defects raised Remaining projects join qTest Regression Pack & O/s 17.2 defects Release 17.2: Bugzilla & TestOpia On Going Training and Communications Daily reviews and rapid issue resolution
  • 19. qTest – Results to far Phase 1: Targets all met & Benefits realised Exceeded expectations:  qTest live a month early  Integration to Rally & Jira  Adopted by o TUI Group projects o E-Commerce scrums teams for SIT o Airline Portfolio Total active users 513 Logged once since 1st June 510 Logged once since 1st Aug 456 Logged once since last wk 320 Logged once since Monday 243
  • 20. What Worked Well  Selection Process  Training  MVP  Collaboration
  • 21. qTest – What Next?
  • 22. qTest – Next Steps  Further teams moving onto qTest  Session Based Testing & Automation  Reporting on Automation results  Using qTest data to drive improvements  UAT use of EggPlant  DevOps: CI/CD  Putting qTest front & centre of Nordics delivery