SlideShare una empresa de Scribd logo
1 de 13
Finding improvement path
(Recommender system)
Muntis Rudzītis
Machine Learning enthusiast
RIGA COMM, 11.10.2018
2
Emergn Machine Learning Lab
Predictive invoice-to-payment for
Utility company
ML technique:
Random Forest, AdaBoost etc.
ML technique:
Computer vision
Employee detection in production
for Latvian Plywood
ML technique:
Market Basket Analysis
(association rules)
Product recommendation engine
for e-markets
Question – “What’s next?”
• Next video/movie
• Next song
• Next JIRA / Redmine / Bugzilla task
• Next thing to learn
Finding optimum and making sure it will lead to better result is hard and highly biased.
3
Our solution
• Requires:
• Historical data
• Enough data
• The more input factors, the better
• Rating function (current rating) – can be individualized or not.
4
Latvian e-environment
The Latvian e-index is an e-environment rating (level/quality of e-services) in public
administration institutions and municipalities.
Created and calculated by Ministry of Environmental Protection and Regional Development of the Republic
of Latvia (VARAM).
5
What's needed?
• Personalized recommendations for each institution
• Ordered plan of action for e-index improvement
• Visual, end-user-readable representation of the solution
VARAM logo
Latvian e-environment
The Latvian e-index is an e-environment rating (level/quality of e-services) in public
administration institutions and municipalities.
6
What we did?
• Data exploration
• Comparison by variation
• Heavy normalization and
transformation
• Clustering? No.
• MinMaxing? No.
LV e-environment
• Closeness = similarity in functionality, by variation
• Color = growth of e-index value
• Recommendations based on similar, but better
performing neighbors.
• Action items – based on maximum potential growth in
local vicinity.
7
8
https://plot.ly/~akramkovska/11.embed
9
https://plot.ly/~akramkovska/30.embed
Recommendation system
• Recommends improvement based upon similar data points
• Recommends 3 (or more) next best steps, calculates potential gain
• Recalculates the dimensions, adjusts the parameters
• Creates next recommendations – creating full improvement path
10
AI/ML Service description Card
AI/ML Service main Use Case: Company: Emergn
• Software development &
consulting company
• 250 employees located in Riga
AI/ML Service Specification
Improvement path
Uses local similarities to find local
maxima for improvement, by looking
at similar (but better) data points
Prediction
Recommends next
things to do.
Input/Output
Data with high enough
number of parameters
&
ranking function.
Provides next best
step for improvement
with improvement gain
calculated.
Accuracy
Customizable for each
use case – does
provide path.
Expert opinion?
Training
Historical ranked data
with enough
parameters.
~100 data points and
~50+ parameters is
good starting point.
Implementation options:
• Could be implemented and
optimized for use case in
~2 weeks
• No need for specific
infrastructure
12
Questions?
Comments?
Ideas?
If time is short, catch me in the break with your question/idea/use case.
Thank you
Muntis Rudzītis
muntis.rudzitis@emergn.com
muntis.rudzitis@gmail.com
Paldies!

Más contenido relacionado

Similar a Finding improvement path using recommender systems RIGA COMM 2018

Sps chicago suburbs outsourcing your share point hosting - the clouds fine ...
Sps chicago suburbs   outsourcing your share point hosting - the clouds fine ...Sps chicago suburbs   outsourcing your share point hosting - the clouds fine ...
Sps chicago suburbs outsourcing your share point hosting - the clouds fine ...
SherWeb
 
Qcon SF 2013 - Machine Learning & Recommender Systems @ Netflix Scale
Qcon SF 2013 - Machine Learning & Recommender Systems @ Netflix ScaleQcon SF 2013 - Machine Learning & Recommender Systems @ Netflix Scale
Qcon SF 2013 - Machine Learning & Recommender Systems @ Netflix Scale
Xavier Amatriain
 

Similar a Finding improvement path using recommender systems RIGA COMM 2018 (20)

Nikhil's resume
Nikhil's resumeNikhil's resume
Nikhil's resume
 
Building Intelligent Workplace Limits and Challenges RIGA COMM 2023
Building Intelligent Workplace Limits and Challenges RIGA COMM 2023 Building Intelligent Workplace Limits and Challenges RIGA COMM 2023
Building Intelligent Workplace Limits and Challenges RIGA COMM 2023
 
IRJET- E-Commerce Recommendation System: Problems and Solutions
IRJET- E-Commerce Recommendation System: Problems and SolutionsIRJET- E-Commerce Recommendation System: Problems and Solutions
IRJET- E-Commerce Recommendation System: Problems and Solutions
 
Sps chicago suburbs outsourcing your share point hosting - the clouds fine ...
Sps chicago suburbs   outsourcing your share point hosting - the clouds fine ...Sps chicago suburbs   outsourcing your share point hosting - the clouds fine ...
Sps chicago suburbs outsourcing your share point hosting - the clouds fine ...
 
Outsourcing Your SharePoint Hosting - the clouds fine print magnified
Outsourcing Your SharePoint Hosting - the clouds fine print magnifiedOutsourcing Your SharePoint Hosting - the clouds fine print magnified
Outsourcing Your SharePoint Hosting - the clouds fine print magnified
 
Sps chicago suburbs outsourcing your share point hosting - the clouds fine ...
Sps chicago suburbs   outsourcing your share point hosting - the clouds fine ...Sps chicago suburbs   outsourcing your share point hosting - the clouds fine ...
Sps chicago suburbs outsourcing your share point hosting - the clouds fine ...
 
Conclusion Connect state of IoT 2019 Review io t solutions world congress 2019
Conclusion Connect state of IoT 2019 Review io t solutions world congress 2019Conclusion Connect state of IoT 2019 Review io t solutions world congress 2019
Conclusion Connect state of IoT 2019 Review io t solutions world congress 2019
 
STARBUCKS Site Selection Analysis drift
STARBUCKS Site Selection Analysis driftSTARBUCKS Site Selection Analysis drift
STARBUCKS Site Selection Analysis drift
 
Data Science for Online Services: Problems & Frontiers (Changbal Conference 2...
Data Science for Online Services: Problems & Frontiers (Changbal Conference 2...Data Science for Online Services: Problems & Frontiers (Changbal Conference 2...
Data Science for Online Services: Problems & Frontiers (Changbal Conference 2...
 
#ATAGTR2021 Presentation : "Use of AI and ML in Performance Testing" by Adolf...
#ATAGTR2021 Presentation : "Use of AI and ML in Performance Testing" by Adolf...#ATAGTR2021 Presentation : "Use of AI and ML in Performance Testing" by Adolf...
#ATAGTR2021 Presentation : "Use of AI and ML in Performance Testing" by Adolf...
 
Outsourcing your SharePoint Hosting: The Cloud's Fine Print Magnified
Outsourcing your SharePoint Hosting: The Cloud's Fine Print MagnifiedOutsourcing your SharePoint Hosting: The Cloud's Fine Print Magnified
Outsourcing your SharePoint Hosting: The Cloud's Fine Print Magnified
 
Machine Data Analytics
Machine Data AnalyticsMachine Data Analytics
Machine Data Analytics
 
Page a partition aware engine for parallel graph computation
Page a partition aware engine for parallel graph computationPage a partition aware engine for parallel graph computation
Page a partition aware engine for parallel graph computation
 
Qcon SF 2013 - Machine Learning & Recommender Systems @ Netflix Scale
Qcon SF 2013 - Machine Learning & Recommender Systems @ Netflix ScaleQcon SF 2013 - Machine Learning & Recommender Systems @ Netflix Scale
Qcon SF 2013 - Machine Learning & Recommender Systems @ Netflix Scale
 
Key Imperatives for the CIO in Digital Age By Lalatendu Das Digital VP, Assoc...
Key Imperatives for the CIO in Digital Age By Lalatendu Das Digital VP, Assoc...Key Imperatives for the CIO in Digital Age By Lalatendu Das Digital VP, Assoc...
Key Imperatives for the CIO in Digital Age By Lalatendu Das Digital VP, Assoc...
 
Vishnu_Gowthem_Resume
Vishnu_Gowthem_ResumeVishnu_Gowthem_Resume
Vishnu_Gowthem_Resume
 
Ticketing Systems | Ticketing Systems framework | online ticketing system
Ticketing Systems | Ticketing Systems framework | online ticketing systemTicketing Systems | Ticketing Systems framework | online ticketing system
Ticketing Systems | Ticketing Systems framework | online ticketing system
 
L2 DS Tools and Application.pptx
L2 DS Tools and Application.pptxL2 DS Tools and Application.pptx
L2 DS Tools and Application.pptx
 
Using FME to Automate Data Integration in a City
Using FME to Automate Data Integration in a CityUsing FME to Automate Data Integration in a City
Using FME to Automate Data Integration in a City
 
Behind the Buzzword: Understanding Customer Data Platforms in the Light of Pr...
Behind the Buzzword: Understanding Customer Data Platforms in the Light of Pr...Behind the Buzzword: Understanding Customer Data Platforms in the Light of Pr...
Behind the Buzzword: Understanding Customer Data Platforms in the Light of Pr...
 

Último

Último (20)

Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
 
Evolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI EraEvolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI Era
 
Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...
Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...
Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...
 
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale IbridaUNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
 
Prompt Engineering - an Art, a Science, or your next Job Title?
Prompt Engineering - an Art, a Science, or your next Job Title?Prompt Engineering - an Art, a Science, or your next Job Title?
Prompt Engineering - an Art, a Science, or your next Job Title?
 
A Deep Dive into Secure Product Development Frameworks.pdf
A Deep Dive into Secure Product Development Frameworks.pdfA Deep Dive into Secure Product Development Frameworks.pdf
A Deep Dive into Secure Product Development Frameworks.pdf
 
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdfThe Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
 
Workshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit Milan
Workshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit MilanWorkshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit Milan
Workshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit Milan
 
Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...
Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...
Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...
 
Workshop - Architecting Innovative Graph Applications- GraphSummit Milan
Workshop -  Architecting Innovative Graph Applications- GraphSummit MilanWorkshop -  Architecting Innovative Graph Applications- GraphSummit Milan
Workshop - Architecting Innovative Graph Applications- GraphSummit Milan
 
Auto Affiliate AI Earns First Commission in 3 Hours..pdf
Auto Affiliate  AI Earns First Commission in 3 Hours..pdfAuto Affiliate  AI Earns First Commission in 3 Hours..pdf
Auto Affiliate AI Earns First Commission in 3 Hours..pdf
 
Your Ultimate Web Studio for Streaming Anywhere | Evmux
Your Ultimate Web Studio for Streaming Anywhere | EvmuxYour Ultimate Web Studio for Streaming Anywhere | Evmux
Your Ultimate Web Studio for Streaming Anywhere | Evmux
 
Community is Just as Important as Code by Andrea Goulet
Community is Just as Important as Code by Andrea GouletCommunity is Just as Important as Code by Andrea Goulet
Community is Just as Important as Code by Andrea Goulet
 
Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024
 
From Knowledge Graphs via Lego Bricks to scientific conversations.pptx
From Knowledge Graphs via Lego Bricks to scientific conversations.pptxFrom Knowledge Graphs via Lego Bricks to scientific conversations.pptx
From Knowledge Graphs via Lego Bricks to scientific conversations.pptx
 
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
 
Modern binary build systems - PyCon 2024
Modern binary build systems - PyCon 2024Modern binary build systems - PyCon 2024
Modern binary build systems - PyCon 2024
 
Alluxio Monthly Webinar | Simplify Data Access for AI in Multi-Cloud
Alluxio Monthly Webinar | Simplify Data Access for AI in Multi-CloudAlluxio Monthly Webinar | Simplify Data Access for AI in Multi-Cloud
Alluxio Monthly Webinar | Simplify Data Access for AI in Multi-Cloud
 
Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024
Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024
Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024
 
Microsoft365_Dev_Security_2024_05_16.pdf
Microsoft365_Dev_Security_2024_05_16.pdfMicrosoft365_Dev_Security_2024_05_16.pdf
Microsoft365_Dev_Security_2024_05_16.pdf
 

Finding improvement path using recommender systems RIGA COMM 2018

  • 1. Finding improvement path (Recommender system) Muntis Rudzītis Machine Learning enthusiast RIGA COMM, 11.10.2018
  • 2. 2 Emergn Machine Learning Lab Predictive invoice-to-payment for Utility company ML technique: Random Forest, AdaBoost etc. ML technique: Computer vision Employee detection in production for Latvian Plywood ML technique: Market Basket Analysis (association rules) Product recommendation engine for e-markets
  • 3. Question – “What’s next?” • Next video/movie • Next song • Next JIRA / Redmine / Bugzilla task • Next thing to learn Finding optimum and making sure it will lead to better result is hard and highly biased. 3
  • 4. Our solution • Requires: • Historical data • Enough data • The more input factors, the better • Rating function (current rating) – can be individualized or not. 4
  • 5. Latvian e-environment The Latvian e-index is an e-environment rating (level/quality of e-services) in public administration institutions and municipalities. Created and calculated by Ministry of Environmental Protection and Regional Development of the Republic of Latvia (VARAM). 5 What's needed? • Personalized recommendations for each institution • Ordered plan of action for e-index improvement • Visual, end-user-readable representation of the solution VARAM logo
  • 6. Latvian e-environment The Latvian e-index is an e-environment rating (level/quality of e-services) in public administration institutions and municipalities. 6 What we did? • Data exploration • Comparison by variation • Heavy normalization and transformation • Clustering? No. • MinMaxing? No.
  • 7. LV e-environment • Closeness = similarity in functionality, by variation • Color = growth of e-index value • Recommendations based on similar, but better performing neighbors. • Action items – based on maximum potential growth in local vicinity. 7
  • 10. Recommendation system • Recommends improvement based upon similar data points • Recommends 3 (or more) next best steps, calculates potential gain • Recalculates the dimensions, adjusts the parameters • Creates next recommendations – creating full improvement path 10
  • 11. AI/ML Service description Card AI/ML Service main Use Case: Company: Emergn • Software development & consulting company • 250 employees located in Riga AI/ML Service Specification Improvement path Uses local similarities to find local maxima for improvement, by looking at similar (but better) data points Prediction Recommends next things to do. Input/Output Data with high enough number of parameters & ranking function. Provides next best step for improvement with improvement gain calculated. Accuracy Customizable for each use case – does provide path. Expert opinion? Training Historical ranked data with enough parameters. ~100 data points and ~50+ parameters is good starting point. Implementation options: • Could be implemented and optimized for use case in ~2 weeks • No need for specific infrastructure
  • 12. 12 Questions? Comments? Ideas? If time is short, catch me in the break with your question/idea/use case.

Notas del editor

  1. Pievienošu bildi un linku uz pca telpu https://plot.ly/~akramkovska/11.embed Pievienošu bildi un linku uz rekomendāciju piemēriem https://plot.ly/~akramkovska/30.embed
  2. Pievienošu bildi un linku uz pca telpu https://plot.ly/~akramkovska/11.embed Pievienošu bildi un linku uz rekomendāciju piemēriem https://plot.ly/~akramkovska/30.embed
  3. Pievienošu bildi un linku uz pca telpu https://plot.ly/~akramkovska/11.embed Pievienošu bildi un linku uz rekomendāciju piemēriem https://plot.ly/~akramkovska/30.embed