SlideShare una empresa de Scribd logo
1 de 75
Evolution of Data Sciences and
Marketing Analytics
Prof. M J Xavier
Email: xavier.mj@gmail.com
Historic
Development
of Business
Analytics
• When did Analytics Begin?
• With the invention of wheel – 3500 BC
• To calculate the circumference to fit a rim – π
• Number system and astronomy
• Kings used numbers for collecting and accounting
taxes
• Probability theory got developed for games (6th
century BC)
• Statistical methods were developed in 5th
Century BC.
• In 1660s statistics was used for census and
demographic studies
• Bayes theorem was invented in 1761
• In 1747 design of experiments was used to find a
cure for scurvy
• Design of experiments were extensively used in
Agriculture
Other
Developments
• Operations Research started in 1930s
to solve problems of military
operations.
• After Word war – II these experts
started solving business problems.
• Critical Path Method – Project
Management
• Shortest route problems -
Transportation
• Warehouse location
• Replacement Problems
• Inventory Management
• Simplex algorithm for LP was
developed in 1947
My
Encounter
With
Analytics
• Operations Research in Chemical Engineering at REC
Warangal
• LP for Petroleum products
• Dynamic programming for Chemical plant design
• Doctorate in IIM Calcutta
• ITC problem
• My PhD Work
• Experience at MODE – Data Analysis
• TNS and GFK
• iCRM Projects
• Shopper’s Stop
• Online Travel company
• Recent Works
• Model for Credit worthiness
• Emotion Analysis for customer satisfaction
DS 0.0 –
User of
Numbers
• Numbers for bookkeeping and to
measure performance
• Sales
• Finance
DS 1.0 –
Operations
Research
• Operation Research Models
for Optimal Decisions
• Critical Path Method – Project
Management
• Shortest Route problems -
Transportation
• Warehouse location
• Replacement Problems
• Inventory Management
DS 1.1- Statistical Tools
• Data Analysis
• Use of statistical tools
• Factor Analysis
• Conjoint Analysis
• Multidimensional Scaling
• Correspondence Analysis
VST Study
DS 2.0 –
Electronic
Data
Processing
• Use of Computers for storing and
retrieving data
• EDP department (SPIC sales in
regions)
DS 2.1 – MIS
• MIS and DSS
• Metrics
• Dashboards
• Knowledge Management
DS 3.0 –
Business
Intelligence
• Business Intelligence
• Data Warehousing
• OLTP and OLAP
• Data Marts
Metadata
Data Sources Data Management Access
Complete Warehouse Solution Architecture
Operational Data
Legacy Data
The Post
VISA
External Data
Sources
Enterprise
Data
Warehouse
Organisationally
structured
Extract
Transform
Maintain
Data Information Knowledge
Asset Assembly (and Management) Asset Exploitation
Data
Mart
Data
Mart
Departmentally
structured
Data
Mart
Data
Mart and
Metadata
• Data marts are subsets of a data
warehouse, which are designed to
meet the unique needs of specific
functional or operating groups.
• Metadata is data about data. The
metadata for a specific database may
be likened to a book’s table of content;
it identifies what is stored where
within the database.
What is Online Analytic Processing (OLAP)?
•“OLAP enables an end user to rapidly analyze a data
warehouse from any perspective in an ad-hoc
environment”
Regional Analysis
BOMBAY
DELHI
January February
Cosmetics
Perfumes
Clothing
Accessories
Cosmetics
Perfumes
Clothing
Accessories
The
Questions
OLAP
Answers
• Comparisons
• Revenue increase this quarter
compared to same period last year
• Marketshare
• Show Brand A sales as a percentage
of total sales
• Top and bottom N, top and bottom
N%
• Show top 10 products based on last
week’s sales in the Eastern region
DS 3.1 – Data Analytics
• Data Analytics
• Patterns and Trends in the
Data - Tesco
• Clustering and Classification
What Is
Data
Analytics
“Simply put, data analytics is used to
discover patterns and relationships
in the data in order to help
managers make
better business decisions and exploit
new opportunities.”
Analysis
procedures
• Association: looking for patterns where
one event is connected to another event
• Sequence or path analysis: looking for
patterns where one event leads to a later
event
• Classification: looking for new patterns
• Clustering: finding and visually
documenting groups of facts not previously
known
• Scoring models: developing propensity
scores for individual customers
• Forecasting/Predictions: discovering
patterns in data that can lead to reasonable
predictions about the future
Fraud
and
Crime
Detection
• Look for Outliers – Stock Market
• Map the network of criminals
Jialun Qin, Jennifer J. Xu, Daning Hu,
Marc Sageman and Hsinchun Chen,
“Analyzing Terrorist Networks: A Case Study
of the Global Salafi Jihad Network” Lecture
Notes in Computer Science,
Publisher: Springer-Verlag GmbH, Volume
3495 / 2005 , p. 287.
DS 3.2 – Web Analytics
• Google Analytics (IFMR)
• Semrush
• Kissmetrics
• Heatmaps
• New metrics
• Look to Book
• Abandonment rate
• Click Through Rate
DS 4.0 – Big Data
Speed of data
generation
Activity data •
Conversation
Data
• Our conversations are now
digitally recorded. It all started
with emails but nowadays most of
our conversations leave a digital
trail. Just think of all the
conversations we have on social
media sites like Facebook or
Twitter. Even many of our phone
conversations are now digitally
recorded.
Photo
and
Video
Image
Data
• Just think about all the pictures
we take on our smart phones or
digital cameras. We upload and
share 100s of thousands of them
on social media sites every
second. The increasing amounts of
CCTV cameras take video images
and we up-load hundreds of hours
of video images to YouTube and
other sites every minute .
Sensor Data
• We are increasingly surrounded by sensors that collect and
share data. Take your smart phone, it contains a global
positioning sensor to track exactly where you are every
second of the day, it includes an accelometer to track the
speed and direction at which you are travelling. We now have
sensors in many devices and products.
IoT Data
• We now have smart TVs that are able to
collect and process data, we have smart
watches, smart fridges, and smart
alarms. The Internet of Things, or
Internet of Everything connects these
devices so that e.g. the traffic sensors on
the road send data to your alarm clock
which will wake you up earlier than
planned because the blocked road means
you have to leave earlier to make your
9am meeting…
Telematics for Cars and Trucks
Characteristics
of Big Data
• With the datafication comes big
data, which is often described using
the four Vs:
• Volume
• Velocity
• Variety
• Veracity
Volume
• …refers to the vast amounts of data
generated every second. We are not
talking Terabytes but Zettabytes or
Brontobytes. If we take all the data
generated in the world between the
beginning of time and 2000, the same
amount of data will soon be generated
every minute. New big data tools use
distributed systems so that we can store
and analyse data across databases that
are dotted around anywhere in the
world.
Velocity • …refers to the speed at which new data is
generated and the speed at which data
moves around. Just think of social media
messages going viral in seconds. Technology
allows us now to analyse the data while it is
being generated (sometimes referred to as
inmemory analytics), without ever putting it
into databases.
Variety
• …refers to the different types of data we can now use. In the
past we only focused on structured data that neatly fitted into
tables or relational databases, such as financial data. In fact,
80% of the world’s data is unstructured (text, images, video,
voice, etc.) With big data technology we can now analyse and
bring together data of different types such as messages,
social media conversations, photos, sensor data, video or
voice recordings.
Veracity
• …refers to the messiness or
trustworthiness of the data. With
many forms of big data quality and
accuracy are less controllable (just
think of Twitter posts with hash tags,
abbreviations, typos and colloquial
speech as well as the reliability and
accuracy of content) but technology
now allows us to work with this type
of data.
Gaps
Analyzable
Data
Analyzed
Data
Total Data
Tools Gap
Application Gap
Turning Big Data Into Value
Big Data
Applications
Better
understand
and target
customers
• To better understand and target
customers, companies expand their
traditional data sets with social media
data, browser, text analytics or sensor data
to get a more complete picture of their
customers. The big objective, in many
cases, is to create predictive models. Using
big data, Telecom companies can now
better predict customer churn; retailers
can predict what products will sell, and car
insurance companies understand how well
their customers actually drive.
Understand
and
Optimize
Business
Processes
• Big data is also increasingly used to
optimize business processes.
Retailers are able to optimize their
stock based on predictive models
generated from social media data,
web search trends and weather
forecasts. Another example is supply
chain or delivery route optimization
using data from geographic
positioning and radio frequency
identification sensors.
Improving
Health
• The computing power of big data analytics
enables us to find new cures and better
understand and predict disease patterns.
We can use all the data from smart watches
and wearable devices to better understand
links between lifestyles and diseases. Big
data analytics also allow us to monitor and
predict epidemics and disease outbreaks,
simply by listening to what people are
saying, i.e. “Feeling rubbish today - in bed
with a cold” or searching for on the
Internet, i.e. “cures for flu”.
Security Services
• Security services use big data analytics to foil terrorist plots
and detect cyber attacks. Police forces use big data tools to
catch criminals and even predict criminal activity and credit
card companies use big data analytics it to detect fraudulent
transactions.
Improving
Sports
Performance
• Most elite sports have now embraced big
data analytics. Many use video analytics
to track the performance of every player
in a football or baseball game, sensor
technology is built into sports equipment
such as basket balls or golf clubs, and
many elite sports teams track athletes
outside of the sporting environment –
using smart technology to track nutrition
and sleep, as well as social media
conversations to monitor emotional
wellbeing.
Improving
and
Optimizing
Cities and
Countries
• Big data is used to improve many aspects of
our cities and countries. For example, it
allows cities to optimize traffic flows based
on real time traffic information as well as
social media and weather data. A number
of cities are currently using big data
analytics with the aim of turning
themselves into Smart Cities, where the
transport infrastructure and utility
processes are all joined up. Where a bus
would wait for a delayed train and where
traffic signals predict traffic volumes and
operate to minimize jams.
Business Intelligence Vs Business
Analytics
4 Types of Data Analytics
Data Analysis Vs Data Analytics
DS 4.1 AI, ML & Deep
Learning
Human Brain
and Natural
Intelligence
Human brain is a graph of 100 Billion nodes and 700 Trillion Edges
Artificial Intelligence
AI Assistants
Microsoft Azure
Apple Amazon Web Services
Components
of AI
Natural Language processing
(Understands Human Language)
Big Data (Large data base of past
experiences)
Learning algorithm (Learns to
respond to Queries)
Machine learning is a field of computer science that gives computers the
ability to learn without being explicitly programmed
Methods that can learn from and make predictions on data
Labeled Data
Labeled Data
Machine Learning
algorithm
Learned model Prediction
Training
Prediction
Machine Learning Basics
Regression
Supervised: Learning with a labeled training set
Example: email classification with already labeled emails
Unsupervised: Discover patterns in unlabeled data
Example: cluster similar documents based on text
Reinforcement learning: learn to act based on feedback/reward
Example: learns better to classify based on reward
Types of Learning
class A
class A
Classification Clustering
http://mbjoseph.github.io/2013/11/27/measure.html
A machine learning subfield of learning representations of data. Exceptional
effective at learning patterns.
Deep learning algorithms attempt to learn (multiple levels of) representation by
using a hierarchy of multiple layers
If you provide the system tons of information, it begins to understand it and
respond in useful ways.
What is Deep Learning (DL) ?
https://www.xenonstack.com/blog/static/public/uploads/media/machine-learning-vs-deep-learning.png
So, 1. what exactly is deep learning ?
And, 2. why is it generally better than other methods on
image, speech and certain other types of data?
The short answers
1. ‘Deep Learning’ means using a neural network
with several layers of nodes between input and output
2. the series of layers between input & output do
feature identification and processing in a series of stages,
just as our brains seem to.
hmmm… OK, but:
3. multilayer neural networks have been around for
25 years. What’s actually new?
we have always had good algorithms for learning the
weights in networks with 1 hidden layer
but these algorithms are not good at learning the weights for
networks with more hidden layers
what’s new is: algorithms for training many-later networks
Tools for Deep
Learning
• Matlab
• R
• Amazon Rekognition
• IBM Watson
• Python
• Azure
Amazon Rekognition Pricing
Deep Learning in
Education
Robots in
Education
Image Courtesy: Indus International
School, Bangalore
More AI Applications
• Attendance Taking
• Class participation Marking
• Proctoring of online Exams
• Paper correction
• Chatbots for doubt clearing
• Robot teachers
• Precision teaching
• Authoring books and academic
articles
Precision Learning
• Just like precision medicine and precision
agriculture, learning will become
personalized and customized.
• Future will belong to those who develop
platforms for customized, personalized and
individualized course offerings using
Artificial Intelligence.
• Metacog is an App for IIT JEE coaching
on Google Playstore that serves lessons
based on prior knowledge of the student’s
aptitude for different subjects and speed of
learning.
• A time will come, for example, MBA program
itself will run on artificial intelligence
platform that would customize the content
based on the ability and the aptitude of the
learner.
Downside
of AI
https://www.impactbnd.com/blog/youtubes-top-stats-for-2020-infographic
What Next
https://www.impactbnd.com/blog/youtubes-top-stats-for-2020-infographic
Where are we headed?
0 Write a case study on “AI application in marketing”
0 Give sources from which you collected the information (Min 10
references)
0 This is a group assignment that should be submitted before 18th
october.
This Photo by Unknown Author is licensed under CC BY-NC

Más contenido relacionado

La actualidad más candente

Big data - Key Enablers, Drivers & Challenges
Big data - Key Enablers, Drivers & ChallengesBig data - Key Enablers, Drivers & Challenges
Big data - Key Enablers, Drivers & ChallengesShilpi Sharma
 
Big data analytics, research report
Big data analytics, research reportBig data analytics, research report
Big data analytics, research reportJULIO GONZALEZ SANZ
 
Big Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and RoadmapBig Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and RoadmapSrinath Perera
 
Big Data Evolution
Big Data EvolutionBig Data Evolution
Big Data Evolutionitnewsafrica
 
Big data Presentation
Big data PresentationBig data Presentation
Big data PresentationAswadmehar
 
Tools for Unstructured Data Analytics
Tools for Unstructured Data AnalyticsTools for Unstructured Data Analytics
Tools for Unstructured Data AnalyticsRavi Teja
 
Presentation Big Data
Presentation Big DataPresentation Big Data
Presentation Big DataRené Kuipers
 
Real time analytics of big data
Real time analytics of big dataReal time analytics of big data
Real time analytics of big dataDeependra Jyoti
 
What is big data ? | Big Data Applications
What is big data ? | Big Data ApplicationsWhat is big data ? | Big Data Applications
What is big data ? | Big Data ApplicationsShilpaKrishna6
 
Importance of Data Analytics
 Importance of Data Analytics Importance of Data Analytics
Importance of Data AnalyticsProduct School
 
Big Data Applications | Big Data Analytics Use-Cases | Big Data Tutorial for ...
Big Data Applications | Big Data Analytics Use-Cases | Big Data Tutorial for ...Big Data Applications | Big Data Analytics Use-Cases | Big Data Tutorial for ...
Big Data Applications | Big Data Analytics Use-Cases | Big Data Tutorial for ...Edureka!
 
Big data Seminar/Presentation
Big data Seminar/PresentationBig data Seminar/Presentation
Big data Seminar/PresentationKirtimaan Chhabra
 
Applications of Big Data Analytics in Businesses
Applications of Big Data Analytics in BusinessesApplications of Big Data Analytics in Businesses
Applications of Big Data Analytics in BusinessesT.S. Lim
 

La actualidad más candente (20)

Big data - Key Enablers, Drivers & Challenges
Big data - Key Enablers, Drivers & ChallengesBig data - Key Enablers, Drivers & Challenges
Big data - Key Enablers, Drivers & Challenges
 
Big data analytics, research report
Big data analytics, research reportBig data analytics, research report
Big data analytics, research report
 
Big Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and RoadmapBig Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and Roadmap
 
Big data unit i
Big data unit iBig data unit i
Big data unit i
 
Big Data Evolution
Big Data EvolutionBig Data Evolution
Big Data Evolution
 
Big data Presentation
Big data PresentationBig data Presentation
Big data Presentation
 
Big data
Big dataBig data
Big data
 
Big data
Big dataBig data
Big data
 
Tools for Unstructured Data Analytics
Tools for Unstructured Data AnalyticsTools for Unstructured Data Analytics
Tools for Unstructured Data Analytics
 
Presentation Big Data
Presentation Big DataPresentation Big Data
Presentation Big Data
 
Real time analytics of big data
Real time analytics of big dataReal time analytics of big data
Real time analytics of big data
 
What is big data ? | Big Data Applications
What is big data ? | Big Data ApplicationsWhat is big data ? | Big Data Applications
What is big data ? | Big Data Applications
 
Importance of Data Analytics
 Importance of Data Analytics Importance of Data Analytics
Importance of Data Analytics
 
NewMR 2016 presents: 9 Big Applications of Big Data
NewMR 2016 presents: 9 Big Applications of Big DataNewMR 2016 presents: 9 Big Applications of Big Data
NewMR 2016 presents: 9 Big Applications of Big Data
 
Big Data Applications | Big Data Analytics Use-Cases | Big Data Tutorial for ...
Big Data Applications | Big Data Analytics Use-Cases | Big Data Tutorial for ...Big Data Applications | Big Data Analytics Use-Cases | Big Data Tutorial for ...
Big Data Applications | Big Data Analytics Use-Cases | Big Data Tutorial for ...
 
Big data Seminar/Presentation
Big data Seminar/PresentationBig data Seminar/Presentation
Big data Seminar/Presentation
 
Big data ppt
Big data pptBig data ppt
Big data ppt
 
Big Data analytics
Big Data analyticsBig Data analytics
Big Data analytics
 
Big Data Trends
Big Data TrendsBig Data Trends
Big Data Trends
 
Applications of Big Data Analytics in Businesses
Applications of Big Data Analytics in BusinessesApplications of Big Data Analytics in Businesses
Applications of Big Data Analytics in Businesses
 

Similar a Data sciences and marketing analytics

Data analytics introduction
Data analytics introductionData analytics introduction
Data analytics introductionamiyadash
 
SuanIct-Bigdata desktop-final
SuanIct-Bigdata desktop-finalSuanIct-Bigdata desktop-final
SuanIct-Bigdata desktop-finalstelligence
 
MBA-TU-Thailand:BigData for business startup.
MBA-TU-Thailand:BigData for business startup.MBA-TU-Thailand:BigData for business startup.
MBA-TU-Thailand:BigData for business startup.stelligence
 
Unit 1 (DSBDA) PD.pptx
Unit 1 (DSBDA)  PD.pptxUnit 1 (DSBDA)  PD.pptx
Unit 1 (DSBDA) PD.pptxSamiksha880257
 
Big Data Analytics.pdfbgfjgjgghfhhffhdfyf
Big Data Analytics.pdfbgfjgjgghfhhffhdfyfBig Data Analytics.pdfbgfjgjgghfhhffhdfyf
Big Data Analytics.pdfbgfjgjgghfhhffhdfyfVijayKaran7
 
big-datagroup6-150317090053-conversion-gate01.pdf
big-datagroup6-150317090053-conversion-gate01.pdfbig-datagroup6-150317090053-conversion-gate01.pdf
big-datagroup6-150317090053-conversion-gate01.pdfVirajSaud
 
bigdataintro.pptx
bigdataintro.pptxbigdataintro.pptx
bigdataintro.pptxAlbert Alex
 
Big-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-KoenigBig-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-KoenigManish Chopra
 
Bigdata and Hadoop with applications
Bigdata and Hadoop with applicationsBigdata and Hadoop with applications
Bigdata and Hadoop with applicationsPadma Metta
 
Big Data and Data Science: The Technologies Shaping Our Lives
Big Data and Data Science: The Technologies Shaping Our LivesBig Data and Data Science: The Technologies Shaping Our Lives
Big Data and Data Science: The Technologies Shaping Our LivesRukshan Batuwita
 
Big data 2017 final
Big data 2017   finalBig data 2017   final
Big data 2017 finalAmjid Ali
 
Lecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdfLecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdfahmedibrahimghnnam01
 
Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven RamageGeospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven RamageSteven Ramage
 

Similar a Data sciences and marketing analytics (20)

SKILLWISE-BIGDATA ANALYSIS
SKILLWISE-BIGDATA ANALYSISSKILLWISE-BIGDATA ANALYSIS
SKILLWISE-BIGDATA ANALYSIS
 
Data analytics introduction
Data analytics introductionData analytics introduction
Data analytics introduction
 
SuanIct-Bigdata desktop-final
SuanIct-Bigdata desktop-finalSuanIct-Bigdata desktop-final
SuanIct-Bigdata desktop-final
 
MBA-TU-Thailand:BigData for business startup.
MBA-TU-Thailand:BigData for business startup.MBA-TU-Thailand:BigData for business startup.
MBA-TU-Thailand:BigData for business startup.
 
Unit 1 (DSBDA) PD.pptx
Unit 1 (DSBDA)  PD.pptxUnit 1 (DSBDA)  PD.pptx
Unit 1 (DSBDA) PD.pptx
 
bigdatappt.pptx
bigdatappt.pptxbigdatappt.pptx
bigdatappt.pptx
 
Big Data Analytics.pdfbgfjgjgghfhhffhdfyf
Big Data Analytics.pdfbgfjgjgghfhhffhdfyfBig Data Analytics.pdfbgfjgjgghfhhffhdfyf
Big Data Analytics.pdfbgfjgjgghfhhffhdfyf
 
Intro big data analytics
Intro big data analyticsIntro big data analytics
Intro big data analytics
 
big-datagroup6-150317090053-conversion-gate01.pdf
big-datagroup6-150317090053-conversion-gate01.pdfbig-datagroup6-150317090053-conversion-gate01.pdf
big-datagroup6-150317090053-conversion-gate01.pdf
 
Big data
Big dataBig data
Big data
 
bigdataintro.pptx
bigdataintro.pptxbigdataintro.pptx
bigdataintro.pptx
 
Big-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-KoenigBig-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-Koenig
 
Bigdata and Hadoop with applications
Bigdata and Hadoop with applicationsBigdata and Hadoop with applications
Bigdata and Hadoop with applications
 
Big Data and Data Science: The Technologies Shaping Our Lives
Big Data and Data Science: The Technologies Shaping Our LivesBig Data and Data Science: The Technologies Shaping Our Lives
Big Data and Data Science: The Technologies Shaping Our Lives
 
Big data
Big dataBig data
Big data
 
Big data 2017 final
Big data 2017   finalBig data 2017   final
Big data 2017 final
 
Lecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdfLecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdf
 
Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven RamageGeospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
 
Big data
Big dataBig data
Big data
 
Big data
Big dataBig data
Big data
 

Último

INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman
 
How we prevented account sharing with MFA
How we prevented account sharing with MFAHow we prevented account sharing with MFA
How we prevented account sharing with MFAAndrei Kaleshka
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsVICTOR MAESTRE RAMIREZ
 
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdfKantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdfSocial Samosa
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptxthyngster
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanMYRABACSAFRA2
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改yuu sss
 
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort servicejennyeacort
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Sapana Sha
 
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档208367051
 
Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 217djon017
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdfHuman37
 
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default  Presentation : Data Analysis Project PPTPredictive Analysis for Loan Default  Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPTBoston Institute of Analytics
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...dajasot375
 
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)jennyeacort
 
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceCall Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceSapana Sha
 
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...Boston Institute of Analytics
 
RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.natarajan8993
 

Último (20)

INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
 
How we prevented account sharing with MFA
How we prevented account sharing with MFAHow we prevented account sharing with MFA
How we prevented account sharing with MFA
 
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business Professionals
 
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdfKantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population Mean
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
 
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
 
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
 
Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf
 
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default  Presentation : Data Analysis Project PPTPredictive Analysis for Loan Default  Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
 
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
 
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceCall Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts Service
 
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
 
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
 
RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.
 

Data sciences and marketing analytics

  • 1. Evolution of Data Sciences and Marketing Analytics Prof. M J Xavier Email: xavier.mj@gmail.com
  • 2. Historic Development of Business Analytics • When did Analytics Begin? • With the invention of wheel – 3500 BC • To calculate the circumference to fit a rim – π • Number system and astronomy • Kings used numbers for collecting and accounting taxes • Probability theory got developed for games (6th century BC) • Statistical methods were developed in 5th Century BC. • In 1660s statistics was used for census and demographic studies • Bayes theorem was invented in 1761 • In 1747 design of experiments was used to find a cure for scurvy • Design of experiments were extensively used in Agriculture
  • 3. Other Developments • Operations Research started in 1930s to solve problems of military operations. • After Word war – II these experts started solving business problems. • Critical Path Method – Project Management • Shortest route problems - Transportation • Warehouse location • Replacement Problems • Inventory Management • Simplex algorithm for LP was developed in 1947
  • 4. My Encounter With Analytics • Operations Research in Chemical Engineering at REC Warangal • LP for Petroleum products • Dynamic programming for Chemical plant design • Doctorate in IIM Calcutta • ITC problem • My PhD Work • Experience at MODE – Data Analysis • TNS and GFK • iCRM Projects • Shopper’s Stop • Online Travel company • Recent Works • Model for Credit worthiness • Emotion Analysis for customer satisfaction
  • 5. DS 0.0 – User of Numbers • Numbers for bookkeeping and to measure performance • Sales • Finance
  • 6. DS 1.0 – Operations Research • Operation Research Models for Optimal Decisions • Critical Path Method – Project Management • Shortest Route problems - Transportation • Warehouse location • Replacement Problems • Inventory Management
  • 7. DS 1.1- Statistical Tools • Data Analysis • Use of statistical tools • Factor Analysis • Conjoint Analysis • Multidimensional Scaling • Correspondence Analysis VST Study
  • 8. DS 2.0 – Electronic Data Processing • Use of Computers for storing and retrieving data • EDP department (SPIC sales in regions)
  • 9. DS 2.1 – MIS • MIS and DSS • Metrics • Dashboards • Knowledge Management
  • 10. DS 3.0 – Business Intelligence • Business Intelligence • Data Warehousing • OLTP and OLAP • Data Marts
  • 11. Metadata Data Sources Data Management Access Complete Warehouse Solution Architecture Operational Data Legacy Data The Post VISA External Data Sources Enterprise Data Warehouse Organisationally structured Extract Transform Maintain Data Information Knowledge Asset Assembly (and Management) Asset Exploitation Data Mart Data Mart Departmentally structured Data Mart
  • 12. Data Mart and Metadata • Data marts are subsets of a data warehouse, which are designed to meet the unique needs of specific functional or operating groups. • Metadata is data about data. The metadata for a specific database may be likened to a book’s table of content; it identifies what is stored where within the database.
  • 13. What is Online Analytic Processing (OLAP)? •“OLAP enables an end user to rapidly analyze a data warehouse from any perspective in an ad-hoc environment” Regional Analysis BOMBAY DELHI January February Cosmetics Perfumes Clothing Accessories Cosmetics Perfumes Clothing Accessories
  • 14. The Questions OLAP Answers • Comparisons • Revenue increase this quarter compared to same period last year • Marketshare • Show Brand A sales as a percentage of total sales • Top and bottom N, top and bottom N% • Show top 10 products based on last week’s sales in the Eastern region
  • 15. DS 3.1 – Data Analytics • Data Analytics • Patterns and Trends in the Data - Tesco • Clustering and Classification
  • 16. What Is Data Analytics “Simply put, data analytics is used to discover patterns and relationships in the data in order to help managers make better business decisions and exploit new opportunities.”
  • 17. Analysis procedures • Association: looking for patterns where one event is connected to another event • Sequence or path analysis: looking for patterns where one event leads to a later event • Classification: looking for new patterns • Clustering: finding and visually documenting groups of facts not previously known • Scoring models: developing propensity scores for individual customers • Forecasting/Predictions: discovering patterns in data that can lead to reasonable predictions about the future
  • 18. Fraud and Crime Detection • Look for Outliers – Stock Market • Map the network of criminals
  • 19. Jialun Qin, Jennifer J. Xu, Daning Hu, Marc Sageman and Hsinchun Chen, “Analyzing Terrorist Networks: A Case Study of the Global Salafi Jihad Network” Lecture Notes in Computer Science, Publisher: Springer-Verlag GmbH, Volume 3495 / 2005 , p. 287.
  • 20. DS 3.2 – Web Analytics • Google Analytics (IFMR) • Semrush • Kissmetrics • Heatmaps • New metrics • Look to Book • Abandonment rate • Click Through Rate
  • 21. DS 4.0 – Big Data
  • 24. Conversation Data • Our conversations are now digitally recorded. It all started with emails but nowadays most of our conversations leave a digital trail. Just think of all the conversations we have on social media sites like Facebook or Twitter. Even many of our phone conversations are now digitally recorded.
  • 25. Photo and Video Image Data • Just think about all the pictures we take on our smart phones or digital cameras. We upload and share 100s of thousands of them on social media sites every second. The increasing amounts of CCTV cameras take video images and we up-load hundreds of hours of video images to YouTube and other sites every minute .
  • 26. Sensor Data • We are increasingly surrounded by sensors that collect and share data. Take your smart phone, it contains a global positioning sensor to track exactly where you are every second of the day, it includes an accelometer to track the speed and direction at which you are travelling. We now have sensors in many devices and products.
  • 27. IoT Data • We now have smart TVs that are able to collect and process data, we have smart watches, smart fridges, and smart alarms. The Internet of Things, or Internet of Everything connects these devices so that e.g. the traffic sensors on the road send data to your alarm clock which will wake you up earlier than planned because the blocked road means you have to leave earlier to make your 9am meeting… Telematics for Cars and Trucks
  • 28. Characteristics of Big Data • With the datafication comes big data, which is often described using the four Vs: • Volume • Velocity • Variety • Veracity
  • 29. Volume • …refers to the vast amounts of data generated every second. We are not talking Terabytes but Zettabytes or Brontobytes. If we take all the data generated in the world between the beginning of time and 2000, the same amount of data will soon be generated every minute. New big data tools use distributed systems so that we can store and analyse data across databases that are dotted around anywhere in the world.
  • 30. Velocity • …refers to the speed at which new data is generated and the speed at which data moves around. Just think of social media messages going viral in seconds. Technology allows us now to analyse the data while it is being generated (sometimes referred to as inmemory analytics), without ever putting it into databases.
  • 31. Variety • …refers to the different types of data we can now use. In the past we only focused on structured data that neatly fitted into tables or relational databases, such as financial data. In fact, 80% of the world’s data is unstructured (text, images, video, voice, etc.) With big data technology we can now analyse and bring together data of different types such as messages, social media conversations, photos, sensor data, video or voice recordings.
  • 32. Veracity • …refers to the messiness or trustworthiness of the data. With many forms of big data quality and accuracy are less controllable (just think of Twitter posts with hash tags, abbreviations, typos and colloquial speech as well as the reliability and accuracy of content) but technology now allows us to work with this type of data.
  • 34. Turning Big Data Into Value
  • 36. Better understand and target customers • To better understand and target customers, companies expand their traditional data sets with social media data, browser, text analytics or sensor data to get a more complete picture of their customers. The big objective, in many cases, is to create predictive models. Using big data, Telecom companies can now better predict customer churn; retailers can predict what products will sell, and car insurance companies understand how well their customers actually drive.
  • 37. Understand and Optimize Business Processes • Big data is also increasingly used to optimize business processes. Retailers are able to optimize their stock based on predictive models generated from social media data, web search trends and weather forecasts. Another example is supply chain or delivery route optimization using data from geographic positioning and radio frequency identification sensors.
  • 38. Improving Health • The computing power of big data analytics enables us to find new cures and better understand and predict disease patterns. We can use all the data from smart watches and wearable devices to better understand links between lifestyles and diseases. Big data analytics also allow us to monitor and predict epidemics and disease outbreaks, simply by listening to what people are saying, i.e. “Feeling rubbish today - in bed with a cold” or searching for on the Internet, i.e. “cures for flu”.
  • 39. Security Services • Security services use big data analytics to foil terrorist plots and detect cyber attacks. Police forces use big data tools to catch criminals and even predict criminal activity and credit card companies use big data analytics it to detect fraudulent transactions.
  • 40. Improving Sports Performance • Most elite sports have now embraced big data analytics. Many use video analytics to track the performance of every player in a football or baseball game, sensor technology is built into sports equipment such as basket balls or golf clubs, and many elite sports teams track athletes outside of the sporting environment – using smart technology to track nutrition and sleep, as well as social media conversations to monitor emotional wellbeing.
  • 41. Improving and Optimizing Cities and Countries • Big data is used to improve many aspects of our cities and countries. For example, it allows cities to optimize traffic flows based on real time traffic information as well as social media and weather data. A number of cities are currently using big data analytics with the aim of turning themselves into Smart Cities, where the transport infrastructure and utility processes are all joined up. Where a bus would wait for a delayed train and where traffic signals predict traffic volumes and operate to minimize jams.
  • 42.
  • 43. Business Intelligence Vs Business Analytics
  • 44. 4 Types of Data Analytics
  • 45. Data Analysis Vs Data Analytics
  • 46.
  • 47. DS 4.1 AI, ML & Deep Learning
  • 48. Human Brain and Natural Intelligence Human brain is a graph of 100 Billion nodes and 700 Trillion Edges
  • 50. AI Assistants Microsoft Azure Apple Amazon Web Services
  • 51.
  • 52. Components of AI Natural Language processing (Understands Human Language) Big Data (Large data base of past experiences) Learning algorithm (Learns to respond to Queries)
  • 53.
  • 54. Machine learning is a field of computer science that gives computers the ability to learn without being explicitly programmed Methods that can learn from and make predictions on data Labeled Data Labeled Data Machine Learning algorithm Learned model Prediction Training Prediction Machine Learning Basics
  • 55. Regression Supervised: Learning with a labeled training set Example: email classification with already labeled emails Unsupervised: Discover patterns in unlabeled data Example: cluster similar documents based on text Reinforcement learning: learn to act based on feedback/reward Example: learns better to classify based on reward Types of Learning class A class A Classification Clustering http://mbjoseph.github.io/2013/11/27/measure.html
  • 56.
  • 57.
  • 58. A machine learning subfield of learning representations of data. Exceptional effective at learning patterns. Deep learning algorithms attempt to learn (multiple levels of) representation by using a hierarchy of multiple layers If you provide the system tons of information, it begins to understand it and respond in useful ways. What is Deep Learning (DL) ? https://www.xenonstack.com/blog/static/public/uploads/media/machine-learning-vs-deep-learning.png
  • 59. So, 1. what exactly is deep learning ? And, 2. why is it generally better than other methods on image, speech and certain other types of data? The short answers 1. ‘Deep Learning’ means using a neural network with several layers of nodes between input and output 2. the series of layers between input & output do feature identification and processing in a series of stages, just as our brains seem to.
  • 60. hmmm… OK, but: 3. multilayer neural networks have been around for 25 years. What’s actually new? we have always had good algorithms for learning the weights in networks with 1 hidden layer but these algorithms are not good at learning the weights for networks with more hidden layers what’s new is: algorithms for training many-later networks
  • 61.
  • 62.
  • 63.
  • 64.
  • 65. Tools for Deep Learning • Matlab • R • Amazon Rekognition • IBM Watson • Python • Azure
  • 66.
  • 69. Robots in Education Image Courtesy: Indus International School, Bangalore
  • 70. More AI Applications • Attendance Taking • Class participation Marking • Proctoring of online Exams • Paper correction • Chatbots for doubt clearing • Robot teachers • Precision teaching • Authoring books and academic articles
  • 71. Precision Learning • Just like precision medicine and precision agriculture, learning will become personalized and customized. • Future will belong to those who develop platforms for customized, personalized and individualized course offerings using Artificial Intelligence. • Metacog is an App for IIT JEE coaching on Google Playstore that serves lessons based on prior knowledge of the student’s aptitude for different subjects and speed of learning. • A time will come, for example, MBA program itself will run on artificial intelligence platform that would customize the content based on the ability and the aptitude of the learner.
  • 74. Where are we headed? 0 Write a case study on “AI application in marketing” 0 Give sources from which you collected the information (Min 10 references) 0 This is a group assignment that should be submitted before 18th october.
  • 75. This Photo by Unknown Author is licensed under CC BY-NC