SlideShare una empresa de Scribd logo
1 de 27
Descargar para leer sin conexión
Health information professionals
and Artificial Intelligence
Andrew Cox, Senior Lecturer, Information School, Sheffield
a.m.cox@sheffield.ac.uk
The impact of AI, machine learning, automation and robotics on the information professions: A report for CILIP
https://www.cilip.org.uk/general/custom.asp?page=researchreport
Health Libraries Group – Virtual conference - 24th November 2021
The Information School
University of Sheffield, UK
Artificial Intelligence
Part 1: Defining AI
Definition 1: Everyday functionality increasing
productivity of knowledge workers
• Auto-correct
• Auto-suggest
• Grammar check
• Transcription/ captioning of
meetings
• Translation tools
• Automatic writing
• Many features of search and
recommendation
• Increased productivity
• Increased access to knowledge
• Does it do so evenly, eg which
languages are served best?
• Continued need for critical
information literacy
Definition 2: A cluster of new technologies
• Machine learning
• Natural language processing
• Sentiment analysis
• Voice recognition
• Image recognition
• Applications: new forms of search and
recommendation, collections as data
• Eg Searching medical images or text
mining the literature
• Chatbots, voice assistants
Its not magic
• Data description and fragmentation
• Training data effort
• Data bias
• Data validity
• Data ethics
• The hype around technological
solutionism always downplays
women’s work, emotional labour,
service (Mirza and Seale, 2017)
https://exploreai.jisc.ac.uk/
Definition 3: A global industrial complex
• How much energy does it use?
• How much raw material does it
use?
• How much unpaid labour/ data
are we contributing?
• How much does it rely on
clickworkers?
• Who profits? How does it link to
global inequalities?
• Is it sustainable?
(Crawford and Joler, 2018; Crawford, 2020)
Definition 4: An evolving idea… a social
imaginary
• Utopias and dystopias of science fiction
• Evolves as our idea of technology and intelligence evolve
• Intelligence as answering a quiz
• Intelligence as social, creative, emergent, open
Definition 5: AI for information professionals
Use in our own daily work
• Using AI tools in your own work, eg book ordering,
summarising texts… etc
• Robotic process automation of backend processes
Using AI in our own services to users
• Supporting use of AI built into third party search
tools
• Applying machine learning to organisational datasets
• Text mining the literature
• Developing a chatbot or voice assistant for
information service users
Supporting a community of data scientist users
• Locating/ licensing external data sets for analysis
• Developing training data for machine learning
• Creating a community of data scientists
• Data governance and stewardship
Supporting wider use in the organisation
• Input to your organization’s adoption of AI, eg in
procurement, training etc
• Promoting data and AI literacy
Using it to monitor/ predict/influence user behaviour
• Applying sentiment analysis to social media
responses to information services
What types of uses can you
imagine?
Post your answers in padlet: https://padlet.com/a_m_cox/jduwltdylkl7vi54
Understanding or managing users
• Libraries are rich in data about users
• Turnstile data
• Circulation data
• Usage of digital resources
• Satisfaction surveys
• Reference enquiries
• Qualitative data, eg UX studies
• AI to analyse social media data or open text survey data
• AI to nudge users?
Learning analytics debate
• Lack consent or student awareness of how their data
is being used
• Lack ethics review
• Libraries few responsible use statements
• Benefits unclear or for institution not learner
• Privacy issues
• Chilling effect on free speech and expression
Jones et al. (2020)
• Issue of validity: “learning data” not equal to learning
• Evidence that data analysis flawed (Robertshaw and
Asher, 2019)
Ethical AI
Ethics and values – do our profession’s
translate?
• Study found 84 statements about
ethics (international organisation,
governments, tech companies etc)
(Jobin et al., 2019)
• Bias
• Transparency and accountability
• Privacy / surveillance – chilling
effects
• Security and safety
• Human agency - nudging
• Voice assistants cannot understand
people with non-standard accents
• “Female” naming of chatbot
reinforces stereotypes
• Deepfakes create false news
• Automated moderation on social
media blocks legitimate free
expression
• Fear of surveillance inhibits
searching/ reading certain material
• My data being used without my
consent
Which of these barriers to using AI do you
think is the greatest?
1. Privacy concerns
2. Concerns about bias and lack of transparency
3. Security risks
4. GDPR compliance
5. Legal uncertainty
6. Issues of data quality in general
7. Over promising/ hype
8. Lack of information professional skills
9. Other people’s dated assumptions about what information professionals can do
10. IT owns the agenda
11. User fear of technology/ need for culture change
12. Other priorities
Part 2: AI and information
professional jobs
AI’s impact on jobs
• Replaced
• Dominated
• Divided
• Complemented
• Augmented
• Rehumanized
(GPAI, 2020)
Differences by sector
• Some scholars predict the
replacement of professionals
(Susskind and Susskind, 2015)…
others emphasise the
vulnerability of “routine” jobs
(Frey and Osborne, 2017)…
Skills and knowledge – updating for data and AI
• Information Management skills – apply to data – information governance,
standards, metadata, preservation
• Sourcing external data is a content challenge
• Collection management, including metadata, standards, IPR etc – data not print
collections
• Importance of data provenance for validity
• Procuring data and systems – different types of system
• Searching for data – new landscapes of search
• Teaching data & AI literacy – new dimensions of literacy, implies stronger
understanding of data analysis
• Knowledge of users’ need – assembling data from wide range of sources
• “Computational sense” (Twidale and Nichols, 2008)
Attitudes
• Service focus / balanced with sense of institutional agendas
• Collaborative skills / Influencing skills
• Commitment to professional development and learning
• Professional knowledge sharing
WEF (2020) – 10 skills to thrive in the 4th
Industrial revolution
1. Complex Problem Solving
2. Critical Thinking
3. Creativity
4. People Management
5. Coordinating with Others
6. Emotional Intelligence
7. Judgement and Decision Making
8. Service Orientation
9. Negotiation
10. Cognitive Flexibility
Addressing our weaknesses
• Other professions who talk more about data:
• I do not think we need to become data scientists (who combine stats/
computing/ subject knowledge)
• But other groups such as BCS, DAMA also talk about data management
• Literate profession – shift towards quanti data (according to
McKinseys)
• Lack of recognition for IM/KM
• When we see tech as outside force – IT control the agenda
• Not so good at collaborating across sectors
• Our diversity
Values
Example: CILIP’s ethical statement
1. Human rights, equalities and diversity, and the
equitable treatment of users and colleagues
2. The public benefit and the advancement of the
wider good of our profession to society
3. Preservation and continuity of access to knowledge
4. Intellectual freedom, including freedom from
censorship
5. Impartiality and the avoidance of inappropriate bias
6. The confidentiality of information provided by
clients or users and the right of all individuals to
privacy
7. The development of information skills and
information literacy
Offers a distinctive perspective on AI ethics
• Understanding of how inequality
reproduced?
• Relevance of sustainability, eg need
for green AI
• Consideration of global South
perspectives, eg issues around
language and operating in low
resource environments
• The ultimate drivers for
datafication lie beyond our control
A guide to good practice for digital and data-
driven health technologies (2021)
• Review the Data Ethics Framework and abide by the principles
• Ensure that the product is designed to achieve a clear outcome for users or the system *
• Ensure that the product is easy to use and accessible to all users *
• Ensure that the product is appropriately tested and is fit for purpose
• Ensure that the product is clinically safe to use
• Demonstrate that the product collects, stores and processes users’ information in a safe, fair and lawful way
• Be fair, transparent and accountable about what data is being used
• Be transparent about the limitations of the data used *
• Make security integral to the design and ensure that the product meets industry best practice security standards
• Ensure that the product meets all relevant regulatory requirements
• Ensure that the product makes the best possible use of open standards to ensure data quality and
interoperability
• Generate evidence that the product achieves clinical, social, economic or behavioural benefits
• Define the commercial strategy
A vision
The paradigm of the intelligent library
From searching to find a text to read
To interacting with the full text of the library collection
OR The living systematic review
Cox, Pinfield and Rutter (2019)
What would your vision of a
library powered by AI be?
Post your answers in the chat!
The impact of AI, machine learning, automation and robotics on the
information professions: A report for CILIP
https://www.cilip.org.uk/general/custom.asp?page=researchreport
Your questions and comments
are welcome!
References
• Cox A (2021) The impact of AI, machine learning, automation and robotics on the information professions: A report for CILIP
https://www.cilip.org.uk/general/custom.asp?page=researchreport
• Cox, A. M., Pinfield, S., & Rutter, S. (2019). The intelligent library: Thought leaders’ views on the likely impact of artificial intelligence on academic libraries.
Library Hi Tech. 37 (3) 418-435.
• Crawford, K. (2021) Atlas of AI. Yale University Press.
• Department of Health and Social Care. (2021) https://www.gov.uk/government/publications/code-of-conduct-for-data-driven-health-and-care-
technology/initial-code-of-conduct-for-data-driven-health-and-care-technology
• Glanville, J. (2020). Text mining for information specialists. In Craven and Leavey Systematic searchin:Practical ideas for improving results. Facet.
• Global Partnership on Artificial Intelligence (2020). Working group on the future of work, https://gpai.ai/projects/future-of-work/
• IFLA (2020) IFLA statement on libraries and artificial intelligence https://www.ifla.org/wp-
content/uploads/2019/05/assets/faife/ifla_statement_on_libraries_and_artificial_intelligence.pdf
• Jones, K. M., Briney, K. A., Goben, A., Salo, D., Asher, A., & Perry, M. R. (2020). A comprehensive primer to library learning analytics practices, initiatives,
and privacy issues. Jones, KML, Briney, KA, Goben, A., Salo, D., Asher, A., & Perry, MR, a Comprehensive Primer to Library Learning Analytics Practices,
Initiatives, and Privacy Issues. College & Research Libraries, 81(3), 570-591.
• McKinsey Global Institute. (2018). Skill Shift: Automation and the Future of the Workforce (Discussion Paper, May 2018). In McKinsey &Company (Issue
May). https://www.mckinsey.com/~/media/McKinsey/Featured Insights/Future of Organizations/Skill shift Automation and the future of the
workforce/MGI-Skill-Shift-Automation-and-future-of-the-workforce-May-2018.ashx
• Robertshaw, M. B., & Asher, A. (2019). Unethical numbers? A meta-analysis of library learning analytics studies. Library Trends, 68(1), 76-
101.
• Twidale, M. B., & Nichols, D. M. (2006). Computational sense: The role of technology in the education of digital librarians.
https://researchcommons.waikato.ac.nz/handle/10289/40
• World Economic Forum (WEF) (2020). The ten skills you need to thrive in the 4th Industrial revolution https://www.weforum.org/agenda/2016/01/the-
10-skills-you-need-to-thrive-in-the-fourth-industrial-revolution/

Más contenido relacionado

La actualidad más candente

UKSG 2018 Breakout - TERMS redefined: developing the combination of electroni...
UKSG 2018 Breakout - TERMS redefined: developing the combination of electroni...UKSG 2018 Breakout - TERMS redefined: developing the combination of electroni...
UKSG 2018 Breakout - TERMS redefined: developing the combination of electroni...UKSG: connecting the knowledge community
 
UKSG Conference 2017 Breakout - Providing accessible content – initiatives in...
UKSG Conference 2017 Breakout - Providing accessible content – initiatives in...UKSG Conference 2017 Breakout - Providing accessible content – initiatives in...
UKSG Conference 2017 Breakout - Providing accessible content – initiatives in...UKSG: connecting the knowledge community
 
The digital transformation of research support - Northern Collaboration 2017 ...
The digital transformation of research support - Northern Collaboration 2017 ...The digital transformation of research support - Northern Collaboration 2017 ...
The digital transformation of research support - Northern Collaboration 2017 ...northerncollaboration
 
Information Points
Information PointsInformation Points
Information PointsJames Clay
 
Intelligent Campus update April 2018
Intelligent Campus update April 2018Intelligent Campus update April 2018
Intelligent Campus update April 2018James Clay
 
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...UKSG: connecting the knowledge community
 
Trust and identity in the Géant project - Networkshop44
Trust and identity in the Géant project - Networkshop44Trust and identity in the Géant project - Networkshop44
Trust and identity in the Géant project - Networkshop44Jisc
 
UK data management environment and support
UK data management environment and supportUK data management environment and support
UK data management environment and supportJisc
 
Repository and preservation systems
Repository and preservation systemsRepository and preservation systems
Repository and preservation systemsJisc
 
UKSG Conference 2017 Breakout - Librarians as digital leaders: developing dig...
UKSG Conference 2017 Breakout - Librarians as digital leaders: developing dig...UKSG Conference 2017 Breakout - Librarians as digital leaders: developing dig...
UKSG Conference 2017 Breakout - Librarians as digital leaders: developing dig...UKSG: connecting the knowledge community
 
Good practice in learning analytics - Jisc Digital Festival 2015
Good practice in learning analytics - Jisc Digital Festival 2015Good practice in learning analytics - Jisc Digital Festival 2015
Good practice in learning analytics - Jisc Digital Festival 2015Jisc
 
APAN50 - Removing barriers to knowledge
APAN50 - Removing barriers to knowledgeAPAN50 - Removing barriers to knowledge
APAN50 - Removing barriers to knowledgeOpenAthens
 
Data Management Support at Leiden University
Data Management Support at Leiden UniversityData Management Support at Leiden University
Data Management Support at Leiden UniversityLIBER Europe
 
Making the most of digital resources - Penny Robertson, Neil Stapleton and Cl...
Making the most of digital resources - Penny Robertson, Neil Stapleton and Cl...Making the most of digital resources - Penny Robertson, Neil Stapleton and Cl...
Making the most of digital resources - Penny Robertson, Neil Stapleton and Cl...Jisc
 
Bridging ontario public libraries fopl bo d meeting nov. 23
Bridging ontario public libraries fopl bo d meeting nov. 23 Bridging ontario public libraries fopl bo d meeting nov. 23
Bridging ontario public libraries fopl bo d meeting nov. 23 Stephen Abram
 
Bentley evolving access needs 130715 jibs(2)
Bentley  evolving access needs 130715 jibs(2)Bentley  evolving access needs 130715 jibs(2)
Bentley evolving access needs 130715 jibs(2)sherif user group
 

La actualidad más candente (20)

UKSG 2018 Breakout - TERMS redefined: developing the combination of electroni...
UKSG 2018 Breakout - TERMS redefined: developing the combination of electroni...UKSG 2018 Breakout - TERMS redefined: developing the combination of electroni...
UKSG 2018 Breakout - TERMS redefined: developing the combination of electroni...
 
UKSG 2018 Breakout - Advocating for corporate libraries - Poole
UKSG 2018 Breakout - Advocating for corporate libraries - PooleUKSG 2018 Breakout - Advocating for corporate libraries - Poole
UKSG 2018 Breakout - Advocating for corporate libraries - Poole
 
August 12 NISO Webinar: MOOCs and Libraries: A Brewing Collaboration.
August 12 NISO Webinar: MOOCs and Libraries: A Brewing Collaboration.August 12 NISO Webinar: MOOCs and Libraries: A Brewing Collaboration.
August 12 NISO Webinar: MOOCs and Libraries: A Brewing Collaboration.
 
UKSG Conference 2017 Breakout - Providing accessible content – initiatives in...
UKSG Conference 2017 Breakout - Providing accessible content – initiatives in...UKSG Conference 2017 Breakout - Providing accessible content – initiatives in...
UKSG Conference 2017 Breakout - Providing accessible content – initiatives in...
 
The digital transformation of research support - Northern Collaboration 2017 ...
The digital transformation of research support - Northern Collaboration 2017 ...The digital transformation of research support - Northern Collaboration 2017 ...
The digital transformation of research support - Northern Collaboration 2017 ...
 
Information Points
Information PointsInformation Points
Information Points
 
Intelligent Campus update April 2018
Intelligent Campus update April 2018Intelligent Campus update April 2018
Intelligent Campus update April 2018
 
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...
 
Trust and identity in the Géant project - Networkshop44
Trust and identity in the Géant project - Networkshop44Trust and identity in the Géant project - Networkshop44
Trust and identity in the Géant project - Networkshop44
 
UK data management environment and support
UK data management environment and supportUK data management environment and support
UK data management environment and support
 
Repository and preservation systems
Repository and preservation systemsRepository and preservation systems
Repository and preservation systems
 
Basic database search training for NHS library assistants - Barnard & Pawley
Basic database search training for NHS library assistants - Barnard & Pawley Basic database search training for NHS library assistants - Barnard & Pawley
Basic database search training for NHS library assistants - Barnard & Pawley
 
UKSG Conference 2017 Breakout - Librarians as digital leaders: developing dig...
UKSG Conference 2017 Breakout - Librarians as digital leaders: developing dig...UKSG Conference 2017 Breakout - Librarians as digital leaders: developing dig...
UKSG Conference 2017 Breakout - Librarians as digital leaders: developing dig...
 
Good practice in learning analytics - Jisc Digital Festival 2015
Good practice in learning analytics - Jisc Digital Festival 2015Good practice in learning analytics - Jisc Digital Festival 2015
Good practice in learning analytics - Jisc Digital Festival 2015
 
APAN50 - Removing barriers to knowledge
APAN50 - Removing barriers to knowledgeAPAN50 - Removing barriers to knowledge
APAN50 - Removing barriers to knowledge
 
Data Management Support at Leiden University
Data Management Support at Leiden UniversityData Management Support at Leiden University
Data Management Support at Leiden University
 
Nance "Demystifying Resource Sharing"
Nance "Demystifying Resource Sharing"Nance "Demystifying Resource Sharing"
Nance "Demystifying Resource Sharing"
 
Making the most of digital resources - Penny Robertson, Neil Stapleton and Cl...
Making the most of digital resources - Penny Robertson, Neil Stapleton and Cl...Making the most of digital resources - Penny Robertson, Neil Stapleton and Cl...
Making the most of digital resources - Penny Robertson, Neil Stapleton and Cl...
 
Bridging ontario public libraries fopl bo d meeting nov. 23
Bridging ontario public libraries fopl bo d meeting nov. 23 Bridging ontario public libraries fopl bo d meeting nov. 23
Bridging ontario public libraries fopl bo d meeting nov. 23
 
Bentley evolving access needs 130715 jibs(2)
Bentley  evolving access needs 130715 jibs(2)Bentley  evolving access needs 130715 jibs(2)
Bentley evolving access needs 130715 jibs(2)
 

Similar a Health information professionals and Artificial Intelligence

ASA conference Feb 2013
ASA conference Feb 2013ASA conference Feb 2013
ASA conference Feb 2013mrkwr
 
Data science and ethics in fundraising
Data science and ethics in fundraisingData science and ethics in fundraising
Data science and ethics in fundraisingJames Orton
 
The role of libraries and information professionals during the Big Data Era/ ...
The role of libraries and information professionals during the Big Data Era/ ...The role of libraries and information professionals during the Big Data Era/ ...
The role of libraries and information professionals during the Big Data Era/ ...African Open Science Platform
 
How to Enhance Your Career with AI
How to Enhance Your Career with AIHow to Enhance Your Career with AI
How to Enhance Your Career with AIKeita Broadwater
 
Luciano uvi hackfest.28.10.2020
Luciano uvi hackfest.28.10.2020Luciano uvi hackfest.28.10.2020
Luciano uvi hackfest.28.10.2020Joanne Luciano
 
Artificial Intelligence (AI) Tools in Scientific Research .pptx
Artificial Intelligence (AI) Tools in Scientific Research .pptxArtificial Intelligence (AI) Tools in Scientific Research .pptx
Artificial Intelligence (AI) Tools in Scientific Research .pptxTutors India
 
Artificial Intelligence in Library and Educational Settings_Concerns and Oppo...
Artificial Intelligence in Library and Educational Settings_Concerns and Oppo...Artificial Intelligence in Library and Educational Settings_Concerns and Oppo...
Artificial Intelligence in Library and Educational Settings_Concerns and Oppo...Naseej Academy أكاديمية نسيج
 
Ai in Human Welfare and Knowledge Economy
Ai in Human Welfare and Knowledge EconomyAi in Human Welfare and Knowledge Economy
Ai in Human Welfare and Knowledge EconomySubhendu Dey
 
Generative AI - Responsible Path Forward.pdf
Generative AI - Responsible Path Forward.pdfGenerative AI - Responsible Path Forward.pdf
Generative AI - Responsible Path Forward.pdfSaeed Al Dhaheri
 
005. Ethics, Privacy and Security
005. Ethics, Privacy and Security005. Ethics, Privacy and Security
005. Ethics, Privacy and SecurityArianto Muditomo
 
Scaling Training Data for AI Applications
Scaling Training Data for AI ApplicationsScaling Training Data for AI Applications
Scaling Training Data for AI ApplicationsApplause
 
BioPharma and FAIR Data, a Collaborative Advantage
BioPharma and FAIR Data, a Collaborative AdvantageBioPharma and FAIR Data, a Collaborative Advantage
BioPharma and FAIR Data, a Collaborative AdvantageTom Plasterer
 
dissertation proposal writing service
dissertation proposal writing servicedissertation proposal writing service
dissertation proposal writing servicePhd Assistance
 
Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)Thinkful
 
Meeting Federal Research Requirements for Data Management Plans, Public Acces...
Meeting Federal Research Requirements for Data Management Plans, Public Acces...Meeting Federal Research Requirements for Data Management Plans, Public Acces...
Meeting Federal Research Requirements for Data Management Plans, Public Acces...ICPSR
 
Data as a service: a human-centered design approach/Retha de la Harpe
Data as a service: a human-centered design approach/Retha de la HarpeData as a service: a human-centered design approach/Retha de la Harpe
Data as a service: a human-centered design approach/Retha de la HarpeAfrican Open Science Platform
 
Learning Data Analytics
Learning Data AnalyticsLearning Data Analytics
Learning Data AnalyticsLearnbay
 

Similar a Health information professionals and Artificial Intelligence (20)

ASA conference Feb 2013
ASA conference Feb 2013ASA conference Feb 2013
ASA conference Feb 2013
 
Data science and ethics in fundraising
Data science and ethics in fundraisingData science and ethics in fundraising
Data science and ethics in fundraising
 
The role of libraries and information professionals during the Big Data Era/ ...
The role of libraries and information professionals during the Big Data Era/ ...The role of libraries and information professionals during the Big Data Era/ ...
The role of libraries and information professionals during the Big Data Era/ ...
 
How to Enhance Your Career with AI
How to Enhance Your Career with AIHow to Enhance Your Career with AI
How to Enhance Your Career with AI
 
Luciano uvi hackfest.28.10.2020
Luciano uvi hackfest.28.10.2020Luciano uvi hackfest.28.10.2020
Luciano uvi hackfest.28.10.2020
 
Artificial Intelligence (AI) Tools in Scientific Research .pptx
Artificial Intelligence (AI) Tools in Scientific Research .pptxArtificial Intelligence (AI) Tools in Scientific Research .pptx
Artificial Intelligence (AI) Tools in Scientific Research .pptx
 
DATAIA & TransAlgo
DATAIA & TransAlgoDATAIA & TransAlgo
DATAIA & TransAlgo
 
Artificial Intelligence in Library and Educational Settings_Concerns and Oppo...
Artificial Intelligence in Library and Educational Settings_Concerns and Oppo...Artificial Intelligence in Library and Educational Settings_Concerns and Oppo...
Artificial Intelligence in Library and Educational Settings_Concerns and Oppo...
 
Ai in Human Welfare and Knowledge Economy
Ai in Human Welfare and Knowledge EconomyAi in Human Welfare and Knowledge Economy
Ai in Human Welfare and Knowledge Economy
 
Generative AI - Responsible Path Forward.pdf
Generative AI - Responsible Path Forward.pdfGenerative AI - Responsible Path Forward.pdf
Generative AI - Responsible Path Forward.pdf
 
005. Ethics, Privacy and Security
005. Ethics, Privacy and Security005. Ethics, Privacy and Security
005. Ethics, Privacy and Security
 
Scaling Training Data for AI Applications
Scaling Training Data for AI ApplicationsScaling Training Data for AI Applications
Scaling Training Data for AI Applications
 
BioPharma and FAIR Data, a Collaborative Advantage
BioPharma and FAIR Data, a Collaborative AdvantageBioPharma and FAIR Data, a Collaborative Advantage
BioPharma and FAIR Data, a Collaborative Advantage
 
dissertation proposal writing service
dissertation proposal writing servicedissertation proposal writing service
dissertation proposal writing service
 
Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)
 
Meeting Federal Research Requirements for Data Management Plans, Public Acces...
Meeting Federal Research Requirements for Data Management Plans, Public Acces...Meeting Federal Research Requirements for Data Management Plans, Public Acces...
Meeting Federal Research Requirements for Data Management Plans, Public Acces...
 
Data as a service: a human-centered design approach/Retha de la Harpe
Data as a service: a human-centered design approach/Retha de la HarpeData as a service: a human-centered design approach/Retha de la Harpe
Data as a service: a human-centered design approach/Retha de la Harpe
 
Learning Data Analytics
Learning Data AnalyticsLearning Data Analytics
Learning Data Analytics
 
Big Data for Library Services (2017)
Big Data for Library Services (2017)Big Data for Library Services (2017)
Big Data for Library Services (2017)
 
Module 1
Module 1Module 1
Module 1
 

Último

Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...narwatsonia7
 
Noida Sector 135 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few C...
Noida Sector 135 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few C...Noida Sector 135 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few C...
Noida Sector 135 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few C...rajnisinghkjn
 
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...narwatsonia7
 
High Profile Call Girls Mavalli - 7001305949 | 24x7 Service Available Near Me
High Profile Call Girls Mavalli - 7001305949 | 24x7 Service Available Near MeHigh Profile Call Girls Mavalli - 7001305949 | 24x7 Service Available Near Me
High Profile Call Girls Mavalli - 7001305949 | 24x7 Service Available Near Menarwatsonia7
 
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...Nehru place Escorts
 
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...rajnisinghkjn
 
Case Report Peripartum Cardiomyopathy.pptx
Case Report Peripartum Cardiomyopathy.pptxCase Report Peripartum Cardiomyopathy.pptx
Case Report Peripartum Cardiomyopathy.pptxNiranjan Chavan
 
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbai
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service MumbaiVIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbai
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbaisonalikaur4
 
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...narwatsonia7
 
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...narwatsonia7
 
call girls in paharganj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in paharganj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in paharganj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in paharganj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️saminamagar
 
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment Booking
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment BookingCall Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment Booking
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment BookingNehru place Escorts
 
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort Service
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort ServiceCollege Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort Service
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort ServiceNehru place Escorts
 
Glomerular Filtration rate and its determinants.pptx
Glomerular Filtration rate and its determinants.pptxGlomerular Filtration rate and its determinants.pptx
Glomerular Filtration rate and its determinants.pptxDr.Nusrat Tariq
 
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original PhotosBook Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photosnarwatsonia7
 
Pharmaceutical Marketting: Unit-5, Pricing
Pharmaceutical Marketting: Unit-5, PricingPharmaceutical Marketting: Unit-5, Pricing
Pharmaceutical Marketting: Unit-5, PricingArunagarwal328757
 
Call Girls Viman Nagar 7001305949 All Area Service COD available Any Time
Call Girls Viman Nagar 7001305949 All Area Service COD available Any TimeCall Girls Viman Nagar 7001305949 All Area Service COD available Any Time
Call Girls Viman Nagar 7001305949 All Area Service COD available Any Timevijaych2041
 
call girls in Connaught Place DELHI 🔝 >༒9540349809 🔝 genuine Escort Service ...
call girls in Connaught Place  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service ...call girls in Connaught Place  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service ...
call girls in Connaught Place DELHI 🔝 >༒9540349809 🔝 genuine Escort Service ...saminamagar
 
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...narwatsonia7
 
Call Girls Thane Just Call 9910780858 Get High Class Call Girls Service
Call Girls Thane Just Call 9910780858 Get High Class Call Girls ServiceCall Girls Thane Just Call 9910780858 Get High Class Call Girls Service
Call Girls Thane Just Call 9910780858 Get High Class Call Girls Servicesonalikaur4
 

Último (20)

Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...
 
Noida Sector 135 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few C...
Noida Sector 135 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few C...Noida Sector 135 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few C...
Noida Sector 135 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few C...
 
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...
Russian Call Girl Brookfield - 7001305949 Escorts Service 50% Off with Cash O...
 
High Profile Call Girls Mavalli - 7001305949 | 24x7 Service Available Near Me
High Profile Call Girls Mavalli - 7001305949 | 24x7 Service Available Near MeHigh Profile Call Girls Mavalli - 7001305949 | 24x7 Service Available Near Me
High Profile Call Girls Mavalli - 7001305949 | 24x7 Service Available Near Me
 
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...
Call Girls Service in Virugambakkam - 7001305949 | 24x7 Service Available Nea...
 
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
 
Case Report Peripartum Cardiomyopathy.pptx
Case Report Peripartum Cardiomyopathy.pptxCase Report Peripartum Cardiomyopathy.pptx
Case Report Peripartum Cardiomyopathy.pptx
 
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbai
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service MumbaiVIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbai
VIP Call Girls Mumbai Arpita 9910780858 Independent Escort Service Mumbai
 
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
 
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
 
call girls in paharganj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in paharganj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in paharganj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in paharganj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
 
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment Booking
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment BookingCall Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment Booking
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment Booking
 
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort Service
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort ServiceCollege Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort Service
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort Service
 
Glomerular Filtration rate and its determinants.pptx
Glomerular Filtration rate and its determinants.pptxGlomerular Filtration rate and its determinants.pptx
Glomerular Filtration rate and its determinants.pptx
 
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original PhotosBook Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
 
Pharmaceutical Marketting: Unit-5, Pricing
Pharmaceutical Marketting: Unit-5, PricingPharmaceutical Marketting: Unit-5, Pricing
Pharmaceutical Marketting: Unit-5, Pricing
 
Call Girls Viman Nagar 7001305949 All Area Service COD available Any Time
Call Girls Viman Nagar 7001305949 All Area Service COD available Any TimeCall Girls Viman Nagar 7001305949 All Area Service COD available Any Time
Call Girls Viman Nagar 7001305949 All Area Service COD available Any Time
 
call girls in Connaught Place DELHI 🔝 >༒9540349809 🔝 genuine Escort Service ...
call girls in Connaught Place  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service ...call girls in Connaught Place  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service ...
call girls in Connaught Place DELHI 🔝 >༒9540349809 🔝 genuine Escort Service ...
 
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...
High Profile Call Girls Kodigehalli - 7001305949 Escorts Service with Real Ph...
 
Call Girls Thane Just Call 9910780858 Get High Class Call Girls Service
Call Girls Thane Just Call 9910780858 Get High Class Call Girls ServiceCall Girls Thane Just Call 9910780858 Get High Class Call Girls Service
Call Girls Thane Just Call 9910780858 Get High Class Call Girls Service
 

Health information professionals and Artificial Intelligence

  • 1. Health information professionals and Artificial Intelligence Andrew Cox, Senior Lecturer, Information School, Sheffield a.m.cox@sheffield.ac.uk The impact of AI, machine learning, automation and robotics on the information professions: A report for CILIP https://www.cilip.org.uk/general/custom.asp?page=researchreport Health Libraries Group – Virtual conference - 24th November 2021
  • 5. Definition 1: Everyday functionality increasing productivity of knowledge workers • Auto-correct • Auto-suggest • Grammar check • Transcription/ captioning of meetings • Translation tools • Automatic writing • Many features of search and recommendation • Increased productivity • Increased access to knowledge • Does it do so evenly, eg which languages are served best? • Continued need for critical information literacy
  • 6. Definition 2: A cluster of new technologies • Machine learning • Natural language processing • Sentiment analysis • Voice recognition • Image recognition • Applications: new forms of search and recommendation, collections as data • Eg Searching medical images or text mining the literature • Chatbots, voice assistants Its not magic • Data description and fragmentation • Training data effort • Data bias • Data validity • Data ethics • The hype around technological solutionism always downplays women’s work, emotional labour, service (Mirza and Seale, 2017) https://exploreai.jisc.ac.uk/
  • 7. Definition 3: A global industrial complex • How much energy does it use? • How much raw material does it use? • How much unpaid labour/ data are we contributing? • How much does it rely on clickworkers? • Who profits? How does it link to global inequalities? • Is it sustainable? (Crawford and Joler, 2018; Crawford, 2020)
  • 8. Definition 4: An evolving idea… a social imaginary • Utopias and dystopias of science fiction • Evolves as our idea of technology and intelligence evolve • Intelligence as answering a quiz • Intelligence as social, creative, emergent, open
  • 9. Definition 5: AI for information professionals Use in our own daily work • Using AI tools in your own work, eg book ordering, summarising texts… etc • Robotic process automation of backend processes Using AI in our own services to users • Supporting use of AI built into third party search tools • Applying machine learning to organisational datasets • Text mining the literature • Developing a chatbot or voice assistant for information service users Supporting a community of data scientist users • Locating/ licensing external data sets for analysis • Developing training data for machine learning • Creating a community of data scientists • Data governance and stewardship Supporting wider use in the organisation • Input to your organization’s adoption of AI, eg in procurement, training etc • Promoting data and AI literacy Using it to monitor/ predict/influence user behaviour • Applying sentiment analysis to social media responses to information services
  • 10. What types of uses can you imagine? Post your answers in padlet: https://padlet.com/a_m_cox/jduwltdylkl7vi54
  • 11. Understanding or managing users • Libraries are rich in data about users • Turnstile data • Circulation data • Usage of digital resources • Satisfaction surveys • Reference enquiries • Qualitative data, eg UX studies • AI to analyse social media data or open text survey data • AI to nudge users? Learning analytics debate • Lack consent or student awareness of how their data is being used • Lack ethics review • Libraries few responsible use statements • Benefits unclear or for institution not learner • Privacy issues • Chilling effect on free speech and expression Jones et al. (2020) • Issue of validity: “learning data” not equal to learning • Evidence that data analysis flawed (Robertshaw and Asher, 2019)
  • 13. Ethics and values – do our profession’s translate? • Study found 84 statements about ethics (international organisation, governments, tech companies etc) (Jobin et al., 2019) • Bias • Transparency and accountability • Privacy / surveillance – chilling effects • Security and safety • Human agency - nudging • Voice assistants cannot understand people with non-standard accents • “Female” naming of chatbot reinforces stereotypes • Deepfakes create false news • Automated moderation on social media blocks legitimate free expression • Fear of surveillance inhibits searching/ reading certain material • My data being used without my consent
  • 14. Which of these barriers to using AI do you think is the greatest? 1. Privacy concerns 2. Concerns about bias and lack of transparency 3. Security risks 4. GDPR compliance 5. Legal uncertainty 6. Issues of data quality in general 7. Over promising/ hype 8. Lack of information professional skills 9. Other people’s dated assumptions about what information professionals can do 10. IT owns the agenda 11. User fear of technology/ need for culture change 12. Other priorities
  • 15. Part 2: AI and information professional jobs
  • 16. AI’s impact on jobs • Replaced • Dominated • Divided • Complemented • Augmented • Rehumanized (GPAI, 2020) Differences by sector • Some scholars predict the replacement of professionals (Susskind and Susskind, 2015)… others emphasise the vulnerability of “routine” jobs (Frey and Osborne, 2017)…
  • 17. Skills and knowledge – updating for data and AI • Information Management skills – apply to data – information governance, standards, metadata, preservation • Sourcing external data is a content challenge • Collection management, including metadata, standards, IPR etc – data not print collections • Importance of data provenance for validity • Procuring data and systems – different types of system • Searching for data – new landscapes of search • Teaching data & AI literacy – new dimensions of literacy, implies stronger understanding of data analysis • Knowledge of users’ need – assembling data from wide range of sources • “Computational sense” (Twidale and Nichols, 2008)
  • 18. Attitudes • Service focus / balanced with sense of institutional agendas • Collaborative skills / Influencing skills • Commitment to professional development and learning • Professional knowledge sharing
  • 19. WEF (2020) – 10 skills to thrive in the 4th Industrial revolution 1. Complex Problem Solving 2. Critical Thinking 3. Creativity 4. People Management 5. Coordinating with Others 6. Emotional Intelligence 7. Judgement and Decision Making 8. Service Orientation 9. Negotiation 10. Cognitive Flexibility
  • 20. Addressing our weaknesses • Other professions who talk more about data: • I do not think we need to become data scientists (who combine stats/ computing/ subject knowledge) • But other groups such as BCS, DAMA also talk about data management • Literate profession – shift towards quanti data (according to McKinseys) • Lack of recognition for IM/KM • When we see tech as outside force – IT control the agenda • Not so good at collaborating across sectors • Our diversity
  • 21. Values Example: CILIP’s ethical statement 1. Human rights, equalities and diversity, and the equitable treatment of users and colleagues 2. The public benefit and the advancement of the wider good of our profession to society 3. Preservation and continuity of access to knowledge 4. Intellectual freedom, including freedom from censorship 5. Impartiality and the avoidance of inappropriate bias 6. The confidentiality of information provided by clients or users and the right of all individuals to privacy 7. The development of information skills and information literacy Offers a distinctive perspective on AI ethics • Understanding of how inequality reproduced? • Relevance of sustainability, eg need for green AI • Consideration of global South perspectives, eg issues around language and operating in low resource environments • The ultimate drivers for datafication lie beyond our control
  • 22. A guide to good practice for digital and data- driven health technologies (2021) • Review the Data Ethics Framework and abide by the principles • Ensure that the product is designed to achieve a clear outcome for users or the system * • Ensure that the product is easy to use and accessible to all users * • Ensure that the product is appropriately tested and is fit for purpose • Ensure that the product is clinically safe to use • Demonstrate that the product collects, stores and processes users’ information in a safe, fair and lawful way • Be fair, transparent and accountable about what data is being used • Be transparent about the limitations of the data used * • Make security integral to the design and ensure that the product meets industry best practice security standards • Ensure that the product meets all relevant regulatory requirements • Ensure that the product makes the best possible use of open standards to ensure data quality and interoperability • Generate evidence that the product achieves clinical, social, economic or behavioural benefits • Define the commercial strategy
  • 23. A vision The paradigm of the intelligent library From searching to find a text to read To interacting with the full text of the library collection OR The living systematic review Cox, Pinfield and Rutter (2019)
  • 24. What would your vision of a library powered by AI be? Post your answers in the chat!
  • 25. The impact of AI, machine learning, automation and robotics on the information professions: A report for CILIP https://www.cilip.org.uk/general/custom.asp?page=researchreport
  • 26. Your questions and comments are welcome!
  • 27. References • Cox A (2021) The impact of AI, machine learning, automation and robotics on the information professions: A report for CILIP https://www.cilip.org.uk/general/custom.asp?page=researchreport • Cox, A. M., Pinfield, S., & Rutter, S. (2019). The intelligent library: Thought leaders’ views on the likely impact of artificial intelligence on academic libraries. Library Hi Tech. 37 (3) 418-435. • Crawford, K. (2021) Atlas of AI. Yale University Press. • Department of Health and Social Care. (2021) https://www.gov.uk/government/publications/code-of-conduct-for-data-driven-health-and-care- technology/initial-code-of-conduct-for-data-driven-health-and-care-technology • Glanville, J. (2020). Text mining for information specialists. In Craven and Leavey Systematic searchin:Practical ideas for improving results. Facet. • Global Partnership on Artificial Intelligence (2020). Working group on the future of work, https://gpai.ai/projects/future-of-work/ • IFLA (2020) IFLA statement on libraries and artificial intelligence https://www.ifla.org/wp- content/uploads/2019/05/assets/faife/ifla_statement_on_libraries_and_artificial_intelligence.pdf • Jones, K. M., Briney, K. A., Goben, A., Salo, D., Asher, A., & Perry, M. R. (2020). A comprehensive primer to library learning analytics practices, initiatives, and privacy issues. Jones, KML, Briney, KA, Goben, A., Salo, D., Asher, A., & Perry, MR, a Comprehensive Primer to Library Learning Analytics Practices, Initiatives, and Privacy Issues. College & Research Libraries, 81(3), 570-591. • McKinsey Global Institute. (2018). Skill Shift: Automation and the Future of the Workforce (Discussion Paper, May 2018). In McKinsey &Company (Issue May). https://www.mckinsey.com/~/media/McKinsey/Featured Insights/Future of Organizations/Skill shift Automation and the future of the workforce/MGI-Skill-Shift-Automation-and-future-of-the-workforce-May-2018.ashx • Robertshaw, M. B., & Asher, A. (2019). Unethical numbers? A meta-analysis of library learning analytics studies. Library Trends, 68(1), 76- 101. • Twidale, M. B., & Nichols, D. M. (2006). Computational sense: The role of technology in the education of digital librarians. https://researchcommons.waikato.ac.nz/handle/10289/40 • World Economic Forum (WEF) (2020). The ten skills you need to thrive in the 4th Industrial revolution https://www.weforum.org/agenda/2016/01/the- 10-skills-you-need-to-thrive-in-the-fourth-industrial-revolution/