User Interfaces of the Future

1. U S E R I N T E R F A C E S
O F T H E F U T U R E

2. Evolution of User Interfaces
Graphics
Touch
Gestures
Voice
Wearables
Neural
Sensors
Augmented
Reality
Virtual
Reality

3. Evolution of User Interfaces
Graphics
Touch
Gestures
Voice
Wearables
Neural
Sensors
Augmented
Reality
Virtual
Reality
NATURAL
USER
INTERFACE

4. U S E R I N T E R F A C E S
O F T H E F U T U R E
User Interfaces of the Future
“People who specialize in designing natural user
interfaces challenge themselves with designing
methods of interacting with machines that require no
tools other than the ones you were born with.”
Ron George, Microsoft

5. U S E R I N T E R F A C E
O F T H E F U T U R E
Touch based UI

6. Sony Xperia Touch

7. U S E R I N T E R F A C E S
O F T H E F U T U R E
Sony // Xperia Touch

8. University of Electro-Communication Tokyo // AquaTop Display
U S E R I N T E R F A C E S
O F T H E F U T U R E

9. University of Electro-Communication Tokyo // AquaTop Display

10. U S E R I N T E R F A C E S
O F T H E F U T U R E
Screens of the Future –
Display Prototypes

11. U S E R I N T E R F A C E S
O F T H E F U T U R E
Touch based UI // UX Predictions
• Interfaces will not be bound to touch devices
• New technologies will push the boundaries of classic screens
• Use cases for large-area touch will arise
• Use cases with flexible, natural surfaces and material will arise

12. U S E R I N T E R F A C E S
O F T H E F U T U R E
Touch based UI // UX Predictions
M U LT I P L I C A T I O N O F S C R E E N S .
N E W R E S P O N S I V E D E S I G N .

13. U S E R I N T E R F A C E
O F T H E F U T U R E
Gesture based UI

14. Google ATAP // Soli

15. U S E R I N T E R F A C E S
O F T H E F U T U R E
Google ATAP // Soli

16. U S E R I N T E R F A C E S
O F T H E F U T U R E
Google ATAP // Soli
Button Slider Dial

17. U S E R I N T E R F A C E S
O F T H E F U T U R E
Gesture based UI // UX Predictions
• Gesture UI will partly substitute touch and graphical UI
• Design will aim for absolutely intuitive interactions
• Design will has to define maximally precise interaction patterns

18. U S E R I N T E R F A C E S
O F T H E F U T U R E
Gesture based UI // UX Predictions
H U M A N D E S I G N P A T T E R N S .
H I G H A T T E N T I O N U S E C A S E S .

19. U S E R I N T E R F A C E
O F T H E F U T U R E
VR and AR based UI

20. „U S E R I N T E R F A C E S
O F T H E F U T U R ETHERE’S ALWAYS A RICHER, MORE IMMERSIVE
MEDIUM TO EXPERIENCE THE WORLD AND AFTER
VIDEO, THE NEXT LOGICAL STEP IS FULLY
IMMERSIVE VIRTUAL REALITY.”
Mark Zuckerberg

21. U S E R I N T E R F A C E S
O F T H E F U T U R E
Social VR

22. Facebook // Spaces
U S E R I N T E R F A C E S
O F T H E F U T U R E

23. Facebook // Spaces
U S E R I N T E R F A C E S
O F T H E F U T U R E

24. Facebook // Spaces
U S E R I N T E R F A C E S
O F T H E F U T U R E

25. Facebook // VR Guidelines
U S E R I N T E R F A C E S
O F T H E F U T U R E

26. Microsoft Research // Holoportation
U S E R I N T E R F A C E S
O F T H E F U T U R E

27. Microsoft Research // Holoportation

28. „U S E R I N T E R F A C E S
O F T H E F U T U R E
A HOLOGRAM IS WHATEVER YOU DREAM UP
Microsoft Mixed Reality Guidelines

29. Microsoft // Mixed Reality Guidelines

30. Microsoft // Mixed Reality Guidelines
U S E R I N T E R F A C E S
O F T H E F U T U R E
Gaze direction
Microsoft Mixed Reality Design
1. Avoid gaze angles more than 10 degrees above the horizon
2. Avoid gaze angles more than 60 degrees below the horizon
3. Avoid neck rotations more than 45 degrees off-center

31. Google // Tango

32. Google // Tango
U S E R I N T E R F A C E S
O F T H E F U T U R E

33. Google // Tango VPS

34. Google // Visual Positioning Service

35. U S E R I N T E R F A C E S
O F T H E F U T U R E
Touch VR & AR

36. AxonVR
U S E R I N T E R F A C E S
O F T H E F U T U R E

37. AxonVR

38. Ultrahaptics
U S E R I N T E R F A C E S
O F T H E F U T U R E

39. Ultrahaptics
U S E R I N T E R F A C E S
O F T H E F U T U R E

40. Ultrahaptics
U S E R I N T E R F A C E S
O F T H E F U T U R E

41. „IT IS ALL ABOUT WHAT THE GUYS AT
THE TOP OF THE PYRAMID DO!
Tim Merel, Founder Digi-Capital
U S E R I N T E R F A C E S
O F T H E F U T U R E

42. Apple // WWDC 2017
U S E R I N T E R F A C E S
O F T H E F U T U R E

43. Apple // WWDC 2017
U S E R I N T E R F A C E S
O F T H E F U T U R E

44. U S E R I N T E R F A C E S
O F T H E F U T U R E
VR/AR based UI // UX Predictions
• Design of more immersive experiences is asked by consumers
• Desire for real virtuality instead virtual reality is growing
• There is a huge need for VR design guidelines to establish UX standards

45. U S E R I N T E R F A C E S
O F T H E F U T U R E
VR/AR based UI // UX Predictions
C O M F O R T D E S I G N .
M O R E T H A N G A M I N G .

46. U S E R I N T E R F A C E
O F T H E F U T U R E
Brain-Computer-Interface

47. U S E R I N T E R F A C E S
O F T H E F U T U R E
Brain-Computer-Interface
„Neuralink is developing ultra high bandwidth brain-
machine interfaces to connect humans and
computers.“

48. „WHAT IF YOU COULD TYPE DIRECTLY
FROM YOUR BRAIN?
Mark Zuckerberg
U S E R I N T E R F A C E S
O F T H E F U T U R E

49. U S E R I N T E R F A C E S
O F T H E F U T U R E
EMOTIV

50. EMOTIV

51. „OUR BRAINS PRODUCE ENOUGH DATA TO STREAM
4 HD MOVIES EVERY SECOND. THE PROBLEM IS
THAT SPEECH CAN ONLY TRANSMIT ABOUT THE
SAME AMOUNT OF DATA AS A 1980’S MODEM.
Mark Zuckerberg
U S E R I N T E R F A C E S
O F T H E F U T U R E

52. U S E R I N T E R F A C E S
O F T H E F U T U R E
Brain-Computer-Interfaces // UX Predictions
• Brain-Computer-Interfaces will be the most efficient UI ever
• Design for experiences will get truly invisible
• The technology needs decades to become mainstream

53. U S E R I N T E R F A C E S
O F T H E F U T U R E
Brain-Computer-Interfaces // UX Predictions
D A T A E X P L O S I O N .
S E C U R I T Y D E S A S T E R .

54. U S E R I N T E R F A C E
O F T H E F U T U R E
Wearable UI

55. U S E R I N T E R F A C E S
O F T H E F U T U R E
Wearable UI

56. Fashion Tech & Smart Fabrics

57. U S E R I N T E R F A C E S
O F T H E F U T U R E
Electrocouture // The Syma Line

58. U S E R I N T E R F A C E S
O F T H E F U T U R E
Google + Levi’s // Project Jacquard

59. Google + Levi’s // Project Jacquard

60. Pauline van Dongen // Solar Shirt

61. MIT + Microsoft Research // DuoSkin
U S E R I N T E R F A C E S
O F T H E F U T U R E
Input Communication

62. „CLOTHING SHOULD BE OUR PARTNER IN GETTING
THROUGH LIFE!
Amanda Parkes, Manufacture New York
U S E R I N T E R F A C E S
O F T H E F U T U R E

63. U S E R I N T E R F A C E S
O F T H E F U T U R E
Wearable UI // UX Predictions
• The human body will become one integral part of UI design
• New possibilities for designing invisible gadgets arise
• Reseach focus will stay the perfectly seamless integration of technology
and apparel.

64. U S E R I N T E R F A C E S
O F T H E F U T U R E
Wearable UI // UX Predictions
B O D Y E X T E N S I O N .
R E F R A M I N G E A S E O F U S E .

65. U S E R I N T E R F A C E
O F T H E F U T U R E
What will be the next big UI paradigm?

66. U S E R I N T E R F A C E S
O F T H E F U T U R E
The evaluation of interaction patterns
Tim Friedemann
What will be the next big UI paradigm?
Text UI
Graphical UI
Touch UI
Voice UI
Interface
very low
moderate
high
very high
Instinctiveness
low
high
high
less high (yet)
Reliabilty of
expectations
unlimited
limited
very limited
unlimited
Degrees of
freedom

67. U S E R I N T E R F A C E S
O F T H E F U T U R E
Common voice concerns from users
Microsoft Mixed Reality Design
What will be the next big UI paradigm?
1. What can I say?
2. How do I know the system heard me correctly?
3. The system keeps getting my voice commands wrong.
4. Doesn’t react when I give it a voice command.
5. Reacts the wrong way when I give it a voice command.
6. How do I target my voice to a specific app or app command?

68. U S E R I N T E R F A C E S
O F T H E F U T U R E
What will be the next big UI paradigm?
AI
Voice
Wearable
Touch
VR/AR
Brain-
Computer
Gestures

69. „U S E R I N T E R F A C E S
O F T H E F U T U R E
AI IS THE NEW UI
Accenture Tech Vision 2017

70. „U S E R I N T E R F A C E S
O F T H E F U T U R E
YOUR SMARTPHONE WILL BE OBSOLETE
IN TWO YEARS
Ewan Spence, Forbes Magazine 2015

71. „U S E R I N T E R F A C E S
O F T H E F U T U R E
SMARTPHONES AS WE KNOW THEM
WILL BE DEAD IN FIVE YEARS
Arjun Kharpal, CNBC 2017

72. U S E R I N T E R F A C E S
O F T H E F U T U R E
Hype or not?
1970er 2009 2016
What will be the next big UI paradigm?

73. U S E R I N T E R F A C E S
O F T H E F U T U R E
Hype or not?
Rupert Platz
What will be the next big UI paradigm?

74. What will be the next big UI paradigm?
U S E R I N T E R F A C E S
O F T H E F U T U R E
The next big thing?

75. What will be the next big UI paradigm?
U S E R I N T E R F A C E S
O F T H E F U T U R E
The next big thing is the next small thing