AWS has introduced Deep Learning Containers to help users set up optimized deep learning environments for training and inference using TensorFlow and MXNet. The containers provide best performance automatically and support both single-node and multi-node setups on AWS services like ECS, EKS and EC2. Wix uses deep learning for tasks like super resolution, portrait segmentation and layout optimization. They found that using AWS Deep Learning Containers could decrease their time to production for new deep learning models by 20% by providing consistent environments for research, training and deployment.

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Introducing AWS Deep Learning
Containers
Satadal Bhattacharjee
Principal Product Manager
Amazon AI
A I M 2 0 1
Andrea Olgiati
Principal Engineer
Amazon AI
Meir Perez
AI Team Leader
Wix

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
1
2
3

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Deep learning model lifecycle
Training
• Gather data for training and testing
• Hyper-parameter tuning
• Distributed training using GPUs
• Cost-to-train and time-to-train
Inference
• Hundreds of machines
• Throughput and latency important
• Cost per inference and inference/sec.
• Run at scale for long

4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Challenges in experimentation to production
AWS Deep Learning AMIs Amazon ECS Amazon EKS
AWS Cloud

5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AI Services
A M A Z O N
R E K O G N I T I O N
I M A G E
A M A Z O N
P O L L Y
T R A N S C R I B E T R A N S L A T E C O M P R E H E N D A M A Z O N
L E X
A M A Z O N
R E K O G N I T I O N
V I D E O
F O R E C A S TA M A Z O N
T E X T R A C T
A M A Z O N
P E R S O N A L I Z E
V IS IO N S P E E CH L A N G U A G E CH A T B OTS F O R E CA ST I NG R E CO M MEN DA TI ON S
ML Services Amazon
SageMaker
Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting
ML Frameworks +
Infrastructure EC2 P3
& P3n
EC2
C5
FPGAs AWS IoT
Greengrass
Elastic
inference
F R AM EWO RKS IN T ER F ACES IN F R AS T R UCTURE
AWS Deep Learning
Containers

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS Deep Learning
Containers
Quickly set up deep learning environments with optimized,
pre-packaged Docker container images
Get best performance automatically; no tuning required
Support TensorFlow and Apache MXNet
Deploy on Amazon ECS, Amazon EKS, or Amazon EC2
Customizable container images
Available at no cost from Amazon Elastic Container Registry (Amazon ECR)
and AWS Marketplace Amazon ECR AWS
Marketplace

8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS Deep Learning Containers
Customizable container images Support for TensorFlow, Apache
MXNet
Single and multi-node training
and inference
Optimized and customizable containers for deep learning environments

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS Deep Learning Containers
TensorFlow MXNet
Training Inference
GPU CPU

10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS Deep Learning Containers performance
Description
Improvement over stock
TensorFlow
Training
ResNet-50 ImageNet on 8-node GPU
cluster
1.27x
Inference ResNet-50 inference on single node CPU 2x

11. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
WIX is the pre-eminent platform for building
websites, to grow your online presence.
Clouds & data centers
Multiple
Users (website
owners)
~150M
Of employees
in R&D
50%
R&D centers
5

13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Great products define Wix
Novice Expert
Wix ADI Wix Editor Wix Code

14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Deep Learning in WIX
Website layout
optimization
Content
enhancement
Automatic Element
Placement and
alignment
Computer vision
Business
models
Predictive analytics
Super resolution
Portrait segmentation
Computational
photography NLP

15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Deep Learning in WIX
#1 Super resolution #2 Portrait & object segmentation

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
BEFORE AFTER
#1 Super Resolution #2 Portrait & Object Segmentation

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
#1 Super resolution #2 Portrait & object segmentation

20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
#1 Super resolution #2 Portrait & object segmentation

21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SU M M I T

23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Workflow
RESEARCH
TRAINING & EVAL
PRODUCTION
Deep Learning AMI
TensorFlow
Production Environment
DATA
CURATION
FEEDBACK
Deployment
Validation
20% of Portrait Segmentation project

24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Deep Learning Containers
RESEARCH
TRAINING & EVAL
DEPLOYMENT
Same Environment
for Research and Pro
Easily distribute
training across nodes
Easier testable
version control
Can split resources
on a single instance

25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS Deep Learning Containers could
decrease our time to production by 20%

26. Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Questions/Feedback:
amazon-dl-container-feedback@amazon.com

27. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.