×

Watch Now

First Name
Last Name
Phone Number
Company Name
Country/Region
Postal Code
Job Role
Company Type
Opt-in to Future Emails
Yes, I'd like Amazon Web Services (AWS) to share the latest news about AWS services and related offerings with me by email, post or telephone.

You may unsubscribe from receiving AWS news and offers at any time by following the instructions in the communications received. AWS handles your information as described in the AWS Privacy Notice.
Thank you!
Error - something went wrong!

AI/ML for Startups - Training Extremely Large Language Models on AWS

November 3, 2021

One Trillion Parameters and Beyond - Lessons Learned from Training Extremely Large Language Models on AWS

Speakers: Emily Webber, Machine Learning Specialist Solutions Architect, AWS | Neel Kishan, Business Development Manager AI/ML, AWS 

GPT-3, Wu Dao, Megatron-LM, Compositional Transformers and more. In this session we'll explore a variety of extreme scale NLP models and the distributed science and architecture that make them tick. In this session you'll learn about the newly launched distributed training toolkits on the AWS cloud and learn about how customers from Hyundai to Hugging Face are pushing the boundaries on transformer-based models. You'll learn about custom hardware AWS is developing to lower costs and boost performance. You'll also learn about how to partner with AWS to bring your unique technology to the enterprise cloud market!

No Previous Videos

Next Video
AI/ML for Startups - How Startups Build at Gigantic Scale Panel
AI/ML for Startups - How Startups Build at Gigantic Scale Panel