Using Pachyderm to Automate NLP Development and Deployment on AWS

Speaker: Jimmy Whitaker, Senior Machine Learning Developer and Developer Advocate, Pachyderm, Inc.

Natural language processing (NLP) is one of the most difficult areas in machine learning. Language is always changing because how we communicate is always changing. When it comes to machine learning our models are only as effective as the data they’ve been trained on. This is why any NLP task ultimately becomes an exercise in data-driven development.

Managing data for machine learning, however, has always been an afterthought. Tracking, versioning, and testing are usually introduced after it’s too late. In this workshop, we’ll show you how to manage your data, automate your training pipelines, and shift to a data-centered development process on a financial market sentiment model, and run it all deployed on AWS with EKS and S3.

In this workshop, attendees will learn how to:

• Train a market sentiment model
• Automate your NLP pipelines
• Shift to data driven development with Pachyderm and AWS