Deploying your AI/ML investments - Jon Peck | ODSC East 2018

Описание: Over the next 18 months, companies will be completing the R&D phase of their AI/ML investments and will be deploying their models and algorithms to production. The proper execution of deploying your AI/ML models will separate the organizations who see an ROI on AI from those who don't. This talk will introduce the best practices of the tech companies already deploying, the tech stack that is needed, and the organization rhythms that are needed to be successful. This talk is ideal for engineers and leadership to attend together.

You’ve trained machine learning models on your data, but how do you put them into production? When you have tens of thousands of model versions, each written in any mix of frameworks (R/Java/Ruby/SciKit/Caffe/Tensorflow on GPUs etc) and exposed as REST API endpoints, and your users love to chain algorithms and run ensembles in parallel... how do you maintain a latency less than 20ms on just a few servers?

As much as AI has been a hot topic lately, with advances being made constantly in what is possible, there has not been as much discussion of the infrastructure and scaling challenges that come with it. As co-founder of Algorithmia, I’ve built, deployed, and scaled thousands of algorithms and machine learning models, using every kind of framework (from scikit-learn to tensorflow). We’ve seen many of the challenges faced in this area, and in this talk I’ll share some insights into the problems you’re likely to face, and how to approach solving them.

What do you think about this material?
Share your thoughts in the comments below!
#AI #MachineLearning #DataScience #ODSC