The Machine Learning Lifecycle


Diego Oppenheimer
Co-Founder & CEO
Algorithmia

During this webinar, industry expert Diego Oppenheimer discussed the machine learning lifecycle and the 10 Measures and KPIs of ML Success We’ve included a short transcription of the webinar, beginning at 10:55 of the webinar.

Diego Oppenheimer, Algorithmia: So let’s talk a little bit about the machine learning lifecycle and, more importantly, how it differs maybe from other things that we’ve seen before. So the one thing that is really interesting, if we think about data scientists as software engineers to a certain degree, they are the fastest moving software engineers that we’ve ever seen in industry. And the reason why I say that is the iterative process. It is a process of constant iteration where data changes, model changes, conditions change and those become extremely important. So you have to have a process in this life cycle that actually allows for that iteration. And so we think about two big areas to that. 

One which is, how do we actually develop these models? The training, the data prep, the experimentation. How do we manage that? How do you actually look at that perspective and scale that out? And then you move over to the world of production operations and deployment, which is how do you actually manage these things in production?

One of the interesting aspects of this that I think is particularly relevant is, while the data analytics stack and I talked a little bit about BI analytics, fact is, we’re pretty self contained in the sense that, you prepared data you had your data warehouses you would create your cubes and measures and then you deploy your dashboards. The end result was in a dashboard and so it could be fully contained. 

Now, in the world of machine learning, the final result goes into an application. So we have a whole new set of requirements now. To get an application into production, there’s a whole devops software development lifecycle that exists. So a very important part of thinking about machine learning at scale and how to get there is how do we merge the world of that machine learning lifecycle into the traditional software development life cycle that exists as an organization? 

There’s a lot of overlap from a devops perspective, but there’s also a lot of unique things. So those are some of the things I’m going to talk about and how to measure those risks and KPI’s today. So while in the world of model development, you’re going to be doing iteration, changing of data, experimentation, hyper parameter optimization, experiment tracking, which is the management side. You also have to have governance and security around that. Are you accessing the right data? Are you training models with the data you’re supposed to be? Do you have controls around audit? Do you have controls around explainability and observability of the training part of that life cycle? 

Once you’ve actually gotten to a result and a model that can go into an application, then you start thinking, okay, how am I going to connect to the data services that are providing that data for inference? How am I going to be able to register those models into a controllable, observable, manageable framework? And then how do I actually scale that? How do I make sure that we have the right back ops? The right up times? The right SLAs? The right monitoring? The right reporting? Right infrastructure management? Who can access those models? Do you have the proper infosec compliance so that these models can actually go into production using the library? Is the tensorflow library you’re using approved by your security team? Do you have the proper Regulatory Compliance set up so that if one day a regulator comes in for your life sciences workflows or your financial services workflows, you can actually provide them full audit control backwards around that. 

Remember that what connects to these machine learning models is applications. So these things will actually be exposed in applications that have their own life cycle, their own refresh cycle, and they have their own conditions around reporting and stuff like that.

Learn more and watch the full video on YouTube: https://youtu.be/So2S7Wy4dn8.


Comments

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Posts

Recent Posts

How AI is Revolutionizing Education -   Artificial intelligence has become increasingly relevant in a number of major industries. We read a lot about how it’s…
Three Amazing Ways AI is Revolutionizing Healthcare - It may not seem like it was too long ago when the idea of artificial intelligence playing a major role…
How 5G is Going to Impact AI in Automation Within Telecom - During this webinar, an industry expert discussed how an automation project comes to life from the initial business problem through…
How Automation Projects Come to Life in Telecom - During this webinar, an industry expert discussed how an automation project comes to life from the initial business problem through…
The Future of AI in Marketing - During this webinar, industry experts discussed where AI in marketing was heading in the future. We’ve included a short transcription…
How AI Has Changed Marketing - During this webinar, industry experts discussed how AI has changed the marketing industry. We’ve included a short transcription of the…
Key Takeaways From Ai4 2020 - Artificial Intelligence Creates the Demand of Innovation, Autonomy, and Personalization Amidst a Crisis There is a seemingly quiet, yet enormous…
Computer Vision Versus Other ML Projects - During this webinar, industry experts discussed computer vision projects versus other machine learning projects within an enterprise setting. We’ve included…
Computer Vision in the Enterprise - During this webinar, industry experts discussed if computer vision computer is commonplace within enterprises that have machine learning models in…
How AI is Enabling Banks to Provide a Better User Experience - During this webinar, industry experts discussed how AI is enabling banks to provide a better user experience for having both…

Popular Posts

Does Healthcare AI Meet Basic Ethics Principles? - Ingrid Vasiliu-Feltes Chief Quality and Innovation Officer MEDNAX, Health Solutions Partner Over the past decade we have noticed an exponential…
Machine Learning and Artificial Intelligence in Banking - Artit "Art" Wangperawong Distinguished Engineer US Bank Introduction Every company’s AI journey is different. We’re all trying to figure out…
Machine Learning for Pricing and Inventory Optimization @ Macy’s - Jolene Mork Senior Data Scientist Macy's Iain Stitt Data Scientist Macy's Bhagyesh Phanse VP, Data Science Macy's Overview In this…
Artificial Intelligence & Cybersecurity: Math Not Magic - Wayne Chung CTO FBI Introduction The field of cybersecurity has slowly progressed from an art to a science. It has…
AI/ML in Investment and Risk Management: Recent Applications, Use Cases, and Implementation Challenges - Arvind Rajan Managing Director - Head of Global & Macro PGIM Fixed Income Introduction Investing is a completely different ballgame…
Top AI Conferences - Interested in learning the latest in AI this year? We’ve compiled a list of the top artificial intelligence conferences in…
Machine Learning in Production: From Research to the Customer - Ameen Kazerouni Lead Data Scientist Zappos Overview In this presentation Ameen Kazerouni, the Lead Data Scientist at Zappos, walks through…
How COVID-19 is Impacting the State of AI in Banking - On this panel, industry experts (listed above) discussed The State of AI in Banking and how COVID-19 is affecting it.…
“Ask Me Anything” with Zappos’s Head of AI/ML Research & Platforms, Ameen Kazerouni - Ameen Kazerouni Head of AI/ML Research & Platforms Zappos Family of Companies Ai4 recently hosted an "Ask Me Anything" session…
The Autonomous Pharmacy: Applying AI and ML to Medication Management Across the Care Continuum - Ken Perez VP of Healthcare Policy Omnicell, Inc. Ken applies artificial intelligence (AI) and machine learning (ML) solutions to medication…