Deployment and Production¶

For a more in depth overview I highly recommended the Machine Learning Engineering for Production (MLOps) Specialization on Coursera.

POC to Production Gap¶

Machine learning model code is only a small part of your entire development. There are many other things still needed, which is why even when having a Proof of Concept ("POC") model working, in for example a Jupyter Notebook, it can still be a lot of work to get to successful production. This is sometimes referred to as the "POC to Production Gap".

Project Lifecycle¶

Thinking through the machine learning project lifecycle is an effective way to plan out all steps that you need to work on to get your system up and running, while at the same time minimizing any surprises. An example of such framework, as suggested by Andrew Ng:

stateDiagram-v2
    direction LR
    Scoping --> Data
    Data --> Modeling
    Modeling --> Deployment
    Modeling --> Data
    Deployment --> Modeling
    Deployment --> Data
    state Scoping {
        scopingState: Define Project
    }
    state Data {
        dataState1: Define data and establish baseline
        dataState2: Label and organize data
        dataState1 --> dataState2
    }
    state Modeling {
        modelState1: Select and train model
        modelState2: Perform error analysis
        modelState1 --> modelState2
        modelState2 --> modelState1
    }
    state Deployment {
        deployState1: Deploy in production
        deployState2: Monitor & maintain system
        deployState1 --> deployState2
    }

Scoping¶

Data¶

Modeling¶

Deployment¶

Links and Learn More¶