Viewing a single comment thread. View all comments

Peantoo t1_iwd3y3l wrote

Nice, I was just researching this topic. Does this touch on CI/CD and other late stage deployment and testing issues?

31

sgt102 OP t1_iwdedyf wrote

Great question; very thought provoking!

I don't go through to in life CI/CD scenarios in the book, but I do look at running MAB's and A/B testing to understand the relative performance of models in live, and also write about the need for model monitoring and governance supporting the prod deployment.

Basically the book mostly ends with getting it into prod - but with the emphasis on getting it into prod with the right framework around it that it can be kept alive in prod.

−6

CaptMartelo t1_iwdkbco wrote

How the hell is it thought provoking. It's a yes or no question

63

sgt102 OP t1_iwdwc7x wrote

Because it made me think about whether I should have extended the scope into the operational phases of a machine learning system?

So I found it thought provoking...

26

globalminima t1_iwe6aeh wrote

The problem with most guides and even ML frameworks (e.g. MLFlow) is that they do everything pretty well up to deployment, and then offer only very basic options that are not really fit-for-purpose for intermediate or advanced systems. It's definitely the biggest differentiator between the best resources and everything else

15