Seldon
[wtm_mlop_cats]
Seldon core converts your ML models (Tensorflow, Pytorch, H2o, etc.) or language wrappers (Python, Java, etc.) into production REST/GRPC microservices.
Seldon handles scaling to thousands of production machine learning models and provides advanced machine learning capabilities out of the box including Advanced Metrics, Request Logging, Explainers, Outlier Detectors, A/B Tests, Canaries and more.
Features
Runs anywhere. Built on Kubernetes, runs on any cloud and on premises.
Agnostic and independent. Framework agnostic, supports top ML libraries, toolkits and languages.
Runtime inference graphs. Advanced deployments with experiments, ensembles and transformers.