BOOK A MEETING FR Multi Model Server (MMS) is a flexible and easy to use tool for serving deep learning models trained using any ML/DL framework. Use the MMS Server CLI, or the pre-configured Docker images, to start a service that sets up HTTP endpoints to handle model inference requests. Features Serving Quick Start – …
MLOP Category Archives:
Merlin
BOOK A MEETING FR Merlin is a platform for deploying and serving machine learning models. The project was born of the belief that model deployment should be: Easy and self-serve: Human should not become the bottleneck for deploying model into production. Scalable: The model deployed should be able to handle Gojek scale and beyond. Fast: …
PredictionIO
BOOK A MEETING FR Apache PredictionIO® is an open source Machine Learning Server built on top of a state-of-the-art open source stack for developers and data scientists to create predictive engines for any machine learning task. Features quickly build and deploy an engine as a web service on production with customizable templates; respond to dynamic …
m2cgen
BOOK A MEETING FR m2cgen (Model 2 Code Generator) – is a lightweight library which provides an easy way to transpile trained statistical models into a native code (Python, C, Java, Go, JavaScript, Visual Basic, C#, PowerShell, R, PHP, Dart, Haskell, Ruby, F#, Rust). Features Linear SVM Tree Random Forest Boosting Official website Link Tutorial …
KFServing
BOOK A MEETING FR The Kubeflow project is dedicated to making deployments of machine learning (ML) workflows on Kubernetes simple, portable and scalable. Our goal is not to recreate other services, but to provide a straightforward way to deploy best-of-breed open-source systems for ML to diverse infrastructures. Anywhere you are running Kubernetes, you should be …
Jina
BOOK A MEETING FR Jina🔊 is a neural search framework that empowers anyone to build SOTA and scalable deep learning search applications in minutes. 🌌 All data types – Scalable indexing, querying, understanding of any data: video, image, long/short text, music, source code, PDF, etc. ⏱️ Save time – The design pattern of neural search …
Opyrator
BOOK A MEETING FR Instantly turn your Python functions into production-ready microservices. Deploy and access your services via HTTP API or interactive UI. Seamlessly export your services into portable, shareable, and executable files or Docker images. Opyrator builds on open standards – OpenAPI, JSON Schema, and Python type hints – and is powered by FastAPI, …
OpenScoring
BOOK A MEETING FR REST web service for scoring PMML models. Openscoring is a Java service that provides a JSON REST interface to the Java Predictive Model Markup Language (PMML) evaluator JPMML Features Full support for PMML specification versions 3.0 through 4.4. The evaluation is handled by the JPMML-Evaluator library. Simple and powerful REST API: …
Hydrosphere
BOOK A MEETING FR Hydrosphere is a platform for deploying, versioning, and monitoring your machine learning models in production. It is language-agnostic and framework-agnostic, with support for all major programming languages and frameworks – Python, Java, Tensorflow, Pytorch, etc. Features Model Registry Inference Pipelines A/B Model Version Deployment Traffic Shadowing Language-Agnostic Deployment Official website Link …
GraphPipe
BOOK A MEETING FR GraphPipe is a protocol and collection of software designed to simplify machine learning model deployment and decouple it from framework-specific model implementations. Model serving network protocols are tied to underlying model implementations. If you have a Tensorflow model, for example, you need to use tensorflow’s protocol buffer server (tensorflow-serving) to perform …