#

model-serving

Here are 50 public repositories matching this topic...

ahkarami / Deep-Learning-in-Production

Star

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

Updated Feb 8, 2021

BentoML

bentoml / BentoML

Star

Model Serving Made Easy

kubernetes machine-learning ai aws-lambda tensorflow ml model-management model-deployment model-serving ml-infrastructure azure-ml mlops aws-sagemaker machine-learning-operations bentoml ml-platform bentoml-format prediction-service

Updated Feb 14, 2021
Python

kubeflow / kfserving

Star

Open

Set imagePullPolicy=Always for storageInitializer init container

6

talexander commented May 19, 2020

Deploy kfserving v0.3.0 and sample app

kubectl apply -f kfserving.v0.3.0.yaml
kubectl apply -f sklearn.yaml

I have k8s cluster with enabled PSP and ImagePullAlways plugin
https://kubernetes.io/docs/reference/access-authn-authz/admission-controllers/
After all kservice isn't working

kubectl describe replicaset.apps/sklearn-iris-predictor-default-x9v87-deployment-784dbd

Read more

area/engprod good first issue help wanted kfserving/storage

Open

Add support for web proxy for KFServing when model is downloaded from Google Storage, S3 etc.

6

Open

Make KFServing accessible from GCP IAP Ingress

8

Find more good first issues →

lightbend / kafka-with-akka-streams-kafka-streams-tutorial

Star

Code samples for the Lightbend tutorial on writing microservices with Akka Streams, Kafka Streams, and Kafka

akka kafka-streams model-serving

Updated May 30, 2019
Scala

eightBEC / fastapi-ml-skeleton

Star

FastAPI Skeleton App to serve machine learning models production-ready.

python machine-learning python3 model-serving fastapi

Updated Aug 29, 2020
Python

spotify / zoltar

Star

Common library for serving TensorFlow, XGBoost and scikit-learn models in production.

java machine-learning tensorflow xgboost model-serving

Updated Feb 13, 2021
Java

FlinkML / flink-jpmml

Star

flink-jpmml is a fresh-made library for dynamic real time machine learning predictions built on top of PMML standard models and Apache Flink streaming engine

prediction apache-flink pmml model-serving flink-jpmml

Updated May 9, 2019
Scala

FederatedAI / FATE-Serving

Star

A scalable, high-performance serving system for federated learning models

machine-learning fate model-serving model-versioning federated-learning

Updated Feb 5, 2021
Java

lightbend / model-serving-tutorial

Star

Code and presentation for Strata Model Serving tutorial

kafka spark tensorflow akka-streams pmml flink tensorflow-serving model-serving

Updated Sep 26, 2019
Scala

typesafehub / fdp-modelserver

Star

An umbrella project for multiple implementations of model serving

kafka akka-http tensorflow spark-streaming akka-streams pmml flink kafka-streams spark-ml model-serving

Updated Sep 18, 2017
Scala

messense / fasttext-serving

Star

fastText model serving service

nlp fasttext model-serving model-server

Updated Jan 16, 2021
Rust

alvarobartt / serving-pytorch-models

Star

Serving PyTorch models with TorchServe 🔥

machine-learning pytorch image-classification model-deployment model-serving pytorch-cnn mlops torchserve

Updated Feb 11, 2021
Jupyter Notebook

bentoml / gallery

Star

BentoML Example Projects Gallery

data-science machine-learning gallery aws-lambda serverless machine-learning-library model-management azure-machine-learning model-deployment model-serving machine-learning-workflow gcp-cloud-functions aws-sagemaker bentoml

Updated Feb 14, 2021
Jupyter Notebook

notAI-tech / fastDeploy

Star

Deploy DL/ ML inference pipelines with minimal extra code.

docker deep-learning gunicorn pytorch falcon http-server gevent tensorflow-serving model-deployment model-serving serving tf-serving torchserve

Updated Oct 28, 2020
Python

yuruofeifei / mms

Star

MXNet Model Serving

mxnet model-serving

Updated Oct 4, 2017
Python

model_deployment

balavenkatesh3322 / model_deployment

Star

A collection of model deployment library and technique.

aws data-science machine-learning caffe deep-learning neural-network mxnet azure tensorflow model keras pytorch model-deployment model-serving serving serving-recommendation model-server serving-pytorch-models serving-tensors

Updated Jul 22, 2020

ml-libs / mlserve

Star

mlserve turns your python models into RESTful API, serves web page with form generated to match your input data.

machine-learning scikit-learn model-deployment model-serving mlserve

Updated Dec 11, 2020
Python

lightbend / kubeflow-recommender

Star

Kubeflow example of machine learning/model serving

machine-learning model-serving kubeflow

Updated Jan 11, 2020
Jupyter Notebook

a2i2 / surround

Star

Open

Create surround project template inside existing repo

AkshatBajaj commented Mar 23, 2020

@zacbrannelly Not sure if this is possible in the current released version, so creating this just to keep track.

Read more

enhancement good first issue

Open

Update tagged topics and change python to python3

Open

Ensure setup.py is up-to-date

Find more good first issues →

FlinkML / flink-modelServer

Star

Generic Model Serving Implementation leveraging Flink

stream tensorflow model pmml flink model-serving

Updated Jan 3, 2019
Java

titus2

animator / titus2

Star

Titus 2 : Portable Format for Analytics (PFA) implementation for Python 3.4+

python analytics inference scoring pmml scoring-engine pfa model-evaluation pfa-standard inference-engine model-deployment model-serving ml-engine titus

Updated Sep 23, 2020
Python

h2oai / dai-deployment-templates

Star

Production ready templates for deploying Driverless AI (DAI) scorers.

machine-learning mojo h2o h2oai model-deployment model-serving model-server

Updated Jan 28, 2021
Java

typesafehub / fdp-beam-modelServer

Star

Model serving using Beam

beam model-serving

Updated Jan 6, 2018
Scala

lightbend / pipelines-model-serving

Star

Implementation of Model serving in pipelines

pipelines model-serving

Updated Nov 11, 2019
Scala

Rishit-dagli / TFServing-Demos

Star

TF Serving demos

tensorflow jupyter-notebook python3 tensorflow-serving model-serving tensorflow-model-server tensorflow2

Updated Oct 21, 2020
Jupyter Notebook

FlinkML / flink-speculative-modelServer

Star

Speculative model serving with Flink

streaming tensorflow flink model-serving

Updated Sep 24, 2018
Scala

marekgalovic / photon

Star

ML model serving service.

machine-learning real-time grpc model-serving

Updated Sep 27, 2017
Go

lightbend / fdp-speculative-model-serving

Star

Experimental implementation of speculative model serving

akka-http akka-streams akka-actors model-serving speculative-execution

Updated May 30, 2019
Scala

huyhoang17 / tensorflow-serving-docker

Star

Tensorflow Serving with Docker / Docker Compose

docker flask protobuf docker-compose tensorflow keras tensorflow-serving model-deployment model-serving protos

Updated Jan 27, 2020
Python

kemingy / ventu

Star

Serving the deep learning models easily.

python deep-learning inference model-serving

Updated Jul 14, 2020
Python

Improve this page

Add a description, image, and links to the model-serving topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the model-serving topic, visit your repo's landing page and select "manage topics."