awslabs / multi-model-server

Watch 40
Star 712
Fork 191

Code
Issues 50
Pull requests 9
Actions
Security
Insights

Code
Issues
Pull requests
Actions
Security
Insights

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Pick a username

Email Address

Password

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

50 Open 310 Closed

Author

Filter by author

Label

Filter by label

Use alt + click/return to exclude labels.

Projects

Filter by project

Milestones

Filter by milestone

Assignee

Filter by who’s assigned

Sort

Sort by

Newest Oldest Most commented Least commented Recently updated Least recently updated

Most reactions

Is it possible to implement multi-stage inferences?

#939 opened Aug 17, 2020 by bedilbek

[Q] GPU support

#938 opened Aug 17, 2020 by oonisim

ONNX to .MAR converter test case fails.

#936 opened Aug 5, 2020 by quantum-fusion

Slack invite link is broken

#935 opened Aug 4, 2020 by tekumara

Netty does not allow \r \n in the reasonPhrase and MMS fails to handle responses which have \r and \n in the reasonPhrase bug

#933 opened Jul 31, 2020 by ashishgupta023

Deploying as a Sagemaker Model

#932 opened Jul 27, 2020 by shawnhan108

Issues with deploying inference model with sklearn Sagemaker container

#929 opened Jul 14, 2020 by sertaco

SageMaker fails to register model archive in .tar.gz format for MMS running behind a multi-model endpoint

#928 opened Jul 10, 2020 by dean-cpi

the document figure is missing for entrypoint configuration

#923 opened Jun 26, 2020 by flamingofugang

Does Multi-model-server support Batch Transform?

#922 opened Jun 18, 2020 by yinsong1986

Is it possible to serve Gluon-TS model by using multi-model-server

#921 opened Jun 14, 2020 by islama-lh

Improve description of MMS

#920 opened Jun 10, 2020 by hasanp87

Scaling down workers to 0 and back up again throws exception bug

#916 opened May 18, 2020 by maaquib

inference with standalone or distributed mode?

#914 opened May 10, 2020 by PayneJoe

Make the temp directory/book-keeping information directory configurable

#913 opened May 6, 2020 by vdantu

MXNet model service inference iteration possible bug

#912 opened Apr 27, 2020 by hassonofer

model-server-worker fails without "optional" arguments

#909 opened Apr 24, 2020 by johncolby

A missing line of command in documentation

#907 opened Apr 2, 2020 by chenw23

Non-nightly pre-built Docker base images are missing

#905 opened Mar 24, 2020 by X455u

config MMS to process the newest request only

#902 opened Mar 12, 2020 by carter54

Controlling multiple copies of same model within multi-model-server

#901 opened Feb 17, 2020 by Kuntal-G

Quick start problem of getting result from MMS

#897 opened Feb 5, 2020 by chenw23

MemoryError handling

#896 opened Feb 2, 2020 by davidas1

Scaling with min_worker=0 removes worker but process is still up (and even restarting itself)

#895 opened Jan 28, 2020 by davidas1

Github releases are not tracking the PyPi releases

#892 opened Jan 18, 2020 by vdantu

Previous 1 2 Next

Previous Next

ProTip! no:milestone will show everything without a milestone.