Skip to content

/ multi-model-server

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

60 Open 312 Closed
60 Open 312 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels.
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀
Wrong version of ONNX as requirement of model-archiver[onnx]
#962 opened Jan 29, 2021 by tbagrel1
Allow custom HTTP status in mms.service.Service
#961 opened Nov 19, 2020 by jcsaaddupuy
1
Process run on a single CPU core
#960 opened Nov 16, 2020 by ngoanpv
1
For multithreaded inferencing on GPU machine, with preload_model=True and default_workers_per_model=2 getting the following error
#959 opened Nov 11, 2020 by msameedkhan
Dependencies not installed in docker.
#958 opened Nov 2, 2020 by bahar3474
s3 path in tutorial is not available
#956 opened Oct 16, 2020 by HahTK
Slack link not working.
#954 opened Oct 15, 2020 by azmaktr
tensor_gpu-inl.h:35: Check failed: e == cudaSuccess: CUDA: initialization error
#953 opened Oct 15, 2020 by wdh234
define inference proto
#951 opened Oct 14, 2020 by lxning
1
@lxning
1
Permission denied when loading model
#949 opened Oct 13, 2020 by akulk314
Detect video
#947 opened Oct 10, 2020 by wdh234
[Q] GPU support
#938 opened Aug 17, 2020 by oonisim
ONNX to .MAR converter test case fails.
#936 opened Aug 5, 2020 by quantum-fusion
@maaquib
6
Slack invite link is broken
#935 opened Aug 4, 2020 by tekumara
Netty does not allow \r \n in the reasonPhrase and MMS fails to handle responses which have \r and \n in the reasonPhrase bug
#933 opened Jul 31, 2020 by ashishgupta023
Deploying as a Sagemaker Model
#932 opened Jul 27, 2020 by shawnhan108
Issues with deploying inference model with sklearn Sagemaker container
#929 opened Jul 14, 2020 by sertaco
SageMaker fails to register model archive in .tar.gz format for MMS running behind a multi-model endpoint
#928 opened Jul 10, 2020 by dean-cpi
4
the document figure is missing for entrypoint configuration
#923 opened Jun 26, 2020 by flamingofugang
Does Multi-model-server support Batch Transform?
#922 opened Jun 18, 2020 by yinsong1986
2
Is it possible to serve Gluon-TS model by using multi-model-server
#921 opened Jun 14, 2020 by islama-lh
Improve description of MMS
#920 opened Jun 10, 2020 by hasanp87
Scaling down workers to 0 and back up again throws exception bug
#916 opened May 18, 2020 by maaquib
1
inference with standalone or distributed mode?
#914 opened May 10, 2020 by PayneJoe
Make the temp directory/book-keeping information directory configurable
#913 opened May 6, 2020 by vdantu
ProTip! Type g i on any issue or pull request to go back to the issue listing page.