Skip to content

Issues: FMInference/FlexGen

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

26 Open 27 Closed
26 Open 27 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

interesting you can crop 65b
#103 opened Mar 24, 2023 by seoeaa
Is FlexGen+GPTQ 4bit possible?
#101 opened Mar 19, 2023 by BarfingLemurs
1
Support for ChatGLM
#100 opened Mar 14, 2023 by AldarisX
ValueError: Invalid model name: galactica-30b
#99 opened Mar 10, 2023 by vmajor
Question about the num-gpu-batches and gpu-batch-size
#98 opened Mar 10, 2023 by young-chao
Question about allocations among different memory hierarchies
#97 opened Mar 10, 2023 by aakejiang
Questions about the intermediate tensor buffers design
#92 opened Mar 6, 2023 by Dazz993
Soft lockup after running flex_opt
#86 opened Mar 2, 2023 by zhang677
1
is cpu peak_mem monitoring work?
#81 opened Mar 1, 2023 by dlfrnaos19
2
AttributeError: 'OptLM' object has no attribute 'weight_home'
#75 opened Feb 28, 2023 by shadowcz007
5
opt-175b model how to load model from disc.
#73 opened Feb 27, 2023 by prof-schacht
2
Soft Label of Flexgen enhancement New feature or request
#67 opened Feb 25, 2023 by 2003pro
1
Is LLaMa supported? enhancement New feature or request
#60 opened Feb 24, 2023 by NightMachinery
26
Update documentation to explicitly describe compatability/performance with early Pascal cards help wanted Extra attention is needed
#55 opened Feb 23, 2023 by tensiondriven
6
FLAN-T5 XXL compatibility enhancement New feature or request
#49 opened Feb 23, 2023 by estoldy
1
Pytorch-Lightning strategy enhancement New feature or request
#42 opened Feb 22, 2023 by k-sparrow
2
ValueError: cannot reshape array of size 0 into shape (7168,28672) help wanted Extra attention is needed
#41 opened Feb 22, 2023 by progressionnetwork
1
Add Erebus and GALACTICA support good first issue Good for newcomers
#40 opened Feb 22, 2023 by Sumanai
6
[Multi-line Chatbot] Multiple line chat answers cut off? enhancement New feature or request
#36 opened Feb 22, 2023 by SoftologyPro
3
Just a suggestion: Think about what Automatic1111 did to Stable Diffusion enhancement New feature or request
#34 opened Feb 22, 2023 by cmp-nct
2
something wrong in the google colab
#26 opened Feb 21, 2023 by azoth07
Doesn't seem to obey --path argument, instead try to download to .cache again help wanted Extra attention is needed
#20 opened Feb 21, 2023 by hsaito
3
Suggestion: Add support for different decoding strategies (Top P) enhancement New feature or request
#19 opened Feb 21, 2023 by anujnayyar1
1
Suggestion: Add Bloom support enhancement New feature or request
#17 opened Feb 21, 2023 by robinsongh381
1
Suggestion: Add GPT-NeoX 20B support enhancement New feature or request
#9 opened Feb 21, 2023 by ElleLeonne
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.