Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upImplement PyTorch and/or TensorFlow sequence classification architectures for causal language models #7623
Comments
|
Hi @LysandreJik is this issue still open? I'll like to pick it up |
|
I believe @fmcurti is working on the OpenAI GPT implementation, but both CTRL and TransfoXL are still open! Would love a PR! |
|
Hi Lysandre, thanks for assigning this issue to me. I've been trying to
setup transformers on my local machine (Windows 10). I've been having
several issues with the setup.
Is there any guide I could follow?
Thanks much
…On Fri, 9 Oct 2020 at 12:38, Lysandre Debut ***@***.***> wrote:
Assigned #7623 <#7623>
to @pasDamola <https://github.com/pasDamola>.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
<#7623 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AGGRMAH2H4Q5JYISSW23W3LSJ3Y4HANCNFSM4SGSU6FQ>
.
|
|
Sure, have you taken a look at the |
|
Yes I have.
` |
|
I believe the repo cannot be installed from conda as of now, can you use a pip virtual environment? |
|
Alright, I'll try that now |
|
Still having the same error I had while in conda. I'm trying to install tensorflow locally and retry this again |
|
Hi @LysandreJik , I'm still having the same errors running on a pip virtual environment |
|
Do you manage to install |
|
Hi @LysandreJik not yet. I get a similar error. I'm trying to look for solutions on the internet
|
|
Hi @LysandreJik – has anyone picked up the CTRL or TransfoXL architectures yet? I'd love to take a crack at one of them if available. Thank you! |
|
No, feel free to take a crack at it! Let me know and I'll put you in the issue description. |
patrickvonplaten
moved this from In progress
to Good First Issue
in Easy Contribution Proposals - Beginners
The architecture
GPT2ForSequenceClassificationwas added in #7501 in PyTorch. It would be great to have it in TensorFlow (cf. issues #7622), but it would also be great to have it for other causal models:OpenAI GPT, CTRL, TransfoXLCurrently working on OpenAI GPT: @fmcurti(done)Below is a list of items to follow to make sure the integration of such an architecture is complete:
XXXForSequenceClassificationinmodeling_xxx.pyorTFXXXForSequenceClassificationin `modeling_tf_xxx.pytests/test_modeling_xxx.pyortests/test_modeling_tf_xxx.py__init__.pyanddocs/source/model_doc/xxx.rst.Taking a look at the code changes in #7501 would be a good start.
A very good first issue to get acquainted with the library and its architectures!