transformer
Here are 977 public repositories matching this topic...
-
Updated
Oct 20, 2020 - Jupyter Notebook
Bidirectional RNN
Is there a way to train a bidirectional RNN (like LSTM or GRU) on trax nowadays?
-
Updated
Feb 4, 2021 - Python
chooses 15% of token
From paper, it mentioned
Instead, the training data generator chooses 15% of tokens at random, e.g., in the sentence my
dog is hairy it chooses hairy.
It means that 15% of token will be choose for sure.
From https://github.com/codertimo/BERT-pytorch/blob/master/bert_pytorch/dataset/dataset.py#L68,
for every single token, it has 15% of chance that go though the followup procedure.
PositionalEmbedding
-
Updated
Jan 3, 2021 - Python
-
Updated
Nov 13, 2020 - Python
-
Updated
May 3, 2017 - Java
-
Updated
Dec 14, 2020 - JavaScript
-
Updated
Jan 18, 2021 - Jupyter Notebook
-
Updated
Jan 30, 2021 - Jupyter Notebook
-
Updated
Feb 7, 2019 - Python
-
Updated
May 16, 2020 - Python
-
Updated
Dec 4, 2020 - Python
-
Updated
Feb 5, 2021 - Python
-
Updated
Feb 4, 2021 - Java
-
Updated
Dec 19, 2020 - Python
-
Updated
Jul 26, 2019 - Python
Hi, I am so interesting in your project, and wonder if you need contributor and how could I make my own contribution?
-
Updated
Dec 25, 2020 - Python
-
Updated
Jan 23, 2021 - Jupyter Notebook
-
Updated
May 12, 2020 - Java
-
Updated
Jan 21, 2021 - Python
-
Updated
Nov 15, 2019 - Python
-
Updated
Jan 7, 2021 - Python
-
Updated
Dec 11, 2020 - TypeScript
-
Updated
Jun 1, 2020
-
Updated
Jan 19, 2021
-
Updated
May 7, 2020 - Python
Improve this page
Add a description, image, and links to the transformer topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the transformer topic, visit your repo's landing page and select "manage topics."
The TensorFlow implementation of the LXMERT model currently has no integration tests. This is problematic as the behavior can diverge without being noticed.
The test_modeling_tf_lxmert.py file should be updated to include integration testing.
An example of a good modeling integration test is visible i