bert
Here are 984 public repositories matching this topic...
-
Updated
Aug 20, 2020 - Python
-
Updated
Aug 15, 2020 - Jupyter Notebook
-
Updated
Dec 1, 2019
-
Updated
Sep 4, 2020 - Python
chooses 15% of token
From paper, it mentioned
Instead, the training data generator chooses 15% of tokens at random, e.g., in the sentence my
dog is hairy it chooses hairy.
It means that 15% of token will be choose for sure.
From https://github.com/codertimo/BERT-pytorch/blob/master/bert_pytorch/dataset/dataset.py#L68,
for every single token, it has 15% of chance that go though the followup procedure.
PositionalEmbedding
-
Updated
Sep 11, 2020 - Rust
-
Updated
Sep 11, 2020 - Python
-
Updated
Aug 17, 2020 - Python
-
Updated
Apr 20, 2020 - Python
-
Updated
Sep 12, 2020 - Python
-
Updated
Sep 8, 2020 - Jupyter Notebook
-
Updated
May 9, 2020 - Jupyter Notebook
-
Updated
Jul 29, 2020 - Python
-
Updated
Jul 28, 2020 - Python
-
Updated
Sep 11, 2020 - Python
-
Updated
Sep 11, 2020 - Python
-
Updated
Aug 4, 2020 - Python
-
Updated
Sep 11, 2020 - Scala
-
Updated
Oct 23, 2019
-
Updated
Sep 2, 2020 - Python
-
Updated
Jun 29, 2020 - Python
-
Updated
Mar 1, 2020 - Python
-
Updated
Aug 16, 2020 - Erlang
-
Updated
Sep 4, 2020 - Jupyter Notebook
-
Updated
Jul 15, 2020 - Python
-
Updated
Aug 6, 2020 - Python
Describe the feature
I think enforcing typing in methods parameters can be helpful for robustness, readability and stability of the code.
By using mypy static type checker, we can see potential improvements for jina:
Usage:
pip install mypy
mypy --ignore-missing-imports jinaDo not get overwhelmed by the errors. Let's slowly keep improving until we can eve
-
Updated
Sep 1, 2020 - JavaScript
If I want to use both of them, how to modify code in aen.py? Thanks a lot.
Improve this page
Add a description, image, and links to the bert topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the bert topic, visit your repo's landing page and select "manage topics."
Currently we have a mixture of negative and positive formulated arguments, e.g.
no_cudaandtraininghere: https://github.com/huggingface/transformers/blob/0054a48cdd64e7309184a64b399ab2c58d75d4e5/src/transformers/benchmark/benchmark_args_utils.py#L61.We should change all arguments to be positively formulated, *e.g. from
no_cudatocuda. These arguments should