Skip to content
#

gpt

Here are 65 public repositories matching this topic...

transformers
tokenizers
sai-prasanna
sai-prasanna commented Jan 23, 2020

Spacy has customizable word level tokenizers with rules for multiple languages. I think porting that to rust would add nicely to this package. Having a customizable uniform word level tokenization across platforms (client web, server) and languages would be beneficial. Currently, idk any clean way or whether it's even possible to write bindings for spacy cython.

Spacy Tokenizer Code

https:

transfer-learning-conv-ai
jb33k
jb33k commented Jun 4, 2019

I'm playing around with this wonderful code but I'm running into a curious issue when I try to train the model with my own data.

I replicated the personachat_self_original.json file structure and added my own data. I deleted dataset_cache_OpenAIGPTTokenizer file but when I try to train, I get this error:

INFO:train.py:Pad inputs and convert to Tensor
Traceback (most recent call last)
behrmann
behrmann commented Sep 27, 2019

Running a current mypy on mkosi gives the following warnings

mkosi:968: error: Argument 1 to "partition" has incompatible type "Optional[str]"; expected "str"
mkosi:971: error: Argument 1 to "partition" has incompatible type "Optional[str]"; expected "str"
mkosi:4624: error: "Dict[str, CommandLineArguments]" has no attribute "director

The last line is harmless and addressed in #36

adaptnlp
pahund
pahund commented Mar 22, 2019

If you try to render ads without an ad unit path being present either in the global config or slot config, react-prebid will happily try to initialize GPT slots, prompting an error from the gpt.js library, e.g.:

Exception in queued GPT command TypeError: "slot is null"

Validate if an ad unit path is provided and give the developers a useful error message in this case.

Improve this page

Add a description, image, and links to the gpt topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the gpt topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.