Deep learning

Current implementation of Go binding can not specify options.

GPUOptions struct is in internal package. And go generate doesn't work for protobuf directory. So we can't specify GPUOptions for NewSession.

Related to #5142, AlbertTokenizer (which uses SentencePiece) doesn't decode special tokens (like [CLS], [MASK]) properly. This issue was discovered when adding the Nystromformer model (#14659), which uses this tokenizer.

To reproduce (Transformers v4.15 or below):

!pip install -q transformers sentencepiece

from transformers import AlbertTokenizer

tokenizer = AlbertTokenizer.from

🐛 Describe the bug

Currently many tests run in forks but they are expected to fail due to lack of credentials in forks.

This is a bit annoying to contributors:

A failed job example: https://github.com/ppwwyyxx/pytorch/runs/5137367784?check_suite_focus=true

I thin

Problem: If I don't have the necessary backend (e.g. torch) installed, a generic ModuleNotFoundError will be raised.

Reproduction:

>>> from ray.train import Trainer
>>> trainer = Trainer(backend="torch", num_workers=1)
2022-02-13 21:31:08,345	INFO services.py:1414 -- View the Ray dashboard at http://127.0.0.1:8265
2022-02-13 21:31:10,396	INFO trainer.py:199 -- Trainer