🚀 Feature request

Add better error message to HubertForCTC, Wav2Vec2ForCTC if labels are bigger than vocab size.

Motivation

Following this issue: huggingface/transformers#12264 it is clear that an error message should be thrown if any of the any of the labels are > self.config.vocab_size or else silent errors can sneak into the training script.

So w

Numpy has a very convenient np.mgrid which allow to easily create coordinate grids: https://numpy.org/doc/stable/reference/generated/numpy.mgrid.html.

I was expecting jax to have the same, but it seems to be missing:

jnp.mgrid  # raise AttributeError

Tracking implementation of these:

• jnp.mgrid #6248
• jnp.ogrid #6342
• jnp.r_ #6593
• `j

Is there a way to train a bidirectional RNN (like LSTM or GRU) on trax nowadays?

Having trace.format_shapes() as in Pyro would help with debugging and verifying models, especially with enumeration, as shown in the Pyro tutorial.

Description

TIL that pip has a super nice Issue template page

that uses a [.github/ISSUE_TEMPLATE/config.yml](https://github.com/pypa/pip/blob/e6414d6db6db37951988f6f2b11ec530ed0b191d/.github/ISSUE_TEMPLATE/conf

See wikipedia table for example patterns: https://en.wikipedia.org/wiki/List_of_integrals_of_Gaussian_functions