What is the problem?

Ray version and other system information (Python version, TensorFlow version, OS):

• Ray nightly

Reproduction (REQUIRED)

Please provide a short code snippet (less than 50 lines if possible) that can be copy-pasted to reproduce the issue. The snippet should have **no e

Short description

VW does not accept cache files that were created with a different vw version e.g. a cache file that was created with vw version 8.9 will not be accepted when running vw version 8.10. However the error message is not very helpful when this happens:

WARNING: cache file is ignored as it's made with less bit precision than required!

version cache compatibility is checke

Is there a way to train a bidirectional RNN (like LSTM or GRU) on trax nowadays?

The following applies to DDPG and TD3, and possibly other models. The following libraries were installed in a virtual environment:

numpy==1.16.4
stable-baselines==2.10.0
gym==0.14.0
tensorflow==1.14.0

Episode rewards do not seem to be updated in model.learn() before callback.on_step(). Depending on which callback.locals variable is used, this means that:

• episode rewards may n