transformers

Currently Crawler does not let JavaScript run on crawled pages. This leads to issues for websites that rely on fully dynamically loaded content that is not present in the DOM at loading time, but is fetched with JS immediately after.

We should investigate how to allow JavaScript to run on the crawled pages with Selenium and add a switch to the Crawler that allows users to do this.

Based on

欢迎您反馈PaddleNLP使用问题，非常感谢您对PaddleNLP的贡献！
在留下您的问题时，辛苦您同步提供如下信息：

• 版本、环境信息
  1）PaddleNLP和PaddlePaddle版本：请提供您的PaddleNLP和PaddlePaddle版本号，例如PaddleNLP 2.0.4，PaddlePaddle2.1.1
  2）系统环境：请您描述系统类型，例如Linux/Windows/MacOS/，python版本
• 复现信息：如为报错，请给出复现环境、复现步骤

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/machine_translation/transformer
在我们的基于 Transformer 的 Machine Translation 例子中，数据准备这一步奏仅提供了

Describe the bug
When running tools/preprocess_data.py to tokenize my dataset, I was confused why the generated .bin and .idx files were empty. It turns out that lm_dataformat, the library which actually reads the dataset into the tokenization logic, was version 0.0.19 as specified in the requirements.txt file. This version of the library doesn't include support for uncompressed `.jso

Problem
Some of our transformers & estimators are not thoroughly tested or not tested at all.

Solution
Use OpTransformerSpec and OpEstimatorSpec base test specs to provide tests for all existing transformers & estimators.

Hi there.
The app is not launching on ubuntu 21.10 (kernel 5.13.0-39). When running from terminal I get:

Fontconfig warning: "/etc/fonts/conf.d/10-hinting-slight.conf", line 5: unknown element "its:translateRule"
Fontconfig error: "/etc/fonts/conf.d/10-hinting-slight.conf", line 5: invalid