Skip to content
#

torchtext

Here are 51 public repositories matching this topic...

TomasAndersonFang
TomasAndersonFang commented Mar 24, 2020

I add a function(according the code in the tutorial4) to calculate the bleu score, but i get the vey low score(0.09), could you tell me why?
This is code to calculate bleu:

def translate_sentence(sentence, src_field, trg_field, model, device, max_len = 50):
    
    model.eval()
        
    if isinstance(sentence, str):
        nlp = spacy.load('de')
        tokens = [token.te

基于Pytorch和torchtext的自然语言处理深度学习框架,包含序列标注、文本分类、句子关系、文本生成、结构分析、五大功能模块,已实现了命名实体识别、中文分词、词性标注、语义角色标注、情感分析、关系抽取、语言模型、文本相似度、文本蕴含、依存句法分析、词向量训练、聊天机器人、机器翻译、文本摘要等功能。框架功能丰富,开箱可用,极易上手!基本都是学习他人实现然后自己修改融合到框架中,没有细致调参,且有不少Bug~

  • Updated Jan 10, 2020
  • Python

Improve this page

Add a description, image, and links to the torchtext topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the torchtext topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.