General technology for enabling AI capabilities w/ LLMs and MLLMs

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model

Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

Recent Advances in Vision and Language PreTrained Models (VL-PTMs)

X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).

Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper

EntitySeg Toolbox: Towards Open-World and High-Quality Image Segmentation

Official Repository for the Uni-Mol Series Methods

Best practice for training LLaMA models in Megatron-LM

【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment

PITI: Pretraining is All You Need for Image-to-Image Translation

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。

[ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links

End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service

BigDetection: A Large-scale Benchmark for Improved Object Detector Pre-training

PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)

An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"

A Chinese Open-Domain Dialogue System