foundation-models

Making large AI models cheaper, faster and more accessible

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

[CVPR 2023] EVA: Exploring the Limits of Masked Visual Representation Learning at Scale (https://arxiv.org/abs/2211.07636)

InternVideo: General Video Foundation Models via Generative and Discriminative Learning (https://arxiv.org/abs/2212.03191)

PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529

Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"

This repository holds code and other relevant files for the NeurIPS 2022 tutorial: Foundational Robustness of Foundation Models.

Self-supervised learning for wearables using the UK-Biobank (>700,000 person-days)

MelXior: a Neural Weather Forecasting app distilling knowledge from models including GPT-3, DALL-E and FourCastNet

FEMR (Framework for Electronic Medical Records) provides tooling for large-scale, self-supervised learning using electronic health records

Object Detection with Vision-Language Pre-training

Official implementation for CVPR '23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"