Skip to content
Avatar
🌾
in her natural habitat
🌾
in her natural habitat

Sponsors

@judegomila
@conceptofmind
@gurvindersingh
@dmvaldman
@mathyouf
@recurrence
@jd3655
@rwightman
@madisonmay
Private Sponsor
Private Sponsor
@flancian
@shi3z
Block or Report

Block or report lucidrains

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned

  1. vit-pytorch Public

    Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

    Python 12.5k 2.1k

  2. alphafold2 Public

    To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released

    Python 1.2k 209

  3. Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

    Python 8.5k 701

  4. Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

    Python 5.9k 522

  5. A simple but complete full-attention transformer with a set of promising experimental features from various papers

    Python 2.2k 187

  6. Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

    Python 503 77

4,187 contributions in the last year

Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Mon Wed Fri

Contribution activity

December 2022

Created a pull request in mlfoundations/open_clip that received 27 comments

add patch dropout, as it has been proven out in new Kaiming He paper …

…in the CLIP setting to save a ton of compute and improve end results https://arxiv.org/abs/2212.00794

+65 −0 27 comments
Opened 3 other pull requests in 2 repositories
Reviewed 2 pull requests in 2 repositories
lucidrains/PaLM-rlhf-pytorch 1 pull request
mlfoundations/open_clip 1 pull request

Seeing something unexpected? Take a look at the GitHub profile guide.