feifeibear Follow

Jiarui Fang feifeibear

Follow

Cofounder of HPC-AI TECH. Ex @Tencent Wechat AI.

200 followers · 62 following

HPC-AI TECH
Beijing, China
https://fangjiarui.github.io/

Achievements

Achievements

Organizations

Block or Report

Block or report feifeibear

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

feifeibear/README.md

GitHub Stats

Pinned

hpcaitech/ColossalAI Public

Colossal-AI: A Unified Deep Learning System for Big Model Era

Python 3.3k 370
Tencent/PatrickStar Public

PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.

Python 587 48
Tencent/TurboTransformers Public

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

C++ 1.2k 157
swGEMM Public

A highly efficient library for GEMM operations on Sunway TaihuLight

C 10 3
swDNNv1.0 Public

A Deep Learning Library for Sunway TaihuLight

C 4 2
SWCaffe Public

A Deep Learning Framework customized for Sunway TaihuLight

C++ 35 18

1,619 contributions in the last year

Learn how we count contributions

Less More

NEW! View your contributions in 3D, VR and IRL!

Activity overview

Contributed to Tencent/PatrickStar, hpcaitech/ColossalAI, hpcaitech/PaLM-colossalai and 33 other repositories

Contribution activity

May 2022

Created 8 commits in 3 repositories

Created 1 repository

feifeibear/transformers Python May 6

Created a pull request in hpcaitech/ColossalAI that received 14 comments

[Graph] building computing graph with ColoTensor, Linear only

Conduction a forward pass under the GraphContext() to build the computing graph. Add graph-building logic in every customize Ops (now just for line…

+202 −9 • 14 comments

Opened 5 other pull requests in 2 repositories

hpcaitech/ColossalAI 4 merged

remove useless import in tensor dir May 18
[Tensor] test pretrain loading on multi-process May 9
[Tensor] polish model test May 6
[Tensor] init ColoParameter May 6

huggingface/transformers 1 open

[bert] An equivalent way to get last_hidden_state tensor but supports ColossalAI well. May 6

Reviewed 15 pull requests in 1 repository

hpcaitech/ColossalAI 15 pull requests

[Tensor] add test checkpoint May 19
[tensor] refactor colo-tensor May 19
[cli] remove unused imports May 18
[release] udpate version May 17
[NFC] update results on a single GPU, highlight quick view May 16
[tensor] design DistSpec and DistSpecManager for ColoTensor May 13
[Tensor] add optimizer to bert test May 13
[Tensor] simplify named param May 11
[tensor] hijack addmm for colo tensor May 9
[Tensor] add from_pretrained support and bert pretrained test May 9
[Graph] building computing graph with ColoTensor, Linear only May 7
[Tensor] add 1d vocab loss May 7
[Tensor] fix test_model May 6
[Tensor] polish model test May 6
[Tensor] add a basic bert. May 6