Recently, I started writing a small tensor library in C for solving some ML problems at work and also for practicing my C programming. Just for fun, I applied it to a few of the state-of-the-art transformer models that are coming out (GPT-2, GPT-J, Whisper, LLaMA). The performance of the inference and simplicity of the implementation attracted significant interest - something I did not expect at all!
Lately, a lot of people ask me how to support this work financially. At the moment, I am doing this in my free time - just for fun. I am full-time employed and, luckily, I don't need financial support. However, if you really feel like sending some money my way, you can do it here via Github Sponsors.
It will most likely go for buying new Apple Silicon hardware.
Featured work
-
ggerganov/llama.cpp
Port of Facebook's LLaMA model in C/C++
C 29,978 -
ggerganov/whisper.cpp
Port of OpenAI's Whisper model in C/C++
C 19,203 -
ggerganov/ggml
Tensor library for machine learning
C 3,061 -
ggerganov/ggwave
Tiny data-over-sound library
C++ 1,460 -
ggerganov/ggmorse
Morse code decoding library
C++ 131