Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
Support multiple ML models #2001
Comments
|
@mbarbella-chromium Marty do you want to own this? Once GradientFuzz starts working, it might make sense to figure out a good solution for adding any new models in future. |
|
Yeah, that makes sense to me. |
Seems like we'll have at least two more models added, and one of them supports several different model types (rnn, gpt, vae, etc).
We need to think on how to schedule trainings for those. I don't want to introduce a new cron for every single type, but at the same time we can't afford training all of them at the same time -- or maybe we can? The models will be updated less often, but that's fine. And for the initial deployment we may temporarily create more GPU bots.
Similar problem on the generation side. This should be easier, as we can have multiple strategies instead of the single ML_RNN that we have right now.