Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

resuming training #663

Open
redhood95 opened this issue Sep 14, 2020 · 9 comments
Open

resuming training #663

redhood95 opened this issue Sep 14, 2020 · 9 comments

Comments

@redhood95
Copy link

@redhood95 redhood95 commented Sep 14, 2020

How do i resume training for text classification?

@Innixma
Copy link
Collaborator

@Innixma Innixma commented Sep 15, 2020

Can you clarify if you mean TextPrediction or TextClassification? TextClassification is a deprecated task and TextPrediction should be used instead (as of 0.0.13).

@redhood95
Copy link
Author

@redhood95 redhood95 commented Sep 16, 2020

I mean TextPrediction.

@Innixma
Copy link
Collaborator

@Innixma Innixma commented Sep 16, 2020

@sxjscience Could you answer?

@sxjscience
Copy link
Collaborator

@sxjscience sxjscience commented Sep 17, 2020

@redhood95 There are two scenarios for resuming a trained model: 1) After you have accidentally killed the job, we may resume the training. 2) We load a trained model and continue the training process with a new sets of hparams, or on a new dataset. Which one is your use case? For now, we cannot resume training but I can add the functionality.

@redhood95
Copy link
Author

@redhood95 redhood95 commented Sep 18, 2020

i need to resume training on previous weights for the same dataset, please let me know if its possible. and the two scenarios @sxjscience mentioned how can i resume training when i killed it accidentally.

@redhood95
Copy link
Author

@redhood95 redhood95 commented Sep 20, 2020

hey, if it's okay can I work on adding this feature, for all tasks that are present currently?

@sxjscience
Copy link
Collaborator

@sxjscience sxjscience commented Sep 20, 2020

@redhood95 We are more than welcome for any contributions to AutoGluon. Adding the second functionality (load a trained model and call .fit() again) in TextPrediction is not very difficult. We will need to extend the loaded predictor

@use_np
class BertForTextPredictionBasic:
to support .fit(). Actually, you may try to join our slack channel to discuss more. Also ping @Innixma .

@redhood95
Copy link
Author

@redhood95 redhood95 commented Sep 20, 2020

@sxjscience where can I join the slack channel?

@sxjscience
Copy link
Collaborator

@sxjscience sxjscience commented Sep 21, 2020

@redhood95 I removed the previous slack invitation. For those who are willing to obtain the slack invitation, just send emails to me or other developers in AutoGluon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants