You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently resume only reads the weights from an existing model and starts training with them instead of randomly initialized weights. This is only partially correct. Ideally, we would save all the states of training in a checkpoint file and resume training exactly where we left off (including lr, random seed, same batch etc)
The text was updated successfully, but these errors were encountered:
Currently resume only reads the weights from an existing model and starts training with them instead of randomly initialized weights. This is only partially correct. Ideally, we would save all the states of training in a checkpoint file and resume training exactly where we left off (including lr, random seed, same batch etc)
The text was updated successfully, but these errors were encountered: