Last active
April 19, 2023 04:06
-
-
Save muellerzr/0634c486bd4939049314632ccc3f7a03 to your computer and use it in GitHub Desktop.
LR Suggestors.ipynb
Hi ! First of all nice work !
A small bug in the .py
file. Shouldn’t this line
lrs, losses = tensor(learn.recorder.lrs[num_it//10:-5]), tensor(learn.recorder.losses[num_it//10:-5])
be
lrs, losses = tensor(self.recorder.lrs[num_it//10:-5]), tensor(self.recorder.losses[num_it//10:-5])
Yes it should be! Thank you!
@muellerzr not sure if there is a bug but slide
doesn't match with my expectation following the description (note that i can't sweep to a higher lr as i get nans then)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
All the relevant code as a
.py
can be copied from here: