Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Modifying learning rate for fine tuning #530

Open
stevenjnovotny opened this issue Jun 27, 2024 · 0 comments
Open

Modifying learning rate for fine tuning #530

stevenjnovotny opened this issue Jun 27, 2024 · 0 comments

Comments

@stevenjnovotny
Copy link

stevenjnovotny commented Jun 27, 2024

I am attempting to fine tune a ljspeech model using 26hrs of voice data. I want to tune slowly, thus I modified the learning rate in the lightning.py file. I also added a LearningRateMonitor as a callback for the trainer. In addition, I set auto_lr_find to False.

What happens:

  • the version yaml files shows the modified value for lr correctly
  • the lr monitor functions correctly
  • no matter what I set as the lr, the monitor shows 1.25e-4 as the initial learning rate

Am I setting the lr incorrectly? Is there a better way to modify the learning rate for slow fine tuning?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant