Skip to content

Apply grad limit for CTC training#1793

Open
csukuangfj wants to merge 5 commits intok2-fsa:masterfrom
csukuangfj:limit-grad
Open

Apply grad limit for CTC training#1793
csukuangfj wants to merge 5 commits intok2-fsa:masterfrom
csukuangfj:limit-grad

Conversation

@csukuangfj
Copy link
Copy Markdown
Collaborator

@csukuangfj csukuangfj commented Oct 30, 2024 •
edited
Loading

Dan: It's basically about zeroing out or scaling down the gradient if we have recenty "moved too far" in the direction that the gradient is pushing us.

TODOs

  • Update results

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@csukuangfj