Repository navigation
Parakeet tdt #44171
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Parakeet tdt #44171
Changes from 7 commits
fa7d6e0
f2b4938
fa36657
05e2e34
bb5ff33
9ec79b0
33f128e
760b4b6
b33002f
48b39dd
e9f23ab
e2b97aa
6b9fc73
6c879bc
149e17f
36bfa63
2df0ccc
388c6d3
08b2b55
0c4e05a
1ddd804
f512670
07d8e35
fab050a
c438565
86d980c
895c4a0
ab21380
d0141d5
f7529d4
77b95d7
94eae66
f7d4067
f75c17b
5a49b65
881233f
b41a8ee
897753a
6c914db
756cee1
f30c536
fa95fc8
5df7f28
cd706d4
a47ed8a
13b68ce
72c1ad0
8e23b3d
1cc39fd
531f297
2c0f23a
cef6639
fd3cf9b
e63a5bf
f9d1a4f
43ee7cd
c2a0f78
1fd7ed7
7cc9d2e
e753eab
ed3fa4d
ab66b23
a5ba0c6
48279a6
1d7680d
59ddced
31490d1
d8eb1b6
1f1b912
9ab08d1
fd9f8b1
136f676
833d289
a1c62a1
8683570
1d4b0f4
a418eca
5d0c631
5c603c1
88810b9
00111b3
c2e2287
a969bc7
bd2ae42
f978098
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. curious about why you needed?
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Otherwise I was getting this error during checkpoint conversion (on tokenizers==0.22.2)
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Yeah, but I don't think the PB is here, maybe more in
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I removed the change in the base class I tried converting the CTC model (already merged) and it was also failing because of logic in Maybe something changed with |
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -2280,6 +2280,12 @@ def _init_weights(self, module): | |
| init.normal_(module.weight, mean=0.0, std=std) | ||
| if module.bias is not None: | ||
| init.zeros_(module.bias) | ||
| elif isinstance(module, nn.LSTM): | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. ok! |
||
| for name, param in module.named_parameters(): | ||
| if "weight" in name: | ||
| init.xavier_uniform_(param) | ||
| elif "bias" in name: | ||
| init.constant_(param, 0.0) | ||
| elif isinstance(module, nn.Embedding): | ||
| init.normal_(module.weight, mean=0.0, std=std) | ||
| # Here we need the check explicitly, as we slice the weight in the `zeros_` call, so it looses the flag | ||
|
|
||
Uh oh!
There was an error while loading. Please reload this page.