Commit 691863b
committed
changed the weight initialization for to_q, to_k, and to_v from (embed, heads) to (None, heads)
1 parent 0a36e73 commit 691863b
1 file changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
358 | 358 | | |
359 | 359 | | |
360 | 360 | | |
361 | | - | |
| 361 | + | |
362 | 362 | | |
363 | 363 | | |
364 | 364 | | |
| |||
0 commit comments