当前位置：网站首页>Code implementation of various kinds of attention

Code implementation of various kinds of attention

2022-08-08 09:32:00 【51CTO】

base attention
dot attention
mlp attention
multihead attention
no attention
pooling attention
https://github.com/pytorch/translate/tree/master/pytorch_translate/attention

attention
bilinear attention
cosine attention
dot product attention
legacy attention
linear attention
https://github.com/allenai/allennlp/tree/master/allennlp/modules/attention

intra sentence attention
multi head self attention
stacked self attention
https://github.com/allenai/allennlp/tree/master/allennlp/modules/seq2seq_encoders

bilinear matrix attention
cosine matrix attention
dot product matrix attention
legacy matrix attention
linear matrix attention
matrix attention
https://github.com/allenai/allennlp/tree/master/allennlp/modules/matrix_attention

版权声明
本文为[51CTO]所创，转载请带上原文链接，感谢
https://yzsam.com/2022/220/202208080907296437.html

边栏推荐

猜你喜欢

随机推荐