Issues

[Residual Connection] Commons

jinmang2/AdvancedTransformers#18 · opened

on Jun 21, 2022

[Activation Function] GeLU + Commons

jinmang2/AdvancedTransformers#16 · opened

on Jun 21, 2022

2

[Positional Embedding] Patch Embedding

jinmang2/AdvancedTransformers#15 · opened

on Jun 20, 2022

[Feed Forward Network] DeBERTa

jinmang2/AdvancedTransformers#14 · opened

on Jun 20, 2022

[Feed Forward Network] Commons

jinmang2/AdvancedTransformers#13 · opened

on Jun 20, 2022

1

[Positional Embedding] Sinusoidal Encoding

jinmang2/AdvancedTransformers#12 · opened

on Apr 12, 2022

[Positional Embedding] DeBERTa

jinmang2/AdvancedTransformers#11 · opened

on Apr 12, 2022

[Positional Embedding] TUPE

jinmang2/AdvancedTransformers#10 · opened

on Apr 12, 2022

[Positional Embedding] Transformer-XL

jinmang2/AdvancedTransformers#9 · opened

on Apr 12, 2022

[Positional Embedding] T5-Bias

jinmang2/AdvancedTransformers#8 · opened

on Apr 12, 2022

[Positional Embedding] Axial Positional Embedding

jinmang2/AdvancedTransformers#7 · opened

on Apr 12, 2022

[Positional Embedding] Shaw's RPE

jinmang2/AdvancedTransformers#6 · opened

on Apr 12, 2022

[Positional Embedding] Rotary Embedding

jinmang2/AdvancedTransformers#5 · opened

on Apr 12, 2022

1

[Positional Embedding] Attention with Linear Biases

jinmang2/AdvancedTransformers#4 · opened

on Apr 12, 2022

Navigation Menu

Repository navigation

Issues

[Residual Connection] Commons

[Activation Function] GeLU + Commons

[Positional Embedding] Patch Embedding

[Feed Forward Network] DeBERTa

[Feed Forward Network] Commons

[Positional Embedding] Sinusoidal Encoding

[Positional Embedding] DeBERTa

[Positional Embedding] TUPE

[Positional Embedding] Transformer-XL

[Positional Embedding] T5-Bias

[Positional Embedding] Axial Positional Embedding

[Positional Embedding] Shaw's RPE

[Positional Embedding] Rotary Embedding

[Positional Embedding] Attention with Linear Biases