Class Token as a Powerful Assistance for Transformer Pretraining

Jingyang Min, Erick Purwanto^*, Su Yang

^*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review

Original language	English
Title of host publication	CICET22: The International Conference on Recent Advancements in Computing in AI, IoT and Computer Engineering Technology
Publication status	Published - Oct 2022

Cite this

@inproceedings{824448e6ede34bb09aebeb3f5751c35b,

title = "Class Token as a Powerful Assistance for Transformer Pretraining",

author = "Jingyang Min and Erick Purwanto and Su Yang",

year = "2022",

month = oct,

language = "English",

booktitle = "CICET22: The International Conference on Recent Advancements in Computing in AI, IoT and Computer Engineering Technology",

}