How does the pre-training objective affect what large language models learn about linguistic properties?
Paper
•
2203.10415
•
Published
Ahmed Alajrami
aajrami
·
AI & ML interests
Language Modelling, Interpretability, ML, etc.
Recent Activity
upvoted
a
paper
3 months ago
Deconstructing Attention: Investigating Design Principles for Effective
Language Modeling
authored
a paper
3 months ago
How does the pre-training objective affect what large language models
learn about linguistic properties?
Organizations
