Myle Ott
2 papers · Latest:
Natural Language Processing
OPT: Open Pre-trained Transformer Language Models
OPT is a suite of openly released large-scale transformer language models comparable to GPT-3 but developed with significantly lower environmental impact.
2205.01068
Natural Language ProcessingRoBERTa: A Robustly Optimized BERT Pretraining Approach
RoBERTa revisits BERT pretraining with optimized hyperparameters and more data, achieving state-of-the-art NLP performance and revealing that BERT was originally undertrained.
1907.11692
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.