Cites: No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models

8 citation edges inside this catalog. A title match is weaker evidence than an identifier match. Zero entries does not mean no citations on the web.

• Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks
  acl:2022.emnlp-main.340 · evidence: title
• Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates
  arxiv:1708.07120 · evidence: title
• Scaling Laws for Neural Language Models
  arxiv:2001.08361 · evidence: id
• GLU Variants Improve Transformer
  arxiv:2002.05202 · evidence: title
• Sharpness-Aware Minimization for Efficiently Improving Generalization
  arxiv:2010.01412 · evidence: id
• Cramming: Training a Language Model on a Single GPU in One Day
  arxiv:2212.14034 · evidence: id
• Symbolic Discovery of Optimization Algorithms
  arxiv:2302.06675 · evidence: id
• Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
  arxiv:2305.14342 · evidence: id