Cites: The AdEMAMix Optimizer: Better, Faster, Older

7 citation edges inside this catalog. A title match is weaker evidence than an identifier match. Zero entries does not mean no citations on the web.

• Large Batch Optimization for Deep Learning: Training BERT in 76 minutes
  arxiv:1904.00962 · evidence: title
• Symbolic Discovery of Optimization Algorithms
  arxiv:2302.06675 · evidence: title
• Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
  arxiv:2305.14342 · evidence: title
• No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models
  arxiv:2307.06440 · evidence: title
• Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations
  arxiv:2405.18392 · evidence: title
• Grokfast: Accelerated Grokking by Amplifying Slow Gradients
  arxiv:2405.20233 · evidence: title
• The Llama 3 Herd of Models
  arxiv:2407.21783 · evidence: title