Cited by: Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

3 citation edges inside this catalog. A title match is weaker evidence than an identifier match. Zero entries does not mean no citations on the web.

• No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models
  arxiv:2307.06440 · evidence: id
• Knowledge Mechanisms in Large Language Models: A Survey and Perspective
  arxiv:2407.15017 · evidence: title
• The AdEMAMix Optimizer: Better, Faster, Older
  arxiv:2409.03137 · evidence: title