Cited by: Scaling Laws for Neural Language Models

42 citation edges inside this catalog. A title match is weaker evidence than an identifier match. Zero entries does not mean no citations on the web.

• Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
  arxiv:2206.04615 · evidence: id
• Neural Networks and the Chomsky Hierarchy
  arxiv:2207.02098 · evidence: title
• Scaling Laws for Reward Model Overoptimization
  arxiv:2210.10760 · evidence: id
• Cramming: Training a Language Model on a Single GPU in One Day
  arxiv:2212.14034 · evidence: id
• Dissociating language and thought in large language models
  arxiv:2301.06627 · evidence: id
• Are Emergent Abilities of Large Language Models a Mirage?
  arxiv:2304.15004 · evidence: id
• Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
  arxiv:2305.14342 · evidence: id
• Scaling MLPs: A Tale of Inductive Bias
  arxiv:2306.13575 · evidence: title
• No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models
  arxiv:2307.06440 · evidence: id
• Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws
  arxiv:2404.05405 · evidence: id
• TransformerFAM: Feedback attention is working memory
  arxiv:2404.09173 · evidence: title
• xLSTM: Extended Long Short-Term Memory
  arxiv:2405.04517 · evidence: title
• The Platonic Representation Hypothesis
  arxiv:2405.07987 · evidence: id
• gzip Predicts Data-dependent Scaling Laws
  arxiv:2405.16684 · evidence: id
• Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations
  arxiv:2405.18392 · evidence: id
• How Do Large Language Models Acquire Factual Knowledge During Pretraining?
  arxiv:2406.11813 · evidence: title
• Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process
  arxiv:2407.20311 · evidence: id
• The Llama 3 Herd of Models
  arxiv:2407.21783 · evidence: id
• Scaling of Search and Learning: A Roadmap to Reproduce o1 from Reinforcement Learning Perspective
  arxiv:2412.14135 · evidence: id
• 2 OLMo 2 Furious
  arxiv:2501.00656 · evidence: id
• s1: Simple test-time scaling
  arxiv:2501.19393 · evidence: id
• LIMO: Less is More for Reasoning
  arxiv:2502.03387 · evidence: id
• Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach
  arxiv:2502.05171 · evidence: id
• Large Language Diffusion Models
  arxiv:2502.09992 · evidence: id