Cites: Knowledge Mechanisms in Large Language Models: A Survey and Perspective

14 citation edges inside this catalog. A title match is weaker evidence than an identifier match. Zero entries does not mean no citations on the web.

• The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
  arxiv:1803.03635 · evidence: title
• Dissociating language and thought in large language models
  arxiv:2301.06627 · evidence: title
• To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review
  arxiv:2304.09355 · evidence: title
• Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
  arxiv:2305.14342 · evidence: title
• Sparse Autoencoders Find Highly Interpretable Features in Language Models
  arxiv:2309.08600 · evidence: title
• The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"
  arxiv:2309.12288 · evidence: title
• Physics of Language Models: Part 3.1, Knowledge Storage and Extraction
  arxiv:2309.14316 · evidence: title
• Physics of Language Models: Part 3.2, Knowledge Manipulation
  arxiv:2309.14402 · evidence: title
• Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws
  arxiv:2404.05405 · evidence: title
• The Platonic Representation Hypothesis
  arxiv:2405.07987 · evidence: id
• Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization
  arxiv:2405.15071 · evidence: title
• Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process
  arxiv:2407.20311 · evidence: id
• Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision
  url:openai.com/research/weak-to-strong-generalization · evidence: title
• Reinforcement Learning from Human Feedback
  url:rlhfbook.com · evidence: title