Relating transformers to models and neural representations of the hippocampal formation

arxiv:2112.04035

Original source · Paper JSON

NeuroAI · 2021-12-07

Cites (0) · Cited by (0)

Complete cleaned Markdown · Source Markdown including bibliography

Read in parts

1. Part 1
2. Part 2
3. Part 3
4. Part 4

Contents

• Relating transformers to models and neural representations of the hippocampal formation
• Abstract
• 1 Introduction
• 2 Transformers
• 3 Transformers learn entorhinal representations
• 4 TEM
• 5 TEM as a transformer
• 6 Place cells in transformers
• 7 Discussion
• 8 Conclusion
• Appendix A Appendix
• A.1 The maths using elements
• A.2 Details of implementation
• A.3 Additional details of the spatial task
• A.4 Additional details of TEM
• A.5 Related work
• A.6 Further learned cell representations
• Instructions for reporting errors