Evidence from formal logical reasoning reveals that the language of thought is not natural language — part 9/10
Cleaned-text code points [105978, 119394). Bibliography omitted here; source.md includes it.
Lin, B. Y., Deng, Y., Chandu, K., Brahman, F., Ravichander, A., Pyatkin, V., Dziri, N., Bras, R. L., & Choi, Y. (2024). WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild (arXiv:2406.04770). arXiv. https://doi.org/10.48550/arXiv.2406.04770 Lipkin, B., Tuckute, G., Affourtit, J., Small, H., Mineroff, Z., Kean, H., Jouravlev, O., Rakocevic, L., Pritchett, B., Siegelman, M., Hoeflin, C., Pongos, A., Blank, I. A., Struhl, M. K., Ivanova, A., Shannon, S., Sathe, A., Hoffmann, M., Nieto-Castañón, A., & Fedorenko, E. (2022). Probabilistic atlas for the language network based on precision fMRI data from >800 individuals. Scientific Data, 9(1), 529. https://doi.org/10.1038/s41597-022-01645-3 Liu, J., Cui, L., Liu, H., Huang, D., Wang, Y., & Zhang, Y. (2020). LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoning (arXiv:2007.08124). arXiv. https://doi.org/10.48550/arXiv.2007.08124 Liu, Y.-F., Kim, J., Wilson, C., & Bedny, M. (2020). Computer code comprehension shares neural resources with formal logical inference in the fronto-parietal network. eLife, 9, e59340. https://doi.org/10.7554/eLife.59340 Mahowald, K., Ivanova, A. A., Blank, I. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2024). Dissociating language and thought in large language models. Trends in Cognitive Sciences, 28(6), 517–540. https://doi.org/10.1016/j.tics.2024.01.011 Malik-Moraleda, S., Ayyash, D., Gallée, J., Affourtit, J., Hoffmann, M., Mineroff, Z., Jouravlev, O., & Fedorenko, E. (2022). An investigation across 45 languages and 12 language families reveals a universal language network. Nature Neuroscience, 25(8), 1014–1019. https://doi.org/10.1038/s41593-022-01114-5 Malik-Moraleda, S., Taliaferro, M., Shannon, S., Jhingan, N., Swords, S., Peterson, D. J., Frommer, P., Okrand, M., Sams, J., Cardwell, R., Freeman, C., & Fedorenko, E. (2025). Constructed languages are processed by the same brain mechanisms as natural languages. Proceedings of the National Academy of Sciences of the United States of America, 122(12), e2313473122. https://doi.org/10.1073/pnas.2313473122 Marcus, G. F. (2001). The algebraic mind: Integrating connectionism and cognitive science (pp. xiii, 224). The MIT Press. Masís-Obando, R., Norman, K. A., & Baldassano, C. (2022). Schema representations in distinct brain networks support narrative memory during encoding and retrieval. eLife, 11, e70445. https://doi.org/10.7554/eLife.70445 McCarthy, J., & Hayes, P. (1969). Some Philosophical Problems From the Standpoint of Artificial Intelligence. In B. Meltzer & D. Michie (Eds.), Machine Intelligence 4 (pp. 463–502). Edinburgh University Press. McCoy, R. T., Yao, S., Friedman, D., Hardy, M., & Griffiths, T. L. (2023). Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solve (arXiv:2309.13638). arXiv. https://doi.org/10.48550/arXiv.2309.13638 Menenti, L., Gierhan, S. M. E., Segaert, K., & Hagoort, P. (2011). Shared language: Overlap and segregation of the neuronal infrastructure for speaking and listening revealed by functional MRI. Psychological Science, 22(9), 1173–1182. https://doi.org/10.1177/0956797611418347 Mody, S., & Carey, S. (2016). The emergence of reasoning by the disjunctive syllogism in early childhood. Cognition, 154, 40–48. https://doi.org/10.1016/j.cognition.2016.05.012 Monti, M. M., Parsons, L. M., & Osherson, D. N. (2009). The boundaries of language and thought in deductive inference. Proceedings of the National Academy of Sciences, 106(30), 12554–12559. https://doi.org/10.1073/pnas.0902422106 Monti, M. M., Parsons, L. M., & Osherson, D. N. (2012). Thought Beyond Language: Neural Dissociation of Algebra and Natural Language. Psychological Science, 23(8), 914–922. https://doi.org/10.1177/0956797612437427 Nezhurina, M., Cipolina-Kun, L., Cherti, M., & Jitsev, J. (2025). Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models (arXiv:2406.02061). arXiv. https://doi.org/10.48550/arXiv.2406.02061 .CC-BY 4.0 International licenseavailable under a was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made The copyright holder for this preprint (whichthis version posted July 29, 2025. ; https://doi.org/10.1101/2025.07.26.666979doi: bioRxiv preprint Niendam, T. A., Laird, A. R., Ray, K. L., Dean, Y. M., Glahn, D. C., & Carter, C. S. (2012). Meta- analytic evidence for a superordinate cognitive control network subserving diverse executive functions. Cognitive, Affective & Behavioral Neuroscience, 12(2), 241–268. https://doi.org/10.3758/s13415-011-0083-5 Novick, J. M., Hussey, E., Teubner-Rhodes, S., Harbison, J. I., & Bunting, M. F. (2014). Clearing the garden-path: Improving sentence processing through cognitive control training. Language, Cognition and Neuroscience, 29(2), 186–217. https://doi.org/10.1080/01690965.2012.758297 Novick, J. M., Trueswell, J. C., & Thompson-Schill, S. L. (2005). Cognitive control and parsing: Reexamining the role of Broca’s area in sentence comprehension. Cognitive, Affective & Behavioral Neuroscience, 5(3), 263–281. https://doi.org/10.3758/cabn.5.3.263 Nye, M., Andreassen, A. J., Gur-Ari, G., Michalewski, H., Austin, J., Bieber, D., Dohan, D., Lewkowycz, A., Bosma, M., Luan, D., Sutton, C., & Odena, A. (2021). Show Your Work: Scratchpads for Intermediate Computation with Language Models (arXiv:2112.00114). arXiv. https://doi.org/10.48550/arXiv.2112.00114 Olausson, T., Gu, A., Lipkin, B., Zhang, C., Solar-Lezama, A., Tenenbaum, J., & Levy, R. (2023). LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First- Order Logic Provers. In H. Bouamor, J. Pino, & K. Bali (Eds.), Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (pp. 5153–5176). Association for Computational Linguistics. https://doi.org/10.18653/v1/2023.emnlp-main.313 OpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., Avila, R., Babuschkin, I., Balaji, S., Balcom, V., Baltescu, P., Bao, H., Bavarian, M., Belgum, J., … Zoph, B. (2024). GPT-4 Technical Report (arXiv:2303.08774). arXiv. https://doi.org/10.48550/arXiv.2303.08774 OpenAI, Jaech, A., Kalai, A., Lerer, A., Richardson, A., El-Kishky, A., Low, A., Helyar, A., Madry, A., Beutel, A., Carney, A., Iftimie, A., Karpenko, A., Passos, A. T., Neitz, A., Prokofiev, A., Wei, A., Tam, A., Bennett, A., … Li, Z. (2024). OpenAI o1 System Card (arXiv:2412.16720). arXiv. https://doi.org/10.48550/arXiv.2412.16720 Pallier, C., Devauchelle, A.-D., & Dehaene, S. (2011). Cortical representation of the constituent structure of sentences. Proceedings of the National Academy of Sciences, 108(6), 2522–2527. https://doi.org/10.1073/pnas.1018711108 Pan, L., Albalak, A., Wang, X., & Wang, W. (2023). Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning. In H. Bouamor, J. Pino, & K. Bali (Eds.), Findings of the Association for Computational Linguistics: EMNLP 2023 (pp. 3806–3824). Association for Computational Linguistics. https://doi.org/10.18653/v1/2023.findings-emnlp.248 Patel, A. D. (2003). Language, music, syntax and the brain. Nature Neuroscience, 6(7), 674–681. https://doi.org/10.1038/nn1082 Paunov, A. M., Blank, I. A., & Fedorenko, E. (2019). Functionally distinct language and Theory of Mind networks are synchronized at rest and during language comprehension. Journal of Neurophysiology, 121(4), 1244–1265. https://doi.org/10.1152/jn.00619.2018 Paunov, A. M., Blank, I. A., Jouravlev, O., Mineroff, Z., Gallée, J., & Fedorenko, E. (2022). Differential Tracking of Linguistic vs. Mental State Content in Naturalistic Stimuli by Language and Theory of Mind (ToM) Brain Networks. Neurobiology of Language, 3(3), 413–440. https://doi.org/10.1162/nol_a_00071 Piaget, J. (1926). The Language and Thought of the Child (M. Gabain, Trans.). Kegan Paul, Trench, Trubner & Co. Pinker, S. (1994). The language instinct (p. 494). William Morrow & Co. Pinto, J., & Reiter, R. (1993). Temporal Reasoning in Logic Programming: A Case for the Situation Calculus. https://doi.org/10.7551/mitpress/4305.003.0023 Poesia, G., Gandhi, K., Zelikman, E., & Goodman, N. D. (2023). Certified Deductive Reasoning with Language Models (arXiv:2306.04031). arXiv. https://doi.org/10.48550/arXiv.2306.04031 .CC-BY 4.0 International licenseavailable under a was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made The copyright holder for this preprint (whichthis version posted July 29, 2025. ; https://doi.org/10.1101/2025.07.26.666979doi: bioRxiv preprint Pramod, R., Cohen, M. A., Tenenbaum, J. B., & Kanwisher, N. (2022). Invariant representation of physical stability in the human brain. eLife, 11, e71736. https://doi.org/10.7554/eLife.71736 Pramod, R. T., Mieczkowski, E., Fang, C. X., Tenenbaum, J. B., & Kanwisher, N. (2025). Decoding predicted future states from the brain’s “physics engine.” Science Advances, 11(22), eadr7429. https://doi.org/10.1126/sciadv.adr7429 Primi, R., Ferrão, M. E., & Almeida, L. S. (2010). Fluid intelligence as a predictor of learning: A longitudinal multilevel approach applied to math. Learning and Individual Differences, 20(5), 446– 451. https://doi.org/10.1016/j.lindif.2010.05.001 Pritchett, B. L., Hoeflin, C., Koldewyn, K., Dechter, E., & Fedorenko, E. (2018). High-level language processing regions are not engaged in action observation or imitation. Journal of Neurophysiology, 120(5), 2555–2570. https://doi.org/10.1152/jn.00222.2018 Qiu, L., Jiang, L., Lu, X., Sclar, M., Pyatkin, V., Bhagavatula, C., Wang, B., Kim, Y., Choi, Y., Dziri, N., & Ren, X. (2023, October 13). Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement. The Twelfth International Conference on Learning Representations. https://openreview.net/forum?id=bNt7oajl2a Quillen, I. A., Yen, M., & Wilson, S. M. (2021). Distinct Neural Correlates of Linguistic and Non- Linguistic Demand. Neurobiology of Language, 2(2), 202–225. https://doi.org/10.1162/nol_a_00031 Radford, A., Narasimhan, K., Salimans, T., & Sutskever, I. (2018). Improving Language Understanding by Generative Pre-Training. Raven, J. (2000). The Raven’s Progressive Matrices: Change and Stability over Culture and Time. Cognitive Psychology, 41(1), 1–48. https://doi.org/10.1006/cogp.1999.0735 Rein, D., Hou, B. L., Stickland, A. C., Petty, J., Pang, R. Y., Dirani, J., Michael, J., & Bowman, S. R. (2023). GPQA: A Graduate-Level Google-Proof Q&A Benchmark (arXiv:2311.12022). arXiv. https://doi.org/10.48550/arXiv.2311.12022 Reverberi, C., Cherubini, P., Rapisarda, A., Rigamonti, E., Caltagirone, C., Frackowiak, R. S. J., Macaluso, E., & Paulesu, E. (2007). Neural basis of generation of conclusions in elementary deduction. NeuroImage, 38(4), 752–762. https://doi.org/10.1016/j.neuroimage.2007.07.060 Rips, L. J. (1983). Cognitive Processes in Propositional Reasoning. Psychological Review, 90(1), 38–71. https://doi.org/10.1037/0033-295x.90.1.38 Rips, L. J. (1988). Deduction. In The psychology of human thought (pp. 116–152). Cambridge University Press. Rips, L. J. (1994). The psychology of proof: Deductive reasoning in human thinking. MIT Press. Rips, L. J. (1995). Deduction and cognition. In Thinking: An invitation to cognitive science, Vol. 3, 2nd ed (pp. 297–343). The MIT Press. Rogalsky, C., Rong, F., Saberi, K., & Hickok, G. (2011). Functional anatomy of language and music perception: Temporal and structural factors investigated using functional magnetic resonance imaging. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 31(10), 3843–3852. https://doi.org/10.1523/JNEUROSCI.4515-10.2011 Roth, B., Becker, N., Romeyke, S., Schäfer, S., Domnick, F., & Spinath, F. M. (2015). Intelligence and school grades: A meta-analysis. Intelligence, 53, 118–137. https://doi.org/10.1016/j.intell.2015.09.002 Rule, J. S. (n.d.). The child as hacker: Building more human-like models of learning. Rule, J. S., Piantadosi, S. T., Cropper, A., Ellis, K., Nye, M., & Tenenbaum, J. B. (2024). Symbolic metaprogram search improves learning efficiency and explains rule learning in humans. Nature Communications, 15(1), 6847. https://doi.org/10.1038/s41467-024-50966-x Saxe, R., & Kanwisher, N. (2003). People thinking about thinking people. The role of the temporo- parietal junction in “theory of mind.” NeuroImage, 19(4), 1835–1842. https://doi.org/10.1016/s1053-8119(03)00230-1 Schank, R. C., & Abelson, R. P. (1977). Scripts, plans, goals and understanding: An inquiry into human knowledge structures (p. 248). Lawrence Erlbaum. .CC-BY 4.0 International licenseavailable under a was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made The copyright holder for this preprint (whichthis version posted July 29, 2025. ; https://doi.org/10.1101/2025.07.26.666979doi: bioRxiv preprint