Sven Krippendorf
A duality connecting neural network and cosmological dynamics
Krippendorf, Sven; Spannowsky, Michael
Abstract
We demonstrate that the dynamics of neural networks (NNs) trained with gradient descent and the dynamics of scalar fields in a flat, vacuum energy dominated Universe are structurally profoundly related. This duality provides the framework for synergies between these systems, to understand and explain NN dynamics and new ways of simulating and describing early Universe models. Working in the continuous-time limit of NNs, we analytically match the dynamics of the mean background and the dynamics of small perturbations around the mean field, highlighting potential differences in separate limits. We perform empirical tests of this analytic description and quantitatively show the dependence of the effective field theory parameters on hyperparameters of the NN. As a result of this duality, the cosmological constant is matched inversely to the learning rate in the gradient descent update.
Citation
Krippendorf, S., & Spannowsky, M. (2022). A duality connecting neural network and cosmological dynamics. Machine Learning: Science and Technology, 3(3), https://doi.org/10.1088/2632-2153/ac87e9
Journal Article Type | Article |
---|---|
Acceptance Date | Aug 8, 2022 |
Online Publication Date | Aug 30, 2022 |
Publication Date | 2022 |
Deposit Date | Sep 28, 2022 |
Publicly Available Date | Sep 29, 2022 |
Journal | Machine Learning: Science and Technology |
Print ISSN | 2632-2153 |
Electronic ISSN | 2632-2153 |
Publisher | IOP Publishing |
Peer Reviewed | Peer Reviewed |
Volume | 3 |
Issue | 3 |
DOI | https://doi.org/10.1088/2632-2153/ac87e9 |
Public URL | https://durham-repository.worktribe.com/output/1190934 |
Files
Published Journal Article (Advance online version)
(1.9 Mb)
PDF
Publisher Licence URL
http://creativecommons.org/licenses/by/4.0/
Copyright Statement
Advance online version Original content from this work may be used under the terms of the Creative Commons Attribution 4.0 license. Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI.
You might also like
The Higgs Portal and Cosmology
(2016)
Presentation / Conference Contribution
Effective limits on single scalar extensions in the light of recent LHC data
(2023)
Journal Article
Quantum fitting framework applied to effective field theories
(2023)
Journal Article
Quantum optimization of complex systems with a quantum annealer
(2022)
Journal Article
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search