Achieving Occam's razor: Deep learning for optimal model reduction Journal Article


Authors: Antal, B. B.; Chesebro, A. G.; Strey, H. H.; Mujica-Parodi, L. R.; Weistuch, C.
Article Title: Achieving Occam's razor: Deep learning for optimal model reduction
Abstract: All fields of science depend on mathematical models. Occam’s razor refers to the principle that good models should exclude parameters beyond those minimally required to describe the systems they represent. This is because redundancy can lead to incorrect estimates of model parameters from data, and thus inaccurate or ambiguous conclusions. Here, we show how deep learning can be powerfully leveraged to apply Occam’s razor to model parameters. Our method, FixFit, uses a feedforward deep neural network with a bottleneck layer to characterize and predict the behavior of a given model from its input parameters. FixFit has three major benefits. First, it provides a metric to quantify the original model’s degree of complexity. Second, it allows for the unique fitting of data. Third, it provides an unbiased way to discriminate between experimental hypotheses that add value versus those that do not. In three use cases, we demonstrate the broad applicability of this method across scientific domains. To validate the method using a known system, we apply FixFit to recover known composite parameters for the Kepler orbit model and a dynamic model of blood glucose regulation. In the latter, we demonstrate the ability to fit the latent parameters to real data. To illustrate how the method can be applied to less well-established fields, we use it to identify parameters for a multi-scale brain model and reduce the search space for viable candidate mechanisms. Copyright: © 2024 Antal et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Keywords: controlled study; mathematical model; glucose blood level; parameter estimation; input parameter; learning systems; occam's razor; human; article; deep learning; deep neural networks; deep neural network; multilayer neural networks; modeling parameters; orbits; degrees of complexity; feed forward; fitting of data; model reduction; optimal model; orbit modeling; original model; orbit score
Journal Title: PLoS Computational Biology
Volume: 20
Issue: 7
ISSN: 1553-7358
Publisher: Public Library of Science  
Date Published: 2024-07-18
Start Page: e1012283
Language: English
DOI: 10.1371/journal.pcbi.1012283
PROVIDER: scopus
PMCID: PMC11288447
PUBMED: 39024398
DOI/URL:
Notes: Article -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors