近三年论文 · 62 篇 (点击展开摘要,时间倒序)
DeepONet-enhanced bayesian inference for biphasic tumor growth modeling
The advancements in computational biology in tandem with the explosion of machine learning (ML) have the potential to revolutionize quantitative and personalized medicine. In this framework, a Deep Operator Network (DeepONet) enhanced computational framework is presented, which enables informed simulations of cancer growth. A continuum mechanics-based, biphasic tumor growth model (TGM) is developed that simulates the tumor as well as the immune response within the tumor microenvironment (TME). A Bayesian inference framework is then customized in order to calculate the posterior distributions of critical model parameters using experimental data. Given the computational complexity of solving the TGM consisting of multiple coupled nonlinear partial differential equations (PDEs), we integrate a DeepONet surrogate model to significantly reduce computational costs while preserving the accuracy of the original model. This approach enhances the identification of model parameters based on experimental data, underscoring the importance of Bayesian strategies in cancer modeling. The proposed framework offers a robust and adaptable approach to tumor growth simulations, paving the way for more precise, data-driven predictions in cancer research and treatment.
Bayesian inference for PDE-based inverse problems using the optimization of a discrete loss
Reinforcement learning closures for underresolved partial differential equations using synthetic data
Partial Differential Equations (PDEs) describe phenomena ranging from turbulence and epidemics to quantum mechanics and financial markets. Despite recent advances in computational science, solving such PDEs for real-world applications remains prohibitively expensive because of the necessity of resolving a broad range of spatiotemporal scales. In turn, practitioners often rely on coarse-grained approximations of the original PDEs, trading off accuracy for reduced computational resources. To mitigate the loss of detail inherent in such approximations, closure models are employed to represent unresolved spatiotemporal interactions. We present a framework for developing closure models for PDEs using synthetic data acquired through the method of manufactured solutions. These data are used in conjunction with reinforcement learning to provide closures for coarse-grained PDEs. We illustrate the efficacy of our method using the one-dimensional and two-dimensional Burgers'equations and the two-dimensional advection equation. Moreover, we demonstrate that closure models trained for inhomogeneous PDEs can be effectively generalized to homogeneous PDEs. The results demonstrate the potential for developing accurate and computationally efficient closure models for systems with scarce data.
A Critical Assessment of Pattern Comparisons Between POD and Autoencoders in Intraventricular Flows
Understanding intraventricular hemodynamics requires compact and physically interpretable representations of the underlying flow structures, as characteristic flow patterns are closely associated with cardiovascular conditions and can support early detection of cardiac deterioration. Conventional visualization of velocity or pressure fields, however, provides limited insight into the coherent mechanisms driving these dynamics. Reduced-order modeling techniques, like Proper Orthogonal Decomposition (POD) and Autoencoder (AE) architectures, offer powerful alternatives to extract dominant flow features from complex datasets. This study systematically compares POD with several AE variants (Linear, Nonlinear, Convolutional, and Variational) using left ventricular flow fields obtained from computational fluid dynamics simulations. We show that, for a suitably chosen latent dimension, AEs produce modes that become nearly orthogonal and qualitatively resemble POD modes that capture a given percentage of kinetic energy. As the number of latent modes increases, AE modes progressively lose orthogonality, leading to linear dependence, spatial redundancy, and the appearance of repeated modes with substantial high-frequency content. This degradation reduces interpretability and introduces noise-like components into AE-based reduced-order models, potentially complicating their integration with physics-based formulations or neural-network surrogates. The extent of interpretability loss varies across the AEs, with nonlinear, convolutional, and variational models exhibiting distinct behaviors in orthogonality preservation and feature localization. Overall, the results indicate that AEs can reproduce POD-like coherent structures under specific latent-space configurations, while highlighting the need for careful mode selection to ensure physically meaningful representations of cardiac flow dynamics.
A Critical Assessment of Pattern Comparisons Between POD and Autoencoders in Intraventricular Flows
arXiv (Cornell University) · 2025 · cited 0
Understanding intraventricular hemodynamics requires compact and physically interpretable representations of the underlying flow structures, as characteristic flow patterns are closely associated with cardiovascular conditions and can support early detection of cardiac deterioration. Conventional visualization of velocity or pressure fields, however, provides limited insight into the coherent mechanisms driving these dynamics. Reduced-order modeling techniques, like Proper Orthogonal Decomposition (POD) and Autoencoder (AE) architectures, offer powerful alternatives to extract dominant flow features from complex datasets. This study systematically compares POD with several AE variants (Linear, Nonlinear, Convolutional, and Variational) using left ventricular flow fields obtained from computational fluid dynamics simulations. We show that, for a suitably chosen latent dimension, AEs produce modes that become nearly orthogonal and qualitatively resemble POD modes that capture a given percentage of kinetic energy. As the number of latent modes increases, AE modes progressively lose orthogonality, leading to linear dependence, spatial redundancy, and the appearance of repeated modes with substantial high-frequency content. This degradation reduces interpretability and introduces noise-like components into AE-based reduced-order models, potentially complicating their integration with physics-based formulations or neural-network surrogates. The extent of interpretability loss varies across the AEs, with nonlinear, convolutional, and variational models exhibiting distinct behaviors in orthogonality preservation and feature localization. Overall, the results indicate that AEs can reproduce POD-like coherent structures under specific latent-space configurations, while highlighting the need for careful mode selection to ensure physically meaningful representations of cardiac flow dynamics.
Scalable, cloud-based simulations of blood flow and targeted drug delivery in retinal capillaries
Scalable, Cloud-Based Simulations of Blood Flow and Targeted Drug Delivery in Retinal Capillaries
We investigate the capabilities of cloud computing for large-scale,tightly-coupled simulations of biological fluids in complex geometries, traditionally performed in supercomputing centers. We demonstrate scalable and efficient simulations in the public cloud. We perform meso-scale simulations of blood flow in image-reconstructed capillaries, and examine targeted drug delivery by artificial bacterial flagella (ABFs). The simulations deploy dissipative particle dynamics (DPD) with two software frameworks, Mirheo (developed by our team) and LAMMPS. Mirheo exhibits remarkable weak scalability for up to 512 GPUs. Similarly, LAMMPS demonstrated excellent weak scalability for pure solvent as well as for blood suspensions and ABFs in reconstructed retinal capillaries. In particular, LAMMPS maintained weak scaling above 90% on the cloud for up to 2,000 cores. Our findings demonstrate that cloud computing can support tightly coupled, large-scale scientific simulations with competitive performance.
Structure tensor Reynolds-averaged Navier-Stokes turbulence models with equivariant neural networks
Accurate and generalizable Reynolds-averaged Navier-Stokes (RANS) models for turbulent flows rely on effective closures, but currently available closures are notoriously unreliable. Kassinos et al. (J. Fluid Mechanics, 428, pp. 213-248, 2001) hypothesized that this unreliability of RANS models was due to an insufficient description of the statistical state of the turbulence and proposed a set of structure tensors as a candidate for a sufficiently rich description. To test this hypothesis for the rapid pressure-strain term, we introduce tensor-based, symmetry aware closures in terms of the structure tensors using equivariant neural networks (ENNs), and present an algorithm for enforcing algebraic contraction relations among tensor components. Using data from rapid distortion theory, experiments show that such ENNs can effectively learn relationships involving high-order tensors. The resulting ENN structure tensor models are orders of magnitude more accurate than existing models for the rapid pressure-strain correlation, effectively validating the Kassinos et al. hypothesis for this term. Results show that ENNs provide a physically consistent alternative to classical tensor basis models, enabling end-to-end learning of unclosed terms in RANS and other tensor modeling domains, and rapid exploration of model dependencies.
Metamaterials from the Deep: Optimized Mechano-Fluidic Materials Inspired by Deep-Sea Sponges
Bayesian Inference for PDE-based Inverse Problems using the Optimization of a Discrete Loss
Inverse problems are crucial for many applications in science, engineering and medicine that involve data assimilation, design, and imaging. Their solution infers the parameters or latent states of a complex system from noisy data and partially observable processes. When measurements are an incomplete or indirect view of the system, additional knowledge is required to accurately solve the inverse problem. Adopting a physical model of the system in the form of partial differential equations (PDEs) is a potent method to close this gap. In particular, the method of optimizing a discrete loss (ODIL) has shown great potential in terms of robustness and computational cost. In this work, we introduce B-ODIL, a Bayesian extension of ODIL, that integrates the PDE loss of ODIL as prior knowledge and combines it with a likelihood describing the data. B-ODIL employs a Bayesian formulation of PDE-based inverse problems to infer solutions with quantified uncertainties. We demonstrate the capabilities of B-ODIL in a series of synthetic benchmarks involving PDEs in one, two, and three dimensions. We showcase the application of B-ODIL in estimating tumor concentration and its uncertainty in a patient's brain from MRI scans using a three-dimensional tumor growth model.
Ising energy model for the stochastic prediction of tumor islets.
PubMed · 2025 · cited 0
A major challenge in diagnosing and treating cancer is the infiltrative growth of tumors into surrounding tissues. This microscopic spread of the disease is invisible on most diagnostic imaging modalities and can often only be detected histologically in biopsies. The purpose of this paper is to develop a physically based model of tumor spread that captures the histologically observed behavior in terms of seeding small tumor islets in prostate cancer. The model is based on three elementary events: a tumor cell can move, duplicate, or die. The propensity of each event is given by an Ising-like Hamiltonian that captures correlations between neighboring cells. The model parameters were fitted to clinical data obtained from surgical specimens taken from 23 prostate cancer patients. The results demonstrate that this straightforward physical model effectively describes the distribution of the size and the number of tumor islets in prostate cancer. The simulated tumor islets exhibit a regular, approximately spherical shape, correctly mimicking the shapes observed in histology. This is due to the Ising interaction term between neighboring cells acting as a surface tension that gives rise to regularly shaped islets. The model addresses the important clinical need of calculating the probability of tumor involvement in specific sub-volumes of the prostate, which is required for radiation treatment planning and other applications.
Controlling Topological Defects in Polar Fluids via Reinforcement Learning
Topological defects in active polar fluids exhibit complex dynamics driven by internally generated stresses, reflecting the deep interplay between topology, flow, and non-equilibrium hydrodynamics. Feedback control offers a powerful means to guide such systems, enabling transitions between dynamic states. We investigated closed-loop steering of integer-charged defects in a confined active fluid by modulating the spatial profile of activity. Using a continuum hydrodynamic model, we show that localized control of active stress induces flow fields that can reposition and direct defects along prescribed trajectories by exploiting non-linear couplings in the system. A reinforcement learning framework is used to discover effective control strategies that produce robust defect transport across both trained and novel trajectories. The results highlight how AI agents can learn the underlying dynamics and spatially structure activity to manipulate topological excitations, offering insights into the controllability of active matter and the design of adaptive, self-organized materials.
Individualizing glioma radiotherapy planning by optimization of a data and physics-informed discrete loss
Brain tumor growth is unique to each glioma patient and extends beyond what is visible in imaging scans, infiltrating surrounding brain tissue. Understanding these hidden patient-specific progressions is essential for effective therapies. Current treatment plans for brain tumors, such as radiotherapy, typically involve delineating a uniform margin around the visible tumor on pre-treatment scans to target this invisible tumor growth. This "one size fits all" approach is derived from population studies and often fails to account for the nuances of individual patient conditions. We present the Glioma Optimizing the Discrete Loss (GliODIL) framework, which infers the full spatial distribution of tumor cell concentration from available multi-modal imaging, leveraging a Fisher-Kolmogorov type physics model to describe tumor growth. This is achieved through the newly introduced method of Optimizing the Discrete Loss (ODIL), where both data and physics-based constraints are softly assimilated into the solution. Our test dataset comprises 152 glioblastoma patients with pre-treatment imaging and post-treatment follow-ups for tumor recurrence monitoring. By blending data-driven techniques with physics-based constraints, GliODIL enhances recurrence prediction in radiotherapy planning, challenging traditional uniform margins and strict adherence to the Fisher-Kolmogorov partial differential equation model, which is adapted for complex cases.
Optimal navigation of magnetic artificial microswimmers in blood capillaries with deep reinforcement learning
Biomedical applications, such as targeted drug delivery, microsurgery, and sensing, rely on reaching precise areas within the body in a minimally invasive way. Artificial bacterial flagella (ABFs) have emerged as potential tools for this task by navigating through the circulatory system with the help of external magnetic fields. While their swimming characteristics are well understood in simple settings, their controlled navigation through realistic capillary networks remains a significant challenge due to the complexity of blood flow and the high computational cost of detailed simulations. We address this challenge by conducting numerical simulations of ABFs in retinal capillaries, propelled by an external magnetic field. The simulations are based on a validated blood model that predicts the dynamics of individual red blood cells and their hydrodynamic interactions with ABFs. The magnetic field follows a control policy that brings the ABF to a prescribed target. The control policy is learned with an actor-critic, off-policy reinforcement learning algorithm coupled with a reduced-order model of the system. We show that the same policy robustly guides the ABF to a prescribed target in both the reduced-order model and the fine-grained blood simulations. This approach is suitable for designing robust control policies for personalized medicine at moderate computational cost.
Contactless precision steering of particles in a fluid inside a cube with rotating walls
Contactless manipulation of small objects is essential for biomedical and chemical applications, such as cell analysis, assisted fertilisation and precision chemistry. Established methods, including optical, acoustic and magnetic tweezers, are now complemented by flow control techniques that use flow-induced motion to enable precise and versatile manipulation. However, trapping multiple particles in fluid remains a challenge. This study introduces a novel control algorithm capable of steering multiple particles in flow. The system uses rotating disks to generate flow fields that transport particles to precise locations. Disk rotations are governed by a feedback control policy based on the optimising a discrete loss framework, which combines fluid dynamics equations with path objectives into a single loss function. Our experiments, conducted in both simulations and with the physical device, demonstrate the capability of the approach to transport two beads simultaneously to predefined locations, advancing robust contactless particle manipulation for biomedical applications.
Data-driven shape inference in three-dimensional steady-state supersonic flows: Optimizing a discrete loss with JAX-Fluids
We present a data- and first-principles-driven method for inferring the shape of a solid obstacle and its flow field in three-dimensional steady-state supersonic flows. The proposed method combines the optimizing a discrete loss (ODIL) technique with the automatically differentiable JAX-Fluids computational fluid dynamics (CFD) solver to study the joint reconstruction of flow fields and obstacle shapes. ODIL minimizes the discrete residual of the governing partial differential equation (PDE) by gradient descent-based algorithms. The ODIL framework inherits the characteristics of the chosen numerical discretization of the underlying PDE, including its consistency and stability. Discrete residuals and their automatic differentiation gradients are computed by the JAX-Fluids solver, which provides nonlinear shock-capturing schemes and level-set-based immersed solid boundaries. We use synthetic data to validate this approach on challenging inverse problems, including the shape inference of a solid obstacle in three-dimensional steady-state supersonic flow. Specifically, we study flows around a cylinder, a sphere, and an ellipse. We investigate two distinct approaches for the obstacle shape representation: (1) , where the obstacle is described by a small set of parameters (e.g., the radius of the cylinder and the sphere) that are optimized together with the flow field, and (2) , where the level-set function is directly optimized at each point of the computational mesh, without relying on predefined shapes. For the former, a thorough comparison with physics-informed neural networks is provided. We show that the nonlinear shock-capturing discretization in combination with the level-set-based interface representation allows for accurate inference of the obstacle shape and its flow field for the ODIL method. The proposed approach opens new avenues for solving complex inverse problems in supersonic aerodynamics.
Inertial focusing of spherical particles: The effects of rotational motion
Inertial migration in microfluidic channels enables label-free sorting of particles and cells, yet the role of particle rotation has remained unclear. Using large-scale simulations, we show that rotation dramatically alters particle focusing positions in both circular and square ducts. We find that rotation induces a substantial lateral lift force, a simple phenomenological explanation extending existing theories is presented, that agrees well with our findings. Our findings suggest new design strategies for rotation-controlled particle sorting in microfluidic devices.
Quantitative 3D histochemistry reveals region-specific amyloid-β reduction by the antidiabetic drug netoglitazone
A hallmark of Alzheimer's disease (AD) is the extracellular aggregation of toxic amyloid-beta (Aβ) peptides in form of plaques. Here, we identify netoglitazone, an antidiabetic compound previously tested in humans, as an Aβ aggregation antagonist. Netoglitazone improved cognition and reduced microglia activity in a mouse model of AD. Using quantitative whole-brain three-dimensional histology (Q3D), we precisely identified brain regions where netoglitazone reduced the number and size of Aβ plaques. We demonstrate the utility of Q3D in preclinical drug evaluation for AD by providing a high-resolution brain-wide view of drug efficacy. Applying Q3D has the potential to improve pre-clinical drug evaluation by providing information that can help identify mechanisms leading to brain region-specific drug efficacy.
Energy Matching: Unifying Flow Matching and Energy-Based Models for Generative Modeling
Current state-of-the-art generative models map noise to data distributions by matching flows or scores. A key limitation of these models is their inability to readily integrate available partial observations and additional priors. In contrast, energy-based models (EBMs) address this by incorporating corresponding scalar energy terms. Here, we propose Energy Matching, a framework that endows flow-based approaches with the flexibility of EBMs. Far from the data manifold, samples move from noise to data along irrotational, optimal transport paths. As they approach the data manifold, an entropic energy term guides the system into a Boltzmann equilibrium distribution, explicitly capturing the underlying likelihood structure of the data. We parameterize these dynamics with a single time-independent scalar field, which serves as both a powerful generator and a flexible prior for effective regularization of inverse problems. The present method substantially outperforms existing EBMs on CIFAR-10 and ImageNet generation in terms of fidelity, while retaining simulation-free training of transport-based approaches away from the data manifold. Furthermore, we leverage the flexibility of the method to introduce an interaction energy that supports the exploration of diverse modes, which we demonstrate in a controlled protein generation setting. This approach learns a scalar potential energy, without time conditioning, auxiliary generators, or additional networks, marking a significant departure from recent EBM methods. We believe this simplified yet rigorous formulation significantly advances EBMs capabilities and paves the way for their wider adoption in generative modeling in diverse domains.
Learning Effective Dynamics across Spatio-Temporal Scales of Complex Flows
Modeling and simulation of complex fluid flows with dynamics that span multiple spatio-temporal scales is a fundamental challenge in many scientific and engineering domains. Full-scale resolving simulations for systems such as highly turbulent flows are not feasible in the foreseeable future, and reduced-order models must capture dynamics that involve interactions across scales. In the present work, we propose a novel framework, Graph-based Learning of Effective Dynamics (Graph-LED), that leverages graph neural networks (GNNs), as well as an attention-based autoregressive model, to extract the effective dynamics from a small amount of simulation data. GNNs represent flow fields on unstructured meshes as graphs and effectively handle complex geometries and non-uniform grids. The proposed method combines a GNN based, dimensionality reduction for variable-size unstructured meshes with an autoregressive temporal attention model that can learn temporal dependencies automatically. We evaluated the proposed approach on a suite of fluid dynamics problems, including flow past a cylinder and flow over a backward-facing step over a range of Reynolds numbers. The results demonstrate robust and effective forecasting of spatio-temporal physics; in the case of the flow past a cylinder, both small-scale effects that occur close to the cylinder as well as its wake are accurately captured.
Optimal Navigation in Microfluidics via the Optimization of a Discrete Loss
Optimal path planning and control of microscopic devices navigating in fluid environments is essential for applications ranging from targeted drug delivery to environmental monitoring. These tasks are challenging due to the complexity of microdevice-flow interactions. We introduce a closed-loop control method that optimizes a discrete loss (ODIL) in terms of dynamics and path objectives. In comparison with reinforcement learning, ODIL is more robust, up to 3 orders faster, and excels in high-dimensional action and state spaces, making it a powerful tool for navigating complex flow environments.
Machine learning and partial differential equations: benchmark, simplify, and discover
Abstract Simulations of critical phenomena, such as wildfires, epidemics, and ocean dynamics, are indispensable tools for decision-making. Many of these simulations are based on models expressed as Partial Differential Equations (PDEs). PDEs are invaluable inductive inference engines, as their solutions generalize beyond the particular problems they describe. Methods and insights acquired by solving the Navier–Stokes equations for turbulence can be very useful in tackling the Black-Scholes equations in finance. Advances in numerical methods, algorithms, software, and hardware over the last 60 years have enabled simulation frontiers that were unimaginable a couple of decades ago. However, there are increasing concerns that such advances are not sustainable. The energy demands of computers are soaring, while the availability of vast amounts of data and Machine Learning(ML) techniques are challenging classical methods of inference and even the need of PDE based forecasting of complex systems. I believe that the relationship between ML and PDEs needs to be reset. PDEs are not the only answer to modeling and ML is not necessarily a replacement, but a potent companion of human thinking. Algorithmic alloys of scientific computing and ML present a disruptive potential for the reliable and robust forecasting of complex systems. In order to achieve these advances, we argue for a rigorous assessment of their relative merits and drawbacks and the adoption of probabilistic thinking for developing complementary concepts between ML and scientific computing. The convergence of AI and scientific computing opens new horizons for scientific discovery and effective decision-making.
Interpretable learning of effective dynamics for multiscale systems
The modelling and simulation of high-dimensional multiscale systems is a critical challenge across all areas of science and engineering. It is broadly believed that even with today’s computer advances resolving all spatio-temporal scales described by the governing equations remains a remote target. This realization has prompted intense efforts to develop model-order reduction techniques. In recent years, techniques based on deep recurrent neural networks (RNNs) have produced promising results for the modelling and simulation of complex spatiotemporal systems and offer large flexibility in model development as they can incorporate experimental and computational data. However, neural networks lack interpretability, which limits their utility and generalizability across complex systems. Here, we propose a novel framework of interpretable learning effective dynamics (iLED) that offers comparable accuracy to state-of-the-art RNN-based approaches while providing the added benefit of interpretability. The iLED framework is motivated by Mori–Zwanzig and Koopman operator (KO) theory, which justifies the choice of the specific architecture. We demonstrate the effectiveness of the proposed framework in simulations of three benchmark multiscale systems. Our results show that the iLED framework can generate accurate predictions and obtain interpretable dynamics, making it a promising approach for solving high-dimensional multiscale systems.
Deeponet-Enhanced Bayesian Inference for Biphasic Tumor Growth Modeling
Generative learning of the solution of parametric Partial Differential Equations using guided diffusion models and virtual observations
We introduce a generative learning framework to model high-dimensional parametric systems using gradient guidance and virtual observations. We consider systems described by Partial Differential Equations (PDEs) discretized with structured or unstructured grids. The framework integrates multi-level information to generate high fidelity time sequences of the system dynamics. We demonstrate the effectiveness and versatility of our framework with two case studies in incompressible, two dimensional, low Reynolds cylinder flow on an unstructured mesh and incompressible turbulent channel flow on a structured mesh, both parameterized by the Reynolds number. Our results illustrate the framework's robustness and ability to generate accurate flow sequences across various parameter settings, significantly reducing computational costs allowing for efficient forecasting and reconstruction of flow dynamics.
Generative learning for forecasting the dynamics of high-dimensional complex systems
We introduce generative models for accelerating simulations of high-dimensional systems through learning and evolving their effective dynamics. In the proposed Generative Learning of Effective Dynamics (G-LED), instances of high dimensional data are down sampled to a lower dimensional manifold that is evolved through an auto-regressive attention mechanism. In turn, Bayesian diffusion models, that map this low-dimensional manifold onto its corresponding high-dimensional space, operate on batches of physics correlated, time sequences of data and capture the statistics of the system dynamics. We demonstrate the capabilities and drawbacks of G-LED in simulations of several benchmark systems, including the Kuramoto-Sivashinsky (KS) equation, two-dimensional high Reynolds number flow over a backward-facing step, and simulations of three-dimensional turbulent channel flow. The results demonstrate that generative learning offers new frontiers for the accurate forecasting of the statistical properties of high-dimensional systems at a reduced computational cost. The forecasting of critical phenomena in complex systems governed by partial differential equations remains challenging and computationally expensive. The authors propose a generative learning approach for the forecasting of the statistical properties of high-dimensional systems at a reduced computational cost.
Deconstructing Recurrence, Attention, and Gating: Investigating the transferability of Transformers and Gated Recurrent Neural Networks in forecasting of dynamical systems
Machine learning architectures, including transformers and recurrent neural networks (RNNs) have revolutionized forecasting in applications ranging from text processing to extreme weather. Notably, advanced network architectures, tuned for applications such as natural language processing, are transferable to other tasks such as spatiotemporal forecasting tasks. However, there is a scarcity of ablation studies to illustrate the key components that enable this forecasting accuracy. The absence of such studies, although explainable due to the associated computational cost, intensifies the belief that these models ought to be considered as black boxes. In this work, we decompose the key architectural components of the most powerful neural architectures, namely gating and recurrence in RNNs, and attention mechanisms in transformers. Then, we synthesize and build novel hybrid architectures from the standard blocks, performing ablation studies to identify which mechanisms are effective for each task. The importance of considering these components as hyper-parameters that can augment the standard architectures is exhibited on various forecasting datasets, from the spatiotemporal chaotic dynamics of the multiscale Lorenz 96 system, the Kuramoto-Sivashinsky equation, as well as standard real world time-series benchmarks. A key finding is that neural gating and attention improves the performance of all standard RNNs in most tasks, while the addition of a notion of recurrence in transformers is detrimental. Furthermore, our study reveals that a novel, sparsely used, architecture which integrates Recurrent Highway Networks with neural gating and attention mechanisms, emerges as the best performing architecture in high-dimensional spatiotemporal forecasting of dynamical systems.
Physics-Regularized Multi-Modal Image Assimilation for Brain Tumor Localization
Physical models in the form of partial differential equations serve as important priors for many under-constrained problems. One such application is tumor treatment planning, which relies on accurately estimating the spatial distribution of tumor cells within a patient's anatomy. While medical imaging can detect the bulk of a tumor, it cannot capture the full extent of its spread, as low-concentration tumor cells often remain undetectable, particularly in glioblastoma, the most common primary brain tumor. Machine learning approaches struggle to estimate the complete tumor cell distribution due to a lack of appropriate training data. Consequently, most existing methods rely on physics-based simulations to generate anatomically and physiologically plausible estimations. However, these approaches face challenges with complex and unknown initial conditions and are constrained by overly rigid physical models. In this work, we introduce a novel method that integrates data-driven and physics-based cost functions, akin to Physics-Informed Neural Networks (PINNs). However, our approach parametrizes the solution directly on a dynamic discrete mesh, allowing for the effective modeling of complex biomechanical behaviors. Specifically, we propose a unique discretization scheme that quantifies how well the learned spatiotemporal distributions of tumor and brain tissues adhere to their respective growth and elasticity equations. This quantification acts as a regularization term, offering greater flexibility and improved integration of patient data compared to existing models. We demonstrate enhanced coverage of tumor recurrence areas using real-world data from a patient cohort, highlighting the potential of our method to improve model-driven treatment planning for glioblastoma in clinical practice.
Learning on predictions: Fusing training and autoregressive inference for long-term spatiotemporal forecasts
Predictions of complex systems ranging from natural language processing to weather forecasting have benefited from advances in Recurrent Neural Networks (RNNs). RNNs are typically trained using techniques like Backpropagation Through Time (BPTT) to minimize one-step-ahead prediction loss. During testing, RNNs often operate in an auto-regressive mode, with the output of the network fed back into its input. However, this process can eventually result in exposure bias since the network has been trained to process ”ground-truth” data rather than its own predictions. This inconsistency causes errors that compound over time, indicating that the distribution of data used for evaluating losses differs from the actual operating conditions encountered by the model during training. Inspired by the solution to this challenge in language processing networks we propose the Scheduled Autoregressive Truncated Backpropagation Through Time (BPTT-SA) algorithm for predicting complex dynamical systems using RNNs. We find that BPTT-SA effectively reduces iterative error propagation in Convolutional and Convolutional Autoencoder RNNs and demonstrates its capabilities in the long-term prediction of high-dimensional fluid flows. • RNNs trained with teacher forcing (TF) suffer from the exposure bias effect • Exposure bias is the incosistentcy between TF training and autoregressive inference • Scheduled Autoregressive BPTT (BPTT-SA) alleviates the exposure bias effect • We employ BPTT-SA for long-term forecasting of the Navier-Stokes flow past a cylinder • BPTT-SA improves long-term forecasting accuracy for CNN-RNNs, and Conv-RNNs
An interpretable wildfire spreading model for real-time predictions
Forest fires pose a natural threat with devastating social, environmental, and economic implications. The rapid and highly uncertain rate of spread of wildfires necessitates a trustworthy digital tool capable of providing real-time estimates of fire evolution and human interventions, while receiving continuous input from remote sensing. The current work aims at developing an interpretable, physics-based model that will serve as the core of such a tool. This model is constructed using easily understandable equations, incorporating a limited set of parameters that capture essential quantities and heat transport mechanisms. The simplicity of the model allows for effective utilization of data from sensory input, enabling optimal estimation of these parameters. In particular, simplified versions of combustion kinetics and mass/energy balances lead to a computationally inexpensive system of differential equations that provide the spatio-temporal evolution of temperature and flammables over a two-dimensional region. The model is validated by comparing its predictions and the effect of parameters such as flammable bulk density, moisture content, and wind speed, with benchmark results. Additionally, the model successfully captures the evolution of the firefront shape and its rate of spread in multiple directions.
Data-driven shape inference in three-dimensional steady state supersonic flows using ODIL and JAX-Fluids
We present a novel data- and first-principles-driven method for inferring the shape of a solid obstacle and its flow field in three-dimensional steady-state supersonic flows. The method combines the Optimizing a Discrete Loss (ODIL) technique with the automatically differentiable JAX-Fluids CFD solver to jointly reconstruct flow fields and obstacle shapes. ODIL minimizes the discrete residual of the governing PDE via gradient descent-based algorithms and inherits the consistency and stability of the chosen numerical discretization. Discrete residuals and their gradients are computed using JAX-Fluids, which features nonlinear shock-capturing schemes and level-set-based immersed solid boundaries. We validate our method on synthetic data for challenging inverse problems, including shape inference of solid obstacles in 3D steady-state supersonic flows. In particular, we study flow around a cylinder, sphere, and ellipse. Two shape representations are investigated: (1) parametric, where the shape is described by a small set of parameters (e.g., radius of the cylinder or sphere) optimized jointly with the flow field, and (2) free-form, where the level-set function is optimized pointwise over the mesh without predefined shapes. For the parametric case, we provide a detailed comparison with Physics-Informed Neural Networks. We demonstrate that the combination of nonlinear shock-capturing discretization and level-set-based interface representation enables accurate inference of obstacle shapes and flow fields via the ODIL method. This approach opens new avenues for solving complex inverse problems in supersonic aerodynamics.
Inertial Focusing of Spherical Particles: The Effects of Rotational Motion
The identification of cells and particles based on their transport properties in microfluidic devices is crucial for numerous applications in biology and medicine. Neutrally buoyant particles transported in microfluidic channels, migrate laterally towards stable locations due to inertial effects. However, the effect of the particle and flow properties on these focusing positions remain largely unknown. We conduct large scale simulations with dissipative particle dynamics, demonstrating that freely moving particles exhibit significant differences in their focusing patterns from particles that are prevented from rotation. In circular pipes, we observe drastic changes in rotating versus non-rotating focusing positions. We demonstrate that rotation-induced lateral lift force is significant, unlike previously believed, and is linearly dependent on the rotation magnitude. A simple phenomenological explanation extending existing theories is presented, that agrees well with our numerical findings. In square ducts, we report four face-centered stable positions for rotating particles, in accordance with experimental studies on a range of Reynolds numbers 50 < Re < 200. However, non-rotating particles stay scattered on a concentric one-dimensional annulus, revealing qualitatively different behavior with respect to the free ones. Our findings suggest new designs for micro-particle and cell sorting in inertia-based microfluidics devices.
Quantitative 3D histochemistry reveals region-specific amyloid-β reduction by the antidiabetic drug netoglitazone
A hallmark of Alzheimer's disease (AD) is the extracellular aggregation of toxic amyloid-beta (Aβ) peptides in form of plaques. Here, we identify netoglitazone, an antidiabetic compound previously tested in humans, as an Aβ aggregation antagonist. Netoglitazone improved cognition and reduced microglia activity in a mouse model of AD. Using quantitative whole-brain three-dimensional histology (Q3D), we precisely identified brain regions where netoglitazone reduced the number and size of Aβ plaques. We demonstrate the utility of Q3D in preclinical drug evaluation for AD by providing a high-resolution brain-wide view of drug efficacy. Applying Q3D has the potential to improve pre-clinical drug evaluation by providing information that can help identify mechanisms leading to brain region-specific drug efficacy.
Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observations
We introduce a generative learning framework to model high-dimensional parametric systems using gradient guidance and virtual observations. We consider systems described by Partial Differential Equations (PDEs) discretized with structured or unstructured grids. The framework integrates multi-level information to generate high fidelity time sequences of the system dynamics. We demonstrate the effectiveness and versatility of our framework with two case studies in incompressible, two dimensional, low Reynolds cylinder flow on an unstructured mesh and incompressible turbulent channel flow on a structured mesh, both parameterized by the Reynolds number. Our results illustrate the framework's robustness and ability to generate accurate flow sequences across various parameter settings, significantly reducing computational costs allowing for efficient forecasting and reconstruction of flow dynamics.
Engineering Toxoplasma gondii secretion systems for intracellular delivery of multiple large therapeutic proteins to neurons
Delivering macromolecules across biological barriers such as the blood-brain barrier limits their application in vivo. Previous work has demonstrated that Toxoplasma gondii, a parasite that naturally travels from the human gut to the central nervous system (CNS), can deliver proteins to host cells. Here we engineered T. gondii's endogenous secretion systems, the rhoptries and dense granules, to deliver multiple large (>100 kDa) therapeutic proteins into neurons via translational fusions to toxofilin and GRA16. We demonstrate delivery in cultured cells, brain organoids and in vivo, and probe protein activity using imaging, pull-down assays, scRNA-seq and fluorescent reporters. We demonstrate robust delivery after intraperitoneal administration in mice and characterize 3D distribution throughout the brain. As proof of concept, we demonstrate GRA16-mediated brain delivery of the MeCP2 protein, a putative therapeutic target for Rett syndrome. By characterizing the potential and current limitations of the system, we aim to guide future improvements that will be required for broader application.
On roads less travelled between AI and computational science
The volume of healthy red blood cells is optimal for advective oxygen transport in arterioles
Red blood cells (RBCs) are vital for transporting oxygen from the lungs to the body's tissues through the intricate circulatory system. They achieve this by binding and releasing oxygen molecules to the abundant hemoglobin within their cytosol. The volume of RBCs affects the amount of oxygen they can carry, yet whether this volume is optimal for transporting oxygen through the circulatory system remains an open question. This study explores, through high-fidelity numerical simulations, the impact of RBC volume on advectve oxygen transport efficiency through arterioles which form the area of greatest flow resistance in the circulatory system. The results show that, strikingly, RBCs with volumes similar to those found in vivo are most efficient to transport oxygen through arterioles. The flow resistance is related to the cell-free layer thickness, which is influenced by the shape and the motion of the RBCs: at low volumes RBCs deform and fold while at high volumes RBCs collide and follow more diffuse trajectories. In contrast, RBCs with a healthy volume maximize the cell-free layer thickness, resulting in a more efficient advectve transport of oxygen.
Learning in two dimensions and controlling in three: Generalizable drag reduction strategies for flows past circular cylinders through deep reinforcement learning
We present the automated discovery of control strategies for drag reduction in cylinder flows. Reinforcement Learning algorithms discover control strategies for two-dimensional configurations that generalize to three dimensional flows. We discuss the physical processes involved in the drag reduction mechanisms along with their generalization capabilities. This work demonstrates a practical approach to handling the computationally intensive task of deploying Reinforcement Leaning for bluff body flow control problems: namely train in 2D and control in 3D.
Drag reduction in a minimal channel flow with scientific multi-agent reinforcement learning
Abstract We study drag reduction in a minimal turbulent channel flow using scientific multi-agent reinforcement learning (SMARL). The flow is controlled by blowing and suction at the wall of an open channel, with observable states derived from flow velocities sensed at adjustable heights. We explore the actions, state, and reward space of SMARL using the off-policy algorithm V-RACER. We compare single- and multi-agent setups, and compare the identified control policies against the well-known mechanism of opposition-control. Our findings demonstrate that off-policy SMARL reduces drag in various experimental setups, surpassing classical opposition-control by up to 20 percentage points.
Optimal navigation of magnetic artificial microswimmers in blood capillaries with deep reinforcement learning
Biomedical applications such as targeted drug delivery, microsurgery, and sensing rely on reaching precise areas within the body in a minimally invasive way. Artificial bacterial flagella (ABFs) have emerged as potential tools for this task by navigating through the circulatory system with the help of external magnetic fields. While their swimming characteristics are well understood in simple settings, their controlled navigation through realistic capillary networks remains a significant challenge due to the complexity of blood flow and the high computational cost of detailed simulations. We address this challenge by conducting numerical simulations of ABFs in retinal capillaries, propelled by an external magnetic field. The simulations are based on a validated blood model that predicts the dynamics of individual red blood cells and their hydrodynamic interactions with ABFs. The magnetic field follows a control policy that brings the ABF to a prescribed target. The control policy is learned with an actor-critic, off-policy reinforcement learning algorithm coupled with a reduced-order model of the system. We show that the same policy robustly guides the ABF to a prescribed target in both the reduced-order model and the fine-grained blood simulations. This approach is suitable for designing robust control policies for personalized medicine at moderate computational cost.