Must-read Papers on Physics-Informed Neural Networks.

Overview

PINNpapers

Contributed by IDRL lab.

Introduction

Physics-Informed Neural Network (PINN) has achieved great success in scientific computing since 2017. In this repo, we list some representative work on PINNs. Feel free to distribute or use it!

Corrections and suggestions are welcomed.

A script for converting bibtex to the markdown used in this repo is also provided for your convenience.

Software

  1. DeepXDE: A Deep Learning Library for Solving Differential Equations, Lu Lu, Xuhui Meng, Zhiping Mao, George Em Karniadakis, SIAM Review, 2021. [paper][code]
  2. NVIDIA SimNet™: An AI-Accelerated Multi-Physics Simulation Framework, Oliver Hennigh, Susheela Narasimhan, Mohammad Amin Nabian, Akshay Subramaniam, Kaustubh Tangsali, Zhiwei Fang, Max Rietmann, Wonmin Byeon, Sanjay Choudhry, ICCS, 2021. [paper]
  3. SciANN: A Keras wrapper for scientific computations and physics-informed deep learning using artificial neural networks, Ehsan Haghighat, Ruben Juanes, arXiv preprint arXiv:2005.08803, 2020. [paper][code]
  4. Elvet -- a neural network-based differential equation and variational problem solver, Jack Y. Araz, Juan Carlos Criado, Michael Spannowsky, arXiv:2103.14575 [hep-lat, physics:hep-ph, physics:hep-th, stat], 2021. [paper][code]
  5. TensorDiffEq: Scalable Multi-GPU Forward and Inverse Solvers for Physics Informed Neural Networks, Levi D. McClenny, Mulugeta A. Haile, Ulisses M. Braga-Neto, arXiv:2103.16034 [physics], 2021. [paper][code]
  6. PyDEns: a Python Framework for Solving Differential Equations with Neural Networks, Alex Koryagin, er, Roman Khudorozkov, Sergey Tsimfer, arXiv:1909.11544 [cs, stat], 2019. [paper][code]
  7. NeuroDiffEq: A Python package for solving differential equations with neural networks, Feiyu Chen, David Sondak, Pavlos Protopapas, Marios Mattheakis, Shuheng Liu, Devansh Agarwal, Marco Di Giovanni, Journal of Open Source Software, 2020. [paper][code]
  8. Universal Differential Equations for Scientific Machine Learning, Christopher Rackauckas, Yingbo Ma, Julius Martensen, Collin Warner, Kirill Zubov, Rohit Supekar, Dominic Skinner, Ali Ramadhan, Alan Edelman, arXiv:2001.04385 [cs, math, q-bio, stat], 2020. [paper][code]
  9. NeuralPDE: Automating Physics-Informed Neural Networks (PINNs) with Error Approximations, Kirill Zubov, Zoe McCarthy, Yingbo Ma, Francesco Calisto, Valerio Pagliarino, Simone Azeglio, Luca Bottero, Emmanuel Luján, Valentin Sulzer, Ashutosh Bharambe, N Vinchhi, , Kaushik Balakrishnan, Devesh Upadhyay, Chris Rackauckas, arXiv:2107.09443 [cs], 2021. [paper][code]
  10. IDRLnet: A Physics-Informed Neural Network Library, Wei Peng, Jun Zhang, Weien Zhou, Xiaoyu Zhao, Wen Yao, Xiaoqian Chen, arXiv:2107.04320 [cs, math], 2021. [paper][code]

Papers on PINN Models

  1. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations, M. Raissi, P. Perdikaris, G. E. Karniadakis, Journal of Computational Physics, 2019. [paper]
  2. The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems, E Weinan, Bing Yu, Communications in Mathematics and Statistics, 2018. [paper]
  3. DGM: A deep learning algorithm for solving partial differential equations, Justin Sirignano, Konstantinos Spiliopoulos, Journal of Computational Physics, 2018. [paper]
  4. SPINN: Sparse, Physics-based, and partially Interpretable Neural Networks for PDEs, Amuthan A. Ramabathiran, Ramach, Prabhu ran, Journal of Computational Physics, 2021. [paper][code]
  5. Deep neural network methods for solving forward and inverse problems of time fractional diffusion equations with conformable derivative, Yinlin Ye, Yajing Li, Hongtao Fan, Xinyi Liu, Hongbing Zhang, arXiv:2108.07490 [cs, math], 2021. [paper]
  6. NH-PINN: Neural homogenization based physics-informed neural network for multiscale problems, Wing Tat Leung, Guang Lin, Zecheng Zhang, arXiv:2108.12942 [cs, math], 2021. [paper][code]

Papers on Parallel PINN

  1. Parallel Physics-Informed Neural Networks via Domain Decomposition, Khemraj Shukla, Ameya D. Jagtap, George Em Karniadakis, arXiv:2104.10013 [cs], 2021. [paper]
  2. Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equations, Ben Moseley, Andrew Markham, Tarje Nissen-Meyer, arXiv:2107.07871 [physics], 2021. [paper]
  3. PPINN: Parareal physics-informed neural network for time-dependent PDEs, Xuhui Meng, Zhen Li, Dongkun Zhang, George Em Karniadakis, Computer Methods in Applied Mechanics and Engineering, 2020. [paper]

Papers on PINN Accerleration

  1. Self-adaptive loss balanced Physics-informed neural networks for the incompressible Navier-Stokes equations, Zixue Xiang, Wei Peng, Xiaohu Zheng, Xiaoyu Zhao, Wen Yao, arXiv:2104.06217 [physics], 2021. [paper]
  2. A Dual-Dimer method for training physics-constrained neural networks with minimax architecture, Dehao Liu, Yan Wang, Neural Networks, 2021. [paper]
  3. Adversarial Multi-task Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations, Pongpisit Thanasutives, Masayuki Numao, Ken-ichi Fukui, arXiv:2104.14320 [cs, math], 2021. [paper]
  4. DPM: A Novel Training Method for Physics-Informed Neural Networks in Extrapolation, Jungeun Kim, Kookjin Lee, Dongeun Lee, Sheo Yon Jin, Noseong Park, AAAI, 2021. [paper]

Papers on Model Transfer & Meta-Learning

  1. A physics-aware learning architecture with input transfer networks for predictive modeling, Amir Behjat, Chen Zeng, Rahul Rai, Ion Matei, David Doermann, Souma Chowdhury, Applied Soft Computing, 2020. [paper]
  2. Transfer learning based multi-fidelity physics informed deep neural network, Souvik Chakraborty, Journal of Computational Physics, 2021. [paper]
  3. Transfer learning enhanced physics informed neural network for phase-field modeling of fracture, Somdatta Goswami, Cosmin Anitescu, Souvik Chakraborty, Timon Rabczuk, Theoretical and Applied Fracture Mechanics, 2020. [paper]
  4. Meta-learning PINN loss functions, Apostolos F. Psaros, Kenji Kawaguchi, George Em Karniadakis, arXiv:2107.05544 [cs], 2021. [paper]

Papers on Probabilistic PINNs and Uncertainty Quantification

  1. A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the Small Data regime, Constantin Grigo, Phaedon-Stelios Koutsourelakis, Journal of Computational Physics, 2019. [paper]
  2. Adversarial uncertainty quantification in physics-informed neural networks, Yibo Yang, Paris Perdikaris, Journal of Computational Physics, 2019. [paper]
  3. B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data, Liu Yang, Xuhui Meng, George Em Karniadakis, Journal of Computational Physics, 2021. [paper]
  4. PID-GAN: A GAN Framework based on a Physics-informed Discriminator for Uncertainty Quantification with Physics, Arka Daw, M. Maruf, Anuj Karpatne, arXiv:2106.02993 [cs, stat], 2021. [paper]
  5. Quantifying Uncertainty in Physics-Informed Variational Autoencoders for Anomaly Detection, Marcus J. Neuer, ESTEP, 2020. [paper]
  6. A Physics-Data-Driven Bayesian Method for Heat Conduction Problems, Xinchao Jiang, Hu Wang, Yu li, arXiv:2109.00996 [cs, math], 2021. [paper][code]
  7. Wasserstein Generative Adversarial Uncertainty Quantification in Physics-Informed Neural Networks, Yihang Gao, Michael K. Ng, arXiv:2108.13054 [cs, math], 2021. [paper][code]

Papers on Applications

  1. Physics-informed neural networks for high-speed flows, Zhiping Mao, Ameya D. Jagtap, George Em Karniadakis, Computer Methods in Applied Mechanics and Engineering, 2020. [paper]
  2. Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data, Luning Sun, Han Gao, Shaowu Pan, Jian-Xun Wang, Computer Methods in Applied Mechanics and Engineering, 2020. [paper]
  3. Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations, Maziar Raissi, Alireza Yazdani, George Em Karniadakis, Science, 2020. [paper]
  4. NSFnets (Navier-Stokes flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations, Xiaowei Jin, Shengze Cai, Hui Li, George Em Karniadakis, Journal of Computational Physics, 2021. [paper]
  5. A High-Efficient Hybrid Physics-Informed Neural Networks Based on Convolutional Neural Network, Zhiwei Fang, IEEE Transactions on Neural Networks and Learning Systems, 2021. [paper]
  6. A Study on a Feedforward Neural Network to Solve Partial Differential Equations in Hyperbolic-Transport Problems, Eduardo Abreu, Joao B. Florindo, ICCS, 2021. [paper]
  7. A Physics Informed Neural Network Approach to Solution and Identification of Biharmonic Equations of Elasticity, Mohammad Vahab, Ehsan Haghighat, Maryam Khaleghi, Nasser Khalili, arXiv:2108.07243 [cs], 2021. [paper]
  8. Prediction of porous media fluid flow using physics informed neural networks, Muhammad M. Almajid, Moataz O. Abu-Alsaud, Journal of Petroleum Science and Engineering, 2021. [paper]
  9. Investigating a New Approach to Quasinormal Modes: Physics-Informed Neural Networks, Anele M. Ncube, Gerhard E. Harmsen, Alan S. Cornell, arXiv:2108.05867 [gr-qc], 2021. [paper]
  10. Towards neural Earth system modelling by integrating artificial intelligence in Earth system science, Christopher Irrgang, Niklas Boers, Maike Sonnewald, Elizabeth A. Barnes, Christopher Kadow, Joanna Staneva, Jan Saynisch-Wagner, Nature Machine Intelligence, 2021. [paper]
  11. Physics-informed Neural Network for Nonlinear Dynamics in Fiber Optics, Xiaotian Jiang, Danshi Wang, Qirui Fan, Min Zhang, Chao Lu, Alan Pak Tao Lau, arXiv:2109.00526 [physics], 2021. [paper][code]

Papers on PINN Analysis

  1. Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs, Siddhartha Mishra, Roberto Molinaro, IMA Journal of Numerical Analysis, 2021. [paper]
  2. Error analysis for physics informed neural networks (PINNs) approximating Kolmogorov PDEs, Tim De Ryck, Siddhartha Mishra, arXiv:2106.14473 [cs, math], 2021. [paper]
  3. Error Analysis of Deep Ritz Methods for Elliptic Equations, Yuling Jiao, Yanming Lai, Yisu Luo, Yang Wang, Yunfei Yang, arXiv:2107.14478 [cs, math], 2021. [paper]
Owner
IDRL
Intelligent Design and Robust Learning Laboratory
IDRL
AI Toolkit for Healthcare Imaging

Medical Open Network for AI MONAI is a PyTorch-based, open-source framework for deep learning in healthcare imaging, part of PyTorch Ecosystem. Its am

Project MONAI 3.7k Jan 07, 2023
Implementation of "StrengthNet: Deep Learning-based Emotion Strength Assessment for Emotional Speech Synthesis"

StrengthNet Implementation of "StrengthNet: Deep Learning-based Emotion Strength Assessment for Emotional Speech Synthesis" https://arxiv.org/abs/2110

RuiLiu 65 Dec 20, 2022
Streamlit tool to explore coco datasets

What is this This tool given a COCO annotations file and COCO predictions file will let you explore your dataset, visualize results and calculate impo

Jakub Cieslik 75 Dec 16, 2022
Self-Supervised Contrastive Learning of Music Spectrograms

Self-Supervised Music Analysis Self-Supervised Contrastive Learning of Music Spectrograms Dataset Songs on the Billboard Year End Hot 100 were collect

27 Dec 10, 2022
Hub is a dataset format with a simple API for creating, storing, and collaborating on AI datasets of any size.

Hub is a dataset format with a simple API for creating, storing, and collaborating on AI datasets of any size. The hub data layout enables rapid transformations and streaming of data while training m

Activeloop 5.1k Jan 08, 2023
AgeGuesser: deep learning based age estimation system. Powered by EfficientNet and Yolov5

AgeGuesser AgeGuesser is an end-to-end, deep-learning based Age Estimation system, presented at the CAIP 2021 conference. You can find the related pap

5 Nov 10, 2022
Unofficial Tensorflow-Keras implementation of Fastformer based on paper [Fastformer: Additive Attention Can Be All You Need](https://arxiv.org/abs/2108.09084).

Fastformer-Keras Unofficial Tensorflow-Keras implementation of Fastformer based on paper Fastformer: Additive Attention Can Be All You Need. Tensorflo

Yam Peleg 10 Jan 30, 2022
Repo for paper "Dynamic Placement of Rapidly Deployable Mobile Sensor Robots Using Machine Learning and Expected Value of Information"

Repo for paper "Dynamic Placement of Rapidly Deployable Mobile Sensor Robots Using Machine Learning and Expected Value of Information" Notes I probabl

Berkeley Expert System Technologies Lab 0 Jul 01, 2021
[ICML 2022] The official implementation of Graph Stochastic Attention (GSAT).

Graph Stochastic Attention (GSAT) The official implementation of GSAT for our paper: Interpretable and Generalizable Graph Learning via Stochastic Att

85 Nov 27, 2022
68 keypoint annotations for COFW test data

68 keypoint annotations for COFW test data This repository contains manually annotated 68 keypoints for COFW test data (original annotation of CFOW da

31 Dec 06, 2022
Meta Representation Transformation for Low-resource Cross-lingual Learning

MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning This repo hosts the code for MetaXL, published at NAACL 2021. [Meta

Microsoft 36 Aug 17, 2022
[SIGGRAPH 2022 Journal Track] AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars

AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars Fangzhou Hong1*  Mingyuan Zhang1*  Liang Pan1  Zhongang Cai1,2,3  Lei Yang2 

Fangzhou Hong 749 Jan 04, 2023
Identifying a Training-Set Attack’s Target Using Renormalized Influence Estimation

Identifying a Training-Set Attack’s Target Using Renormalized Influence Estimation By: Zayd Hammoudeh and Daniel Lowd Paper: Arxiv Preprint Coming soo

Zayd Hammoudeh 2 Oct 08, 2022
Distributed Evolutionary Algorithms in Python

DEAP DEAP is a novel evolutionary computation framework for rapid prototyping and testing of ideas. It seeks to make algorithms explicit and data stru

Distributed Evolutionary Algorithms in Python 4.9k Jan 05, 2023
deep learning model with only python and numpy with test accuracy 99 % on mnist dataset and different optimization choices

deep_nn_model_with_only_python_100%_test_accuracy deep learning model with only python and numpy with test accuracy 99 % on mnist dataset and differen

0 Aug 28, 2022
🔥🔥High-Performance Face Recognition Library on PaddlePaddle & PyTorch🔥🔥

face.evoLVe: High-Performance Face Recognition Library based on PaddlePaddle & PyTorch Evolve to be more comprehensive, effective and efficient for fa

Zhao Jian 3.1k Jan 02, 2023
Codes for paper "KNAS: Green Neural Architecture Search"

KNAS Codes for paper "KNAS: Green Neural Architecture Search" KNAS is a green (energy-efficient) Neural Architecture Search (NAS) approach. It contain

90 Dec 22, 2022
an Evolutionary Algorithm assisted GAN

EvoGAN an Evolutionary Algorithm assisted GAN ckpts

3 Oct 09, 2022
Turning SymPy expressions into JAX functions

sympy2jax Turn SymPy expressions into parametrized, differentiable, vectorizable, JAX functions. All SymPy floats become trainable input parameters. S

Miles Cranmer 38 Dec 11, 2022
AI grand challenge 2020 Repo (Speech Recognition Track)

KorBERT를 활용한 한국어 텍스트 기반 위협 상황인지(2020 인공지능 그랜드 챌린지) 본 프로젝트는 ETRI에서 제공된 한국어 korBERT 모델을 활용하여 폭력 기반 한국어 텍스트를 분류하는 다양한 분류 모델들을 제공합니다. 본 개발자들이 참여한 2020 인공지

Young-Seok Choi 23 Jan 25, 2022