Skip to content

TechnoAS/PhysicsInformedNuralNetwork-V1

Repository files navigation

🌊 Physics-Informed Neural Networks for Solving Partial Differential Equations

PINN Project TensorFlow Python GPU

🔬 Advanced Scientific Computing with Deep Learning

B.Tech Final Year Project - Information Technology

Siddhant Manna | Meghnad Saha Institute of Technology | 2025


📋 Project Overview

This comprehensive research project explores the revolutionary application of Physics-Informed Neural Networks (PINNs) for solving complex partial differential equations (PDEs). Unlike traditional numerical methods, PINNs embed physical laws directly into neural network architectures, creating a powerful framework that bridges deep learning and computational physics.

🎯 Objectives

  • Develop PINN frameworks for multiple PDE types
  • Achieve high accuracy with minimal training data
  • Demonstrate superiority over traditional numerical methods
  • Explore advanced techniques like curriculum learning and Fourier embeddings

📊 Research Statistics

Metric Value Metric Value
📝 Report Pages 60+ 🧠 PDEs Solved 3
💻 Training Time 9 min 3 sec 📚 References 13+
🎯 Best L2 Error 6.8×10⁻⁴ 🔧 GPU Used NVIDIA T4
Max Iterations 150,000 📈 Convergence Achieved

🔬 Solved Equations

1. Burgers' Equation

$$∂u/∂t + u∂u/∂x = ν∂²u/∂x²$$
  • Application: Fluid dynamics, shock wave modeling
  • Achievement: L2 error of 6.8×10⁻⁴
  • Training Time: 9 minutes on NVIDIA T4

2. Allen-Cahn Equation

$$∂u/∂t = ε²∇²u + u(1-u²)$$
  • Application: Phase separation, material science
  • Key Feature: Multi-component alloy modeling
  • Enhancement: Curriculum learning integration

3. Time-Dependent Eikonal Equation

$$∂S/∂t + |∇S| = 1$$
  • Application: Wave propagation, optimal path planning
  • Innovation: Backward time integration
  • Performance: Superior to fast-sweeping methods

🎨 Research Visualizations

📍 Collocation Points Distribution

Collocation Points Figure 1: Distribution of 10,000 collocation points, 50 initial conditions, and 50 boundary points for PINN training

📉 Training Loss Convergence

Loss Convergence Figure 2: PINN training loss convergence over 5,000 epochs with piecewise learning rate decay, achieving L2 error of 6.8×10⁻⁴

🌊 3D Burgers Solution Surface

3D Solution Figure 3: 3D visualization of Burgers equation solution showing shock formation at t=0.4 and temporal evolution

⚖️ Comparative Analysis: Traditional vs PINN

Comparison Figure 4: Side-by-side comparison demonstrating PINN advantages over traditional numerical methods


🏗️ Architecture & Methodology

🧠 Network Architecture

  • Hidden Layers: 8-9 layers with 20 neurons each
  • Activation: Hyperbolic tangent (tanh)
  • Normalization: Input scaling to [-1,1]
  • Boundary Encoding: Strict Dirichlet condition adherence

⚡ Advanced Techniques

Curriculum Learning

  • Progressive parameter complexity increase
  • Stage-wise training approach
  • Enhanced stability for complex PDEs

Causal Training

  • Time-dependent accuracy enforcement
  • Temporal causality preservation
  • Improved generalization over time

Fourier Feature Embedding (FFE)

  • Spatial periodicity encoding
  • Dramatic error reduction (2+ orders of magnitude)
  • Enhanced spatial accuracy

📈 Experimental Results

🎯 Performance Achievements

Equation Method L2 Error Training Time
Burgers PINN 6.8×10⁻⁴ 9 min 3 sec
Allen-Cahn PINN+FFE Significantly reduced -
Eikonal PINN+Causal Superior accuracy 150k iterations

📊 Comparative Analysis

  • PINNs vs Traditional: Higher accuracy with less computational resources
  • FFE Enhancement: 2+ orders of magnitude error reduction
  • Causal Training: Consistent convergence advantages
  • GPU Acceleration: Optimal performance on NVIDIA T4

🛠️ Technical Implementation

Hardware Setup

  • GPU: NVIDIA T4 Tensor Core
  • Platform: Google Colab
  • Precision: Float32 optimization
  • Memory: Optimized for large-scale problems

Software Stack

tensorflow >= 2.x      # Deep learning framework
numpy                  # Numerical computations
matplotlib             # Visualization
scipy                  # Scientific computing

Key Algorithms

  • Automatic Differentiation: TensorFlow GradientTape
  • Optimization: Adam with adaptive learning rates
  • Loss Functions: Multi-component physics-informed loss
  • Sampling: Uniform and adaptive collocation strategies

📚 Research Contributions

🔬 Theoretical Advances

  • Novel PINN formulations for time-dependent PDEs
  • Integration of curriculum learning with physics constraints
  • Causal training methodology for temporal problems
  • FFE enhancement for periodic boundary conditions

💻 Practical Implementations

  • Efficient GPU-accelerated training pipelines
  • Boundary-encoded output layers
  • Multi-stage training protocols
  • Comprehensive error analysis frameworks

📊 Experimental Validation

  • Rigorous comparison with analytical solutions
  • Performance benchmarking against traditional methods
  • Scalability analysis across different problem sizes
  • Robustness testing under various conditions

🚀 Applications & Impact

🏭 Industrial Applications

  • Fluid Dynamics: Turbulence modeling, flow optimization
  • Materials Science: Alloy design, phase prediction
  • Geophysics: Seismic wave propagation, exploration
  • Robotics: Path planning, navigation systems

🎓 Educational Value

  • Graduate Research: Advanced numerical methods
  • Computational Physics: Modern simulation techniques
  • Machine Learning: Physics-informed AI development
  • Engineering: Real-world problem solving

🔮 Future Directions

🚧 Planned Enhancements

  • Multi-GPU Training: Distributed computing support
  • 3D Extensions: Complex geometry handling
  • Real-time Inference: Optimized deployment
  • Uncertainty Quantification: Bayesian extensions
  • Hybrid Methods: Classical-neural combinations

🌟 Research Opportunities

  • Anisotropic Media: Complex material properties
  • Multi-Physics Coupling: Interdisciplinary problems
  • Inverse Problems: Parameter identification
  • Transfer Learning: Cross-domain applications

📄 Academic Details

🎓 Project Information

  • Title: Solution of Partial Differential Equations Using Physics Informed Neural Network
  • Author: Siddhant Manna (Roll: 14200222065, Reg: 221420120620)
  • Supervisor: Assistant Professor Indrajit Das
  • Institution: Meghnad Saha Institute of Technology
  • Department: Information Technology
  • Year: 2025

📚 Key References

  • Raissi et al. (2019): Foundational PINN methodology
  • Karniadakis et al. (2021): Physics-informed machine learning
  • Multiple domain-specific applications and enhancements

🏆 Achievements

  • ✅ High Accuracy: L2 error of 6.8×10⁻⁴ for Burgers equation
  • ✅ Computational Efficiency: 9-minute training on single GPU
  • ✅ Novel Techniques: FFE, curriculum learning, causal training
  • ✅ Comprehensive Validation: Multiple PDE types solved
  • ✅ Research Impact: Advancing scientific computing methods

🚀 Quick Start

Prerequisites

pip install tensorflow numpy matplotlib scipy

Usage

# Clone the repository
git clone <repository-url>
cd pinn-pde-solver

# Run the main PINN implementation
python Physics-Informed-Neural-Network.py

# Visualize results
python visualize_results.py

📞 Contact & Collaboration

For research collaboration, technical discussions, or project inquiries:

LinkedIn


⭐ If this research contributes to your work, please consider citing! ⭐

Made with ❤️ for Science

Advancing the frontiers of computational physics through deep learning 🚀

About

TensorFlow 2.x implementation of Physics-Informed Neural Networks for solving the nonlinear viscous Burgers equation.This cutting-edge project demonstrates how deep learning can incorporate fundamental physical laws directly into neural network training processes, eliminating the need for traditional numerical discretization methods entirely

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages