Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

CNN‐based ultrafast solver of stiff ODEs and PDEs for enabling realtime Computational Engineering

CNN‐based ultrafast solver of stiff ODEs and PDEs for enabling realtime Computational Engineering Purpose – This paper seeks to develop, propose and validate, through a series of presentable examples, a comprehensive high‐precision and ultra‐fast computing concept for solving stiff ordinary differential equations (ODEs) and partial differential equations (PDEs) with cellular neural networks (CNN). Design/methodology/approach – The core of the concept developed in this paper is a straight‐forward scheme that we call “nonlinear adaptive optimization (NAOP)”, which is used for a precise template calculation for solving any (stiff) nonlinear ODEs through CNN processors. Findings – One of the key contributions of this work (this is a real breakthrough) is to demonstrate the possibility of mapping/transforming different types of nonlinearities displayed by various classical and well‐known oscillators (e.g. van der Pol‐, Rayleigh‐, Duffing‐, Rössler‐, Lorenz‐, and Jerk‐ oscillators, just to name a few) unto first‐order CNN elementary cells, and thereby enabling the easy derivation of corresponding CNN‐templates. Furthermore, in case of PDEs solving, the same concept also allows a mapping unto first‐order CNN cells while considering one or even more nonlinear terms of the Taylor's series expansion generally used in the transformation of a PDEs in a set of coupled nonlinear ODEs. Therefore, the concept of this paper does significantly contribute to the consolidation of CNN as a universal and ultra‐fast solver of stiff differential equations (both ODEs and PDEs). This clearly enables a CNN‐based, real‐time, ultra‐precise, and low‐cost Computational Engineering. As proof of concept a well‐known prototype of stiff equations (van der Pol) has been considered; the corresponding precise CNN‐templates are derived to obtain precise solutions of this equation. Originality/value – This paper contributes to the enrichment of the literature as the relevant state‐of‐the‐art does not provide a systematic and robust method to solve nonlinear ODEs and/or nonlinear PDEs using the CNN‐paradigm. Further, the “NAOP” concept developed in this paper has been proven to perform accurate and robust calculations. This concept is not based on trial‐and‐error processes as it is the case for various classes of optimization methods/tools (e.g. genetic algorithm, particle swarm, neural networks, etc.). The “NAOP” concept developed in this frame does significantly contribute to the consolidation of CNN as a universal and ultra‐fast solver of nonlinear differential equations (both ODEs and PDEs). An implantation of the concept developed is possible even on embedded digital platforms (e.g. field‐programmable gate array (FPGA), digital signal processing (DSP), graphics processing unit (GPU), etc.); this opens a broad range of applications. On‐going works (as outlook) are using NAOP for deriving precise templates for a selected set of practically interesting PDE models such as Navier Stokes, Schrödinger, Maxwell, etc. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png COMPEL: The International Journal for Computation and Mathematics in Electrical and Electronic Engineering Emerald Publishing

CNN‐based ultrafast solver of stiff ODEs and PDEs for enabling realtime Computational Engineering

Download PDF
17 pages

Loading next page...
 
/lp/emerald-publishing/cnn-based-ultrafast-solver-of-stiff-odes-and-pdes-for-enabling-M21FqXBaeu
Publisher
Emerald Publishing
Copyright
Copyright © 2011 Emerald Group Publishing Limited. All rights reserved.
ISSN
0332-1649
DOI
10.1108/03321641111133235
Publisher site
See Article on Publisher Site

Abstract

Purpose – This paper seeks to develop, propose and validate, through a series of presentable examples, a comprehensive high‐precision and ultra‐fast computing concept for solving stiff ordinary differential equations (ODEs) and partial differential equations (PDEs) with cellular neural networks (CNN). Design/methodology/approach – The core of the concept developed in this paper is a straight‐forward scheme that we call “nonlinear adaptive optimization (NAOP)”, which is used for a precise template calculation for solving any (stiff) nonlinear ODEs through CNN processors. Findings – One of the key contributions of this work (this is a real breakthrough) is to demonstrate the possibility of mapping/transforming different types of nonlinearities displayed by various classical and well‐known oscillators (e.g. van der Pol‐, Rayleigh‐, Duffing‐, Rössler‐, Lorenz‐, and Jerk‐ oscillators, just to name a few) unto first‐order CNN elementary cells, and thereby enabling the easy derivation of corresponding CNN‐templates. Furthermore, in case of PDEs solving, the same concept also allows a mapping unto first‐order CNN cells while considering one or even more nonlinear terms of the Taylor's series expansion generally used in the transformation of a PDEs in a set of coupled nonlinear ODEs. Therefore, the concept of this paper does significantly contribute to the consolidation of CNN as a universal and ultra‐fast solver of stiff differential equations (both ODEs and PDEs). This clearly enables a CNN‐based, real‐time, ultra‐precise, and low‐cost Computational Engineering. As proof of concept a well‐known prototype of stiff equations (van der Pol) has been considered; the corresponding precise CNN‐templates are derived to obtain precise solutions of this equation. Originality/value – This paper contributes to the enrichment of the literature as the relevant state‐of‐the‐art does not provide a systematic and robust method to solve nonlinear ODEs and/or nonlinear PDEs using the CNN‐paradigm. Further, the “NAOP” concept developed in this paper has been proven to perform accurate and robust calculations. This concept is not based on trial‐and‐error processes as it is the case for various classes of optimization methods/tools (e.g. genetic algorithm, particle swarm, neural networks, etc.). The “NAOP” concept developed in this frame does significantly contribute to the consolidation of CNN as a universal and ultra‐fast solver of nonlinear differential equations (both ODEs and PDEs). An implantation of the concept developed is possible even on embedded digital platforms (e.g. field‐programmable gate array (FPGA), digital signal processing (DSP), graphics processing unit (GPU), etc.); this opens a broad range of applications. On‐going works (as outlook) are using NAOP for deriving precise templates for a selected set of practically interesting PDE models such as Navier Stokes, Schrödinger, Maxwell, etc.

Journal

COMPEL: The International Journal for Computation and Mathematics in Electrical and Electronic Engineering – Emerald Publishing

Published: Jul 12, 2011

Keywords: Differential equations; Computers

References

  • Neural network method for solving partial differential equations
    Aarts, P.L.; Veer, P.
  • Use of CNN processors for ultra‐fast solution ODE's and PDE: a renaissance of the analog computer
    Chedjou, J.C.; Kyamakya, K.
  • Cellular neural networks: theory
    Chua, L.O.; Yang, L.
  • Autonomous cellular neural networks: a unified paradigm for pattern formation and active wave propagation
    Chua, L.O.; Hasler, M.; Moschytz, G.S.; Neirynck, J.
  • Implementation of one dimensional CNN array on FPGA‐A design based on Verilog HDL
    Fasih, A.; Chedjou, J.C.; Kyamakya, K.
  • Framework for FPGA based real‐time machine vision direct convolution versus CNN
    Fasih, A.; Schwarzlmüller, C.; Chedjou, J.C.; Kyamakya, K.
  • Solving Ordinary Differential Equations II: Stiff and Differential‐algebraic Problems
    Hairer, E.; Norsett, S.P.; Wanner, G.
  • Accuracy and Stability of Numerical Algorithms
    Higham, N.J.
  • Neural computation of decisions in optimization problems
    Hopfield, J.J.; Tank, D.W.
  • A double time‐scale CNN for solving 2‐d Navier‐stokes equations
    Kozek, T.; Roska, T.
  • Simulating nonlinear waves and partial differential equations via CNN‐part II: typical examples
    Kozek, T.; Chua, L.O.; Roska, T.; Wolf, D.; Tetzlaff, R.; Puffer, F.; Lotz, K.
  • Cellular neural networks – an analogous model for stress analysis of prismatic bars subjected to torsion
    Krstic, I.; Kandic, D.; Reljin, B.
  • Modelling lava flows by cellular nonlinear networks (CNN): preliminary results
    Negro, C.; Fortuna, L.; Vicari, A.
  • Cellular neural network analysis for two‐dimensional bioheat transfer equation
    Niu, J.H.; Wang, H.Z.; Zhang, H.X.; Yan, J.Y.
  • Design and learning with cellular neural networks
    Nossek, J.A.
  • Constrained differential optimization for neural networks
    Platt, J.C.; Barr, A.H.
  • A learning algorithm for cellular neural networks (CNN) solving nonlinear partial differential equations
    Puffer, F.; Tetzlaff, R.; Wolf, D.
  • Modeling nonlinear systems with cellular neural networks
    Puffer, F.; Tetzlaff, R.; Wolf, D.
  • Simulating nonlinear waves and partial differential equations via CNN‐Part I: basic techniques
    Roska, T.; Chua, L.O.; Wolf, D.; Kozek, T.; Tetzlaff, R.; Puffer, F.
  • Neural network for combinatorial optimization: a review of more than a decade of research
    Smith, K.A.
  • Solving differential equations with constructed neural networks
    Tsoulos, I.G.; Gavrilis, D.; Glavas, E.
  • The macroscopic LWR model of the transport equation viewed as a distributed parameter system
    Uzunova, M.; Jolly, D.; Nikolov, E.; Boumediene, K.
  • Multiple training concept for back‐propagation neural networks for use in associative memories
    Wang, Y.F.; Cruz, J.B.; Mulligan, J.H.
  • CNN chip prototyping and development system, design automation day on cellular visual microprocessor
    Zarandy, A.; Roska, T.; Szolgay, P.; Zold, P.S.; Foldesy, P.; Petras, I.
  • Gibbs reaction and diffusion equations
    Zhu, S.C.; Mumford, D.