# zbMATH — the first resource for mathematics

A dynamical view of nonlinear conjugate gradient methods with applications to FFT-based computational micromechanics. (English) Zbl 07229270
Summary: For fast Fourier transform (FFT)-based computational micromechanics, solvers need to be fast, memory-efficient, and independent of tedious parameter calibration. In this work, we investigate the benefits of nonlinear conjugate gradient (CG) methods in the context of FFT-based computational micromechanics. Traditionally, nonlinear CG methods require dedicated line-search procedures to be efficient, rendering them not competitive in the FFT-based context. We contribute to nonlinear CG methods devoid of line searches by exploiting similarities between nonlinear CG methods and accelerated gradient methods. More precisely, by letting the step-size go to zero, we exhibit the Fletcher-Reeves nonlinear CG as a dynamical system with state-dependent nonlinear damping. We show how to implement nonlinear CG methods for FFT-based computational micromechanics, and demonstrate by numerical experiments that the Fletcher-Reeves nonlinear CG represents a competitive, memory-efficient and parameter-choice free solution method for linear and nonlinear homogenization problems, which, in addition, decreases the residual monotonically.

##### MSC:
 74S25 Spectral and related methods applied to problems in solid mechanics 74M25 Micromechanics of solids
FFTW; L-BFGS
Full Text:
##### References:
 [1] Moulinec, H.; Suquet, P., A fast numerical method for computing the linear and nonlinear mechanical properties of composites, C R Acad Sci Sér II, 318, 11, 1417-1423 (1994) · Zbl 0799.73077 [2] Moulinec, H.; Suquet, P., A numerical method for computing the overall response of nonlinear composites with complex microstructure, Comput Methods Appl Mech Eng, 157, 69-94 (1998) · Zbl 0954.74079 [3] Frigo, M.; Johnson, SG, The design and Implementation of FFTW3, Proc IEEE, 93, 216-231 (2005) [4] Matouš, K.; Geers, MGD; Kouznetsova, VG; Gillman, A., A review of predictive nonlinear theories for multiscale modeling of heterogeneous materials, J Comput Phys, 330, 192-220 (2017) [5] Spahn, J.; Andrä, H.; Kabel, M.; Müller, R., A multiscale approach for modeling professive damage of composite materials using fast Fourier transforms, Comput Methods Appl Mech Eng, 268, 871-883 (2014) · Zbl 1295.74006 [6] Michel, JC; Suquet, P., Nonuniform transformation field analysis, Int J Solids Struct, 40, 6937-6955 (2003) · Zbl 1057.74031 [7] Fritzen, F.; Leuschner, M., Reduced basis hybrid computational homogenization based on a mixed incremental formulation, Comput Methods Appl Mech Eng, 260, 143-154 (2013) · Zbl 1286.74081 [8] Köbler, J.; Schneider, M.; Ospald, F.; Andrä, H.; Müller, R., Fiber orientation interpolation for the multiscale analysis of short fiber reinforced composite parts, Comput Mech, 61, 6, 729-750 (2018) · Zbl 1446.74024 [9] Liu, Z.; Wu, CT; Koishi, M., A deep material network for multiscale topology learning and accelerated nonlinear modeling of heterogeneous materials, Comput Methods Appl Mech Eng, 345, 1138-1168 (2019) · Zbl 1440.74340 [10] Liu, Z.; Wu, C., Exploring the 3D architectures of deep material network in data-driven multiscale mechanics, J Mech Phys Solids, 127, 20-46 (2019) [11] Lahellec, N.; Michel, J. C.; Moulinec, H.; Suquet, P., Analysis of Inhomogeneous Materials at Large Strains using Fast Fourier Transforms, IUTAM Symposium on Computational Mechanics of Solid Materials at Large Strains, 247-258 (2003), Dordrecht: Springer Netherlands, Dordrecht · Zbl 1039.74040 [12] Eisenlohr, P.; Diehl, M.; Lebensohn, RA; Roters, F., A spectral method solution to crystal elasto-viscoplasticity at finite strains, Int J Plast, 46, 37-53 (2013) [13] Biner, SB; Hu, SY, Simulation of damage evolution in composites: a phase-field model, Acta Mater, 57, 2088-2097 (2009) [14] Sharma, L.; Peerlings, RHJ; Shanthraj, P.; Roters, F.; Geers, MGD, An FFT-based spectral solver for interface decohesion modelling using a gradient damage approach, Comput Mech, 65, 925-939 (2020) · Zbl 07185488 [15] Lucarini, S.; Seguarado, J., An upscaling approach for micromechanics based fatigue: from RVEs to specimens and component life prediction, Int J Fract, 223, 93-108 (2020) [16] Schneider, M., An FFT-based method for computing weighted minimal surfaces in microstructures with applications to the computational homogenization of brittle fracture, Int J Numer Methods Eng, 121, 1367-1387 (2020) [17] Vondřejc, J.; Zeman, J.; Marek, I., Guaranteed upper-lower bounds on homogenized properties by FFT-based Galerkin method, Comput Methods Appl Mech Eng, 297, 258-291 (2015) · Zbl 1423.74806 [18] Brisard, S.; Dormieux, L., FFT-based methods for the mechanics of composites: a general variational framework, Comput Mater Sci, 49, 3, 663-671 (2010) [19] Brisard, S.; Dormieux, L., Combining Galerkin approximation techniques with the principle of Hashin and Shtrikman to derive a new FFT-based numerical method for the homogenization of composites, Comput Methods Appl Mech Eng, 217-220, 197-212 (2012) · Zbl 1253.74101 [20] Schneider, M.; Merkert, D.; Kabel, M., FFT-based homogenization for microstructures discretized by linear hexahedral elements, Int J Numer Methods Eng, 109, 10, 1461-1489 (2017) · Zbl 1378.74056 [21] Schneider, M.; Ospald, F.; Kabel, M., Computational homogenization of elasticity on a staggered grid, Int J Numer Methods Eng, 105, 9, 693-720 (2016) [22] Willot, F., Fourier-based schemes for computing the mechanical response of composites with accurate local fields, C R Méc, 343, 3, 232-245 (2015) [23] Dorn, C.; Schneider, M., Lippmann-Schwinger solvers for the explicit jump discretization for thermal computational homogenization problems, Int J Numer Methods Eng, 118, 11, 631-653 (2019) [24] Tu, F.; Jiao, Y.; Zhou, X.; Cheng, Y.; Tan, F., The implementation of B-splines to Hashin and Shtrikman variational principle based FFT method for the homogenization of composite, Int J Solids Struct, 191-192, 133-145 (2019) [25] Eyre, DJ; Milton, GW, A fast numerical scheme for computing the response of composites using grid refinement, Eur Phys J Appl Phys, 6, 1, 41-47 (1999) [26] Michel, JC; Moulinec, H.; Suquet, P., A computational scheme for linear and non-linear composites with arbitrary phase contrast, Int J Numer Methods Eng, 52, 139-160 (2001) [27] Monchiet, V.; Bonnet, G., A polarization-based FFT iterative scheme for computing the effective properties of elastic composites with arbitrary contrast, Int J Numer Methods Eng, 89, 1419-1436 (2012) · Zbl 1242.74197 [28] Moulinec, H.; Silva, F., Comparison of three accelerated FFT-based schemes for computing the mechanical response of composite materials, Int J Numer Methods Eng, 97, 960-985 (2014) · Zbl 1352.74223 [29] Schneider, M.; Wicht, D.; Böhlke, T., On polarization-based schemes for the FFT-based computational homogenization of inelastic materials, Comput Mech, 64, 4, 1073-1095 (2019) · Zbl 07119152 [30] Douglas, J.; Rachford, HH, On the numerical solution of heat conduction problems in two and three space variables, Trans Am Math Soc, 82, 421-439 (1956) · Zbl 0070.35401 [31] Zeman, J.; Vondřejc, J.; Novak, J.; Marek, I., Accelerating a FFT-based solver for numerical homogenization of periodic media by conjugate gradients, J Comput Phys, 229, 21, 8065-8071 (2010) · Zbl 1197.65191 [32] Paige, CC; Saunders, MA, Solution of sparse indefinite systems of linear equations, SIAM J Numer Anal, 12, 4, 617-629 (1975) · Zbl 0319.65025 [33] Gélébart, L.; Mondon-Cancel, R., Non-linear extension of FFT-based methods accelerated by conjugate gradients to evaluate the mechanical behavior of composite materials, Comput Mater Sci, 77, 430-439 (2013) [34] Kabel, M.; Böhlke, T.; Schneider, M., Efficient fixed point and Newton-Krylov solvers for FFT-based homogenization of elasticity at large deformations, Comput Mech, 54, 6, 1497-1514 (2014) · Zbl 1309.74013 [35] Wicht, D.; Schneider, M.; Böhlke, T., On Quasi-Newton methods in FFT-based micromechanics, Int J Numer Methods Eng, 121, 1665-1694 (2020) [36] Schneider, M., An FFT-based fast gradient method for elastic and inelastic unit cell homogenization problems, Comput Methods Appl Mech Eng, 315, 846-866 (2017) · Zbl 1439.74505 [37] Ernesti, F.; Schneider, M.; Böhlke, T., Fast implicit solvers for phase-field fracture problems on heterogeneous microstructures, Comput Methods Appl Mech Eng, 363, 112793 (2020) · Zbl 1436.74062 [38] Shantraj, P.; Eisenlohr, P.; Diehl, M.; Roters, F., Numerically robust spectral methods for crystal plasticity simulations of heterogeneous materials, Int J Plast, 66, 31-45 (2015) [39] Schneider, M., On the Barzilai-Borwein basic scheme in FFT-based computational homogenization, Int J Numer Methods Eng, 118, 482-494 (2019) [40] Fletcher, R.; Reeves, C., Function minimization by conjugate gradients, Comput J, 7, 149-154 (1964) · Zbl 0132.11701 [41] Hestenes, M.; Stiefel, E., Methods of conjugate gradients for solving linear systems, J Res Nat Bur Standards, 49, 409-436 (1952) · Zbl 0048.09901 [42] Nocedal, J.; Wright, SJ, Numerical optimization (1999), Berlin: Springer, Berlin [43] Polak, E.; Ribière, G., Note sur la convergence de directions conjugées, Rev Fr Inf Rech Opert 3e Ann, 16, 35-43 (1969) · Zbl 0174.48001 [44] Polyak, BT, The conjugate gradient method in extremum problems, USSR Comput Math Math Phys, 9, 94-112 (1969) [45] Dai, YH; Yuan, Y., A nonlinear conjugate gradient method with a strong global convergence property, SIAM J Optim, 10, 1, 177-182 (1999) · Zbl 0957.65061 [46] Polyak, BT, Some methods of speeding up the convergence of iteration methods, USSR Comput Math Math Phys, 4, 5, 1-17 (1964) [47] Polyak, BT, Introduction to optimization (1987), New York: Optimization Software, Inc, New York [48] Ghadimi E, Feyzmahdavian HR, Johansson M (2015) Global convergence of the heavy-ball method for convex optimization. In: 2015 European control conference (ECC), pp 310-315 [49] Lessard, L.; Recht, B.; Packard, A., Analysis and design of optimization algorithms via integral quadratic constraints, SIAM J Optim, 26, 1, 57-95 (2016) · Zbl 1329.90103 [50] Sun, J.; Zhang, J., Global convergence of conjugate gradient methods without line search, Ann Oper Res, 103, 161-173 (2001) · Zbl 1014.90071 [51] Powell, MJD; Griffiths, DF, Nonconvex minimization calculations and the conjugate gradient method, Lecture notes in mathematics, 122-141 (2009), Berlin: Springer, Berlin [52] Gilbert, J.; Nocedal, J., Global convergence properties of conjugate gradient methods for optimization, SIAM J Optim, 2, 1, 21-42 (1992) · Zbl 0767.90082 [53] Dai, Y. H.; Yuan, Y., Some Properties of A New Conjugate Gradient Method, Applied Optimization, 251-262 (1998), Boston, MA: Springer US, Boston, MA · Zbl 0914.90219 [54] Hager, WW; Zhang, H., A survey of nonlinear conjugate gradient methods, Pac J Optim, 2, 35-58 (2006) · Zbl 1117.90048 [55] Dai, Y.; Kou, C., A Barzilai-Borwein conjugate gradient method, Sci China Math, 59, 8, 1511-1524 (2016) · Zbl 1352.49031 [56] Broyden, CG, The convergence of a class of double rank minimization algorithms: 2. The new algorithm, J Math Anal Appl, 6, 222-231 (1970) · Zbl 0207.17401 [57] Fletcher, R., A new approach to variable metric algorithms, Comput J, 13, 317-322 (1970) · Zbl 0207.17402 [58] Goldfarb, D., A family of variable metric methods derived by variational means, Math Comput, 24, 23-26 (1970) · Zbl 0196.18002 [59] Shanno, DF, Conditioning of quasi-Newton methods for function minimization, Math Comput, 24, 647-650 (1970) [60] Nocedal, J., Updating quasi-Newton matrices with limited storage, Math Comput, 35, 151, 773-782 (1980) · Zbl 0464.65037 [61] Liu, H.; Liu, Z., An efficient Barzilai-Borwein conjugate gradient method for unconstrained optimization, J Optim Theory Appl, 180, 879-906 (2019) · Zbl 1409.49031 [62] Helmke, U.; Moore, J., Optimization and dynamical systems (1996), Berlin: Springer, Berlin · Zbl 0943.93001 [63] Zavriev, S.; Kostyuk, F., Heavy-ball method in nonconvex optimization problems, Comput Math Model, 4, 4, 336-341 (1993) · Zbl 1331.90056 [64] Sun, Tao; Yin, Penghang; Li, Dongsheng; Huang, Chun; Guan, Lei; Jiang, Hao, Non-Ergodic Convergence Analysis of Heavy-Ball Algorithms, Proceedings of the AAAI Conference on Artificial Intelligence, 33, 5033-5040 (2019) [65] Siegel JW (2019) Accelerated first-order methods: differential equations and Lyapunov functions, pp 1-17. arXiv:1903.05671 [66] Dai, YH; Wang, Y.; Yang, C.; Yagola, AG, Convergence analysis of nonlinear conjugate gradient methods, Optimization and regularization for computational inverse problems and applications, 1157-171 (2011), Berlin: Springer, Berlin [67] Nesterov, Y., A method for solving the convex programming problem with convergence rate $$O(1/k^2)$$, Dokl Aka Nauk SSSR, 269, 3, 543-547 (1983) [68] Nesterov, Y., Smooth minimization of non-smooth functions, Math Program, 103, 127-152 (2005) · Zbl 1079.90102 [69] Su, W.; Boyd, S.; Candes, E.; Ghahramani, Z.; Welling, M.; Cortes, C.; Lawrence, N.; Weinberger, K., A differential equation for modeling Nesterov’s accelerated gradient method: theory and insights, Advances in neural information processing systems 27, 2510-2518 (2014), New York: Curran Associates Inc, New York [70] Nesterov, Y., Introductory lectures on convex optimization: a basic course (2004), Springer: Kluwer Academic Publishers, Springer · Zbl 1086.90045 [71] Bhaya A, Kaszkurewicz E (2003) Iterative methods as dynamical systems with feedback control. In: 42nd IEEE international conference on decision and control, vol 3. IEEE, pp 2374-2380 [72] Ortiz, L.; Stainier, L., The variational formulation of viscoplastic constitutive update, Comput Methods Appl Mech Eng, 171, 419-444 (1999) · Zbl 0938.74016 [73] Miehe, C., Strain-driven homogenization of inelastic microstructures and composites based on an incremental variational formulation, J Numer Methods Eng, 55, 1285-1322 (2002) · Zbl 1027.74056 [74] Schneider, M., An FFT-based fast gradient method for elastic and inelastic unit cell homogenization problems, Comput Methods Appl Mech Eng, 315, 846-866 (2017) · Zbl 1439.74505 [75] Milton, GW, On characterizing the set of possible effective tensors of composites: the variational method and the translation method, Commun Pure Appl Math, 43, 63-125 (1990) · Zbl 0751.73041 [76] Grimm-Strehle, H.; Kabel, M., Runtime optimization of a memory efficient CG solver for FFT-based homogenization: implementation details and scaling results for linear elasticity, Comput Mech, 64, 5, 1339-1345 (2019) · Zbl 07147406 [77] Kabel, M.; Fliegener, S.; Schneider, M., Mixed boundary conditions for FFT-based homogenization at finite strains, Comput Mech, 57, 2, 193-210 (2016) · Zbl 1359.74356 [78] Schneider, M., Convergence of FFT-based homogenization for strongly heterogeneous media, Math Methods Appl Sci, 38, 13, 2761-2778 (2015) · Zbl 1328.65256 [79] Daphalapurkar, NP; Wang, F.; Fu, B.; Lu, H.; Komanduri, R., Determination of mechanical properties of sand grains by nanoindentation, Exp Mech, 51, 719-728 (2011) [80] Wichtmann, T.; Triantafyllidis, T., On the influence of the grain size distribution curve on P-wave velocity, constrained elastic modulus $$M_{max}$$ and Poisson’s ratio of quartz sands, Soil Dyn Earthq Eng, 30, 8, 757-766 (2010) [81] Sanditov, DS; Mantatov, VV; Sanditov, BD, Poisson ratio and plasticity of glasses, Tech Phys, 54, 4, 594-596 (2009) [82] Wu, L.; Adam, L.; Doghri, I.; Noels, L., An incremental-secant mean-field homogenization method with second statistical moments for elasto-visco-plastic composite materials, Mech Mater, 114, 180-200 (2017) [83] Segurado, J.; Llorca, J.; González, C., On the accuracy of mean-field approaches to simulate the plastic deformation of composites, Scr Mater, 46, 7, 525-529 (2002) [84] Schneider, M.; Hofmann, T.; Andrä, H.; Lechner, P.; Ettemeyer, F.; Volk, W.; Steeb, H., Modelling the microstructure and computing effective elastic properties of sand core materials, Int J Solid Struct, 143, 1-17 (2018) [85] Ettemeyer, F.; Lechner, P.; Hofmann, T.; Andrä, H.; Schneider, M.; Grund, D.; Volk, W.; Günther, D., Digital sand core physics: predicting physical properties of sand cores by simulations on digital microstructures, Int J Solids Struct, 188-189, 155-168 (2020) [86] Barzilai, J.; Borwein, JM, Two-point step size gradient methods, IMA J Numer Anal, 8, 141-148 (1988) · Zbl 0638.65055 [87] Dai, YH; Liao, LZ, R-linear convergence of the Barzilai and Borwein gradient method, IMA J Numer Anal, 22, 1-10 (2002) · Zbl 1002.65069 [88] Chen, Y.; Gélébart, L.; Chateau, C.; Bornert, M.; Sauder, C.; King, A., Analysis of the damage initiation in a SiC/SiC composite tube from a direct comparison between large-scale numerical simulation and synchrotron X-ray micro-computed tomography, Int J Solids Struct, 161, 111-126 (2019) [89] Fang, H-R; Saad, Y., Two classes of multisecant methods for nonlinear acceleration, Numer Linear Algebra Appl, 16, 197-221 (2009) · Zbl 1224.65134 [90] Toth, A.; Kelley, C., Convergence analysis for Anderson acceleration, SIAM J Numer Anal, 53, 2, 805-819 (2015) · Zbl 1312.65083 [91] Saad, Y.; Schultz, MH, GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems, SIAM J Sci Stat Comput, 7, 856-869 (1986) · Zbl 0599.65018 [92] Li Z, Li J (2019) A fast Anderson-Chebyshev acceleration for nonlinear optimization, pp 1-17. arXiv:1809.02341 [93] Schneider, M., The sequential addition and migration method to generate representative volume elements for the homogenization of short fiber reinforced plastics, Comput Mech, 59, 247-263 (2017) [94] Anderson, DG, Iterative procedures for nonlinear integral equations, J ACM, 12, 4, 547-560 (1965) · Zbl 0149.11503 [95] Dembo, RS; Eisenstat, SC; Steihaug, T., Inexact Newton methods, SIAM J Numer Anal, 19, 400-408 (1982) · Zbl 0478.65030
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.