Research Article | Open Access
Nikolaos P. Bakas, "Numerical Solution for the Extrapolation Problem of Analytic Functions", Research, vol. 2019, Article ID 3903187, 10 pages, 2019. https://doi.org/10.34133/2019/3903187
Numerical Solution for the Extrapolation Problem of Analytic Functions
In this work, a numerical solution for the extrapolation problem of a discrete set of n values of an unknown analytic function is developed. The proposed method is based on a novel numerical scheme for the rapid calculation of higher order derivatives, exhibiting high accuracy, with error magnitude of O(10−100) or less. A variety of integrated radial basis functions are utilized for the solution, as well as variable precision arithmetic for the calculations. Multiple alterations in the function’s direction, with no curvature or periodicity information specified, are efficiently foreseen. Interestingly, the proposed procedure can be extended in multiple dimensions. The attained extrapolation spans are greater than two times the given domain length. The significance of the approximation errors is comprehensively analyzed and reported, for 5832 test cases.
Prediction always differs from observation , and extrapolation remains an open challenge  or even a hopelessly ill-conditioned  problem, in a vast variety of scientific disciplines. It relies on numerical methods which attempt to predict the future, unknown values of a studied phenomenon, given a limited set of observations. Its importance is reflected in the Scopus database , by a search with the term extrapolation, yielding nearly 150 thousands of research items, in a wide range of scientific fields (Table S1). The visual presentation of the corresponding keywords (Figure S1) in a bibliometric map  reveals that extrapolation is closely associated with modeling, simulation, uncertainty, and interpolation, which is the reciprocal problem to simulate the unknown mechanism which produced the given data, aiming to predict utilizing the constructed model. Contradictorily to interpolation and despite the significance of extrapolation and forecasting methods, they exhibit a decreasing pattern in literature since the early 1980s (Figure S2), indicating the futility to predict for extended time frames. The given data is often called time-series and their extrapolation forecasting, which usually depend on machine learning algorithms such as support vector machines [6–8] and artificial neural networks [2, 9, 10], which construct nonlinear regression models, to predict beyond the known domain. Prediction algorithms are useful in a wide range of scientific disciplines, such as earth sciences [7, 9], finance [8, 11], computer science [12, 13], and engineering [14–16]. Several methods have been proposed for time-series forecasting  and competitions regarding accuracy have been conducted, utilizing statistical [11, 17] and machine learning procedures [2, 10, 15]; however, the prediction horizon regards only a small percentage (~20-30%) of the given data extension. Similarly, for less uncertain problems as the extrapolation of curves defined by polynomials (splines) [18–20], extrapolation can cause unpredictable results, and their extension should be short . Apparently, prediction procedures are essential for a vast variety of scientific fields, always based on numerical interpolation methods.
More specifically, in the case of analytic functions, where the given data follow an unknown rigor mathematical law, any extrapolation results are too weak to be interesting . Previous theoretical works focus on the interpolation problem, such as the ability of neural networks with one hidden layer to approximate analytic functions , proofs regarding the degree of rational approximation of an analytic function , and analysis of the rate of decrease of the best approximations of analytic functions . Accuracy and convergence techniques are demonstrated in , yet it is shown theoretically  that the approximation of analytic functions cannot converge exponentially. Approximation of analytic functions is investigated utilizing a variety of approximators [27–29], such as Hermite [30, 31] and Airy functions . Computational works regard the approximation of a function  as well as its derivatives [34, 35], investigating the interpolation errors among the given nodal points. Such errors are higher than the approximation errors (Runge phenomenon) especially at the boundaries , affecting dramatically the extrapolation outside the given domain. Moreover, the round-off errors of computing machines follow some stochastic law  and recent works deal with the high impact of infinitesimal errors in the given data, utilizing extended arithmetic precision [37, 38]. Accordingly, the constitution of an accurate numerical method to approximate an analytic function and its derivatives, which is vital for the extrapolation problem, remains a challenge.
The purpose of this study was to provide a generic numerical solution for the extrapolation problem. It was attained for extended extrapolation horizons of even greater than 200% the given domain length if the set of data are derived from an unknown analytic function and their precision is high. The rationale of the proposed method adheres to the following three stages: (a) interpolation of the set of values at specified points using integrated radial basis functions (IRBFs), (b) computation of high order derivatives at any point of the closed domain with high accuracy based on a novel numerical scheme, and (c) successive application of the Taylor series formula to extrapolate at points outside the given domain. The method is capable of interpolating within the given data with high precision, avoiding the Runge phenomenon at the boundaries , as well as of computing the higher order derivatives with remarkable accuracy, which are fundamental problems in numerous applications. The effects of the method’s parameters on the prediction errors were extensively investigated by their analysis of variance (ANOVA) and feature extraction utilizing the Random Forest  method, for 5832 test cases. Illustrative examples of highly nonlinear analytic functions in two and three dimensions demonstrate the prediction extents attained by the proposed method.
2. Numerical Solution
2.1. Extrapolation of One Infinitesimal dx
Let be an analytic function, which is unknown. It is given that the function takes values at specified points as in Figure 1(a), for a generic analytic function. The extrapolation problem, that is, to predict the values which take the function outside the given domain , can be transformed into the computation of ordinary derivatives of , , at point . In particular, applying the Taylor formula from the point to the next point , the corresponding value of is given byfor an infinitesimal step . is the value of at point , depending on the ordinary derivatives of at . These derivatives should be computed, as they are unknown.
2.2. Numerical Evaluation of the Derivatives
Around the endpoint , we used the Taylor formula for computing the value of the function at the first predicted point . In order to calculate the derivatives, we need to consider the function values within the end interval from the point with abscissa to . Accordingly, the Taylor expansion from the endpoint to any previous point (Figure 1(b)) may also be written in the formBy interchanging the positions of and , we may writeand by applying it to points dx (Figure 1(b)) and writing the resulting system of equations in matrix form, we obtainIt is important to note that all the derivatives are considered at the endpoint . Hence, extracting the derivatives as a column vector, we haveThus, only the first column of the matrix in (5) varies as it refers to the values of f within the edge interval. As the objective is to compute the n ordinary derivatives of f, (5) is separated in submatrices, in order to rearrange the equations and develop a formula to calculate the vector D, containing the values of the n derivatives of f at point . The solid lines indicate the submatrices B, C, H, D, and ; hence, (5) can be written in matrix partitions formwhereSince (6) is a system of equations, in order to calculate the vector D (containing the values of the derivatives of at point ), by (6), we deducewhich is a system of n equations. Thus, the matrix of the n ordinary derivatives can be directly computed bywhere n, and hence the number of the calculated derivatives, can be arbitrarily selected. Equation (8) offers a direct computation of the n ordinary derivatives D. Since C is still unknown, we can compute it, by interpolating f with IRBFs as defined subsequently.
2.3. Function Approximation with IRBFs
Radial Basis Functions (RBFs) networks are universal approximators while Integrated RBFs are capable of attaining precise approximation for a function and its derivatives [34, 35] as well as for the solution of partial differential equations [37, 38]. The essential formulation of RBFs, adopted in this work, is as follows.
Let be a variable taking values in a domain . The known values of the function are given at the positions as per Figure 1, while the interval length between two adjacent points , is equal to . The given values of the unknown function can be approximated with RBFs , centered at the N points. The RBFs approximation is defined bywhere are the unknown weights for the approximation with RBFs, represents the distance of a given point in the domain from any other point , and is the radial basis kernels such as Gaussian, Shifted Multiquadrics, and Sigmoid or their integrals, as in , , , , , . Applying (9) at the given points results in the approximated values of , ; hence we deduce thatIf we write (10) times and define as a matrix containing the values of , with i indicating the rows and j the columns of , a vector containing the unknown approximation weights, and a vector comprising the values of at the nodal points , we may writeHence we deriveThe vector b is known, and the matrix can be calculated from the distances of the known points and , so the weights of the RBFs approximation of the function are computed by numerically inverting matrix and multiplying it with vector b. After the computation of vectors , the radial basis functions can be recomputed for each intermediate point , in order to approximate the values of the unknown function at these points. Accordingly, each approximation vector which corresponds to the points , , when multiplied with the calculated weights of (12), results in the interpolated values of , and sowhere are the approximation vectors for each hj and the RBFs weights. The vectors are computed utilizing , , , , , , resulting in the vector C, which is the function’s f approximation at points hj (Figure 1(b)).
The definitions of the radial basis functions φ utilized in (12), (13) are specified in the following group of , , , , , : the Gaussian and the Shifted Logarithmic, as well as integrations of them, for one and two times. Equations , , , , , are written concerning , in order to be generic for any and hence for points xi and hj.
The Gaussian RBF is defined bywhere c is a constant influencing the shape of φ [40–42]. By integration of the Gaussian kernel, we obtainand if we integrate for a second time, thenwhere erf is the error function, , exhibiting a sigmoid scheme, which is commonly used in ANNs .
Respectively, the Shifted Logarithmic RBF is defined byand by integration of the kernel we obtainand if we integrate for a second time, then
2.4. Iterative Implementation of Taylor Series Expansion
Exploiting the computed derivatives with high accuracy at the end of the domain , the predicted value of the function can be computed at the next step , by the Taylor series expansion of (1). This procedure is repeated iteratively, for each next point utilizing each time the shifted vectorsThe N points are initially the positions where the function values are given. This procedure is iteratively applied using at each step the previous values of the function (eliminating each time the first point) and one new value of the function, calculated by the procedure ( and ). Keeping constant the length dx between a predicted point and its subsequent, the matrix remains the same, as in the initial interpolation domain. The same stands for the inverted matrix as well as the matrices , and despite the sequential shifts outside the original domain, the relative distances r of , , , , , remain the same. The same stands for the matrices H and H-1. Hence, the interpolation of the function within the end increment dx each time is accomplished by matrix multiplication and not inversion, which is performed only one time for and one time for H. Utilizing this approach, during the iterations of the extrapolation procedure, the computational time is decreased dramatically, as these matrices are computed only once.
2.5. The Extrapolation Algorithm
3.1. Parameters Affecting the Method and Preparation of Dataset to Test Performance
The efficiency of the procedure was verified through numerical examples for a variety of highly nonlinear functions and their extrapolation spans. The extrapolation span is based on the accuracy of the interpolation method ((9), (10), (12), (13), , , , , , ) as well as the numerical differentiation ((1), (5), (6), , , , , , , (8)). As demonstrated in Figure 1(b), the intervals for the differentiation hj are selected near the node of the domain discretization, in order to achieve the highest possible accuracy, because this region is within the selected dx, and simultaneously, the interpolation error is minimized near this node, due to the Runge phenomenon . Hence we selectwhere l indicates the limit distance near the node . However, for extremely low values of h, the matrix H contains elements near zero, and its inversion grows into unstable one (high condition number and inversion errors).
The features which have an effect on the calculations, as well as their values (in parentheses) utilized in the parametric investigation, are the number of Taylor terms utilized, indicated as number of derivatives, (25, 50, 75); the number of computer digits used for the arbitrary precision calculations (500, 1000, 2000); the span of the given domain L (1/2, 1); the number of the divisions N (50, 100, 200); the limit l (5, 10, 20); the number of IRBFs integrations (0, 1, 2); the kernel of RBFs networks (Gaussian = 1, Shifted Logarithmic = 2); their shape parameter c (1/5, 1, 5); and the unknown function which is studied (, ). Accordingly, the resulting database consists of 5832 records of test cases. The output of each parametric execution of the proposed procedure was the condition number of the H and matrices, their inversion errors, and the error of the first and second derivatives according to the proposed procedure. Moreover, the error of the first step of the extrapolation was computed (ε), in order to investigate its dependence on the problem statement parameters (N, L, dx, f) as well as the method’s attributes (#derivatives, digits, kernel, c, #integrations).
3.2. Effects of Parameters on Extrapolation Accuracy and Computational Time
The was utilized as a measure for the extrapolation error, as the values of exhibit a variation within the domain to the IEEE® arithmetic representation for positive infinity . Given that the lower values of error are important, the analysis of variance was conducted for the cases with values of ; hence the resulting database consists of 2292 records. ANOVA found statistically significant differences between the means (MD) of for 25 and 50 derivatives (MD = 43.5803, p-value = 9.5606 10−10) and for 25 and 75 derivatives (MD = 54.2206, p-value = ) as demonstrated in Figure S3 and Table S2. Similarly, the number of digits (Figure S4 and Table S3) was found significant for the (MD = 20.3576, p-value = 9.6963 10−10 for 500 to 1000 digits and MD = 33.9628, p-value = 9.5606 10−10 for 500 to 2000 digits). The number of divisions exhibits a clear difference as well, in Figure S5 and Table S4 (MD = 22.7727, p-value = 9.5606 10−10 for 50 to 100 divisions and MD = 49.6978, p-value = 9.5606 10−10 for 50 to 200 divisions). The univariate linear correlation of the condition number of with (Figure S12) exhibits an R2 of 0.2559 (p-value = 3.1608 10−149). For the condition number of H as well as the inversion errors of H and , the correlations are even lower (Figures S13-S15); however, the majority of the values are 10323 for the condition of H and 10−323 for the inversion errors.
In order to further investigate more complex associations among the studied parameters and the extrapolation error , the random forests method  was utilized. The numerical dataset was divided into a train set (85% of observations) and a test set (15%) in order to constitute and investigate the reliability of the predictive model. The R2 for the predicted versus actual for the test set was 0.8954 (Figure S18), indicating a reliable model. The features significance was evaluated in terms of their contribution to the prediction error in the constituted model (Figure S19A), signifying high values for the studied function, the condition of , the number of derivatives, and the domain length. Similarly, considering the computation time as dependent variable, the R2 for the test set was 0.9658 and the highest predictive features were the number of divisions, the number of integrations, and number of digits (Figure S19B).
3.3. Illustrative Functions and Their Extrapolation Spans
In Figure 2 the extrapolation results are demonstrated by four test functions as indicated. The initial domain contains only the known given data for and , and after the vertical lines, each graph contains the exact function values, the predicted and the normalized extrapolation error , which take values in the . The text cases include a vast variety of analytic functions as well as their combinations. In Figures 2(a)–2(d) the given curvature or periodicity information is meager, compared to the predicted evolution of the function’s values. Interestingly, the logged error plot exhibits a logarithmic scheme, indicating a weak form of stability .
In Figure 3, the proposed procedure is implied firstly in the x-axis and then in the y-axis for the function . Given only the cyan region, the method can predict the highly nonlinear colored surface in the x, y, z space.
4.1. Numerical Differentiation
Numerical differentiation is highly sensitive to noise , especially for the higher order derivatives. After an extensive examination the literature utilizing IRBFs [35, 45, 46] for the derivatives approximation, or for the solution of specific problems [47, 48] as well as other differentiation methods [49, 50] and a variety of formulations for IRBFs (, , , , , ), the proposed procedure accomplished striking accuracy, with error magnitude ε of O(10−100) or less (Figures S3-S11 and supplementary database), for the derivatives’ computation. This finally permitted the implementation of the Taylor method for significant extrapolation extents (Figures 2 and 3 and Data File S1). The numerical calculation of the derivatives with variable precision arithmetic offers high accuracy [37, 38]. The inverse problem of numerical integration exhibits lower errors with ; however, the integration is less sensitive to—even small—errors in the given data . Cheng , similarly to this work, found that the errors of the derivatives approximation are of one or more order of magnitude higher than the function’s (Figures S16, S17, and Data File S1). However, the digits studied were 100-200, while the precise computation of the derivatives was vital for the extrapolation, and so for a higher number of digits. Similarly, Mai-Duy et al.  examined the compactly integrated radial basis functions, with errors for the derivatives for fifty digits accuracy.
4.2. RBFs’ Matrix Φ and Shape Parameter
The approximation scheme ((9), (10), (12), (13), , , , , , ) permits a precise interpolation, within the given domain, with or less, as found in the numerical experiments (supplementary database). Accordingly, the approximation of the function’s values is attainable with high accuracy, not only at the nodes xi, but for any intermediate point between two given points and, hence, for points hj (Figure 1(b)), permitting the precise calculation of vector C (13). Arbitrary precision found capable of avoiding the ill-conditioning of was also indicated by Cheng  and Huang . Using arbitrary precision in the calculations, the inversion errors in -I were found of O(<10−100) or even exact zero (supplementary database). The arbitrary precision has also been used for the robust computation of by Cheng , where the Gaussian RBFs and inversed multiquadrics exhibit accuracy of interpolation with (~10−20-10−30).
The association of the condition number of with exhibits low R2 (0.25595) with slightly negative slope (Figure S12), although the high condition number is considered to increase instability [37, 41, 52] indicating the need for high precision to the calculations; however the majority of the values are 10323, that is, the maximum real number considered by the software . Sensitivity analysis was selected instead of optimizing each method’s parameters such as times of RBFs integration, the kernel function, or its shape parameter [40–42], as the interpolation errors in a number of the test cases were equal to zero at the nodes, eliminating any relevant objective function. The number of integrations of RBF φ increased computational time, as it magnifies the and matrices, due to the more complex formulas (, , , ).
4.3. Summary of Findings and Limitations of the Proposed Solution
In brief, a method for the extrapolation of analytic functions is developed, accompanied by a systematic investigation of the involved parameters. The proposed scheme for the numerical differentiation exhibited low enough errors to permit adequate extrapolation spans. The constituted database of the numerical experiments highlights the fact that, for the same problem formulation (L, N, dx, f), the derivatives calculation exhibits a high variation, indicating the vagueness of the transference from the presumed theory to the actual calculations. The numerical investigation of the extrapolation errors suggests that only utilizing high accuracy and a precise approximation scheme for a function as well as its derivatives, the extrapolation is attainable. Thus, for real-world phenomena, with laboratory accuracies even of O(10−20), the predictions are limited to short length. Only if the measurements contain some hundreds of significant digits, the proposed solution is efficient. As this is difficult to be accomplished by laboratory instruments, this work’s findings provide strong evidence that we are far from lengthy predictions in physics, biology, and engineering and also even more far from phenomena studied in health and social sciences. However, the parametric investigation suggests that the precision in calculations and the utilized methods are vastly significant, as the extrapolation horizons achieved by the proposed numerical scheme are about an order of magnitude higher than those in the existing literature, highlighting the potentiality of predictions.
5. Materials and Methods
All the software operations ran on an Intel i7-6700 CPU @3.40GHz with 32GB memory and SSD hard disk, and the execution time was accordingly tracked. The errors of the derivatives in the relevant literature are reported in the Supplementary Data File S1, and they highlight the immense accuracy of numerical differentiation achieved in this work.
Conflicts of Interest
The author declares no conflicts of interest.
This study would not have been possible without professor’s John T. Katsikadelis helpful discussions, valuable suggestions, and clarifications regarding the integrated radial basis functions as well as his confidence that the problem is solvable. Special thanks are due to Dr. Natia R. Anastasi for reviewing the original manuscript. I would also like to thank Dr. Savvas Chatzichristofis, Director of Informatics at Neapolis University Pafos, Nikitas Giannakopoulos, Ass. Professor of Medicine, University of Würzburg, Germany, and Angeliki Sivitanidou and Thomas Dimopoulos, Lecturers at Neapolis University, for suggestions regarding language.
The supplementary materials are divided into two parts: (A) The supplementary figures and tables for the statistical analyses of parameters affecting extrapolation accuracy, and the bibliometric review figures. (B) The supplementary database: Data File S1. experiments.xlsx (attached): database for the parametric investigation of extrapolation errors. Figure S1: bibliometric map of papers with keyword extrapolation. Utilizing a bibliometric procedure  for a co-keywords based bibliometric analysis for the top papers in terms of their citations, containing extrapolation as keyword, the keywords highly associated with extrapolation—closer on the bibliometric map—are interpolation, risk assessment, prediction, uncertainty, modeling, etc. The almost coincident positions of extrapolation and interpolation indicate that the techniques aiming to extend a series of values beyond the observed domain are mainly based on interpolation procedures, which is an effort to mathematically formulate the phenomenon . Figure S2: Evolution of terms in Google Books. Commencing the eighties and on, the effort of the researchers is decreasing, reflecting the failure to predict time-series values. This is demonstrated through a search in over 25 million—as of October 2015—books , for the words forecasting and extrapolation and the closely related topic of interpolation . Figure S3: variance of for number of derivatives. Figure S4: variance of for number of digits. Figure S5: variance of for number of divisions. Figure S6: variance of for number of integrations. Nonsignificant differences (as per Table S5). Figure S7: variance of for domain length. Nonsignificant differences (as per Table S6). Figure S8: variance of for function. The function sin(x) exhibits less errors than the more complex (MD = 15.6422, p-value = 1.0597 10−10, from Table S7). Figure S9: variance of for kernel. The Gaussian kernel exhibits lower errors than the Shifted Logarithmic (MD = 9.9051, p-value = 3.3708 10−7 - Table S8). Figure S10: variance of for limit . Nonsignificant differences (as per Table S9). Figure S11: variance of for shape parameter. The shape parameter 0.2 exhibits higher errors than 5 (MD = 8.5855, p-value = 0.0065 - Table S10). Figure S12: scatter plot for condition number of and . Figure S13: scatter plot for condition number of and . Figure S14: scatter plot for inversion error of and . Figure S15: scatter plot for inversion error of and . Figure S16: scatter plot for error of first derivative and . Figure S17: scatter plot for error of second derivative and . Figure S18: scatter plot for actual versus predicted . Table S2: differences between the means of for groups with an uneven number of derivatives. Table S3: differences between the means of for groups with an uneven number of digits. Table S4: differences between the means of for groups with an uneven number of divisions. Table S5: differences between the means of for groups with an uneven number of integrations. Table S6: differences between the means of for groups with uneven domain lengths. Table S7: differences between the means of for groups with uneven functions f. Table S8: differences between the means of for groups with uneven RBF kernel. Table S9: differences between the means of for groups with uneven limit l. Table S10: differences between the means of for groups with uneven RBFs shape parameter. Figure S19: features significance. (Supplementary Materials)
- N. Oreskes, K. Shrader-Frechette, and K. Belitz, “Verification, validation, and confirmation of numerical models in the earth sciences,” Science, vol. 263, no. 5147, pp. 641–646, 1994.
- S. Ben Taieb, G. Bontempi, A. F. Atiya, and A. Sorjamaa, “A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competition,” Expert Systems with Applications, vol. 39, no. 8, pp. 7067–7083, 2012.
- L. Demanet and A. Townsend, Stable Extrapolation of Analytic Functions, 2016, https://arxiv.org/abs/1605.09601.
- “Scopus,” http://www.scopus.com/scopus/homeurl.
- V. Plevris, N. Bakas, G. Markeset, and J. Bellos, “Literature review of masonry structures under earthquake excitation utilizing machine learning algorithms,” in Proceedings of the 6th International Conference on Computational Methods in Structural Dynamics and Earthquake Engineering, COMPDYN 2017, pp. 2685–2694, Greece, June 2017.
- N. Sapankevych and R. Sankar, “Time series prediction using support vector machines: a survey,” IEEE Computational Intelligence Magazine, vol. 4, no. 2, pp. 24–38, 2009.
- S. Ahmad, A. Kalra, and H. Stephen, “Estimating soil moisture using remote sensing data: a machine learning approach,” Advances in Water Resources, vol. 33, no. 1, pp. 69–80, 2010.
- H. Yang, K. Huang, I. King, and M. R. Lyu, “Localized support vector regression for time series prediction,” Neurocomputing, vol. 72, no. 10–12, pp. 2659–2669, 2009.
- F. Recknagel, “Applications of machine learning to ecological modelling,” Ecological Modelling, vol. 146, no. 1-3, pp. 303–310, 2001.
- S. F. Crone, M. Hibon, and K. Nikolopoulos, “Advances in forecasting with neural networks? Empirical evidence from the NN3 competition on time series prediction,” International Journal of Forecasting, vol. 27, no. 3, pp. 635–660, 2011.
- S. Makridakis, C. Chatfield, M. Hibon et al., “The M2-competition: A real-time judgmentally based forecasting study,” International Journal of Forecasting, vol. 9, no. 1, pp. 5–22, 1993.
- J. F. Murray, G. F. Hughes, and K. Kreutz-Delgado, “Machine learning methods for predicting failures in hard drives: a multiple-instance application,” Journal of Machine Learning Research, vol. 6, pp. 783–816, 2005.
- C. Richard, J. C. Bermudez, and P. Honeine, “Online prediction of time serise data with kernels,” IEEE Transactions on Signal Processing, vol. 57, no. 3, pp. 1058–1067, 2008.
- T. Hong, P. Pinson, and S. Fan, “Global energy forecasting competition 2012,” International Journal of Forecasting, vol. 30, no. 2, pp. 357–363, 2014.
- P. Young, “Technological growth curves. A competition of forecasting models,” Technological Forecasting & Social Change, vol. 44, no. 4, pp. 375–389, 1993.
- B.-J. Chen, M.-W. Chang, and C.-J. Lin, “Load forecasting using support vector machines: A study on EUNITE Competition 2001,” IEEE Transactions on Power Systems, vol. 19, no. 4, pp. 1821–1830, 2004.
- S. Makridakis, A. Andersen, R. Carbone et al., “The accuracy of extrapolation (time series) methods: Results of a forecasting competition,” Journal of Forecasting, vol. 1, no. 2, pp. 111–153, 1982.
- Y. Lu, K. Shi, J. Yong, H. Gu, and H. Song, “A B-spline curve extension algorithm,” Science China Information Sciences, vol. 59, no. 3, Article ID 32103, 2016.
- G. Zhang and R. Little, “Extensions of the penalized spline of propensity prediction method of imputation,” Biometrics: Journal of the International Biometric Society, vol. 65, no. 3, pp. 911–918, 2009.
- H. Fan, C. M. Zhang, and J. J. Li, “Extension algorithm for B-splines with GC2-continuous,” Chinese Journal of Computers, vol. 28, no. 6, pp. 933–938, 2005.
- S. Shetty and P. R. White, “Curvature-continuous extensions for rational B-spline curves and surfaces,” Computer-Aided Design, vol. 23, no. 7, pp. 484–491, 1991.
- H. N. Mhaskar, “Neural networks for optimal approximation of smooth and analytic functions,” Neural Computation, vol. 8, no. 1, pp. 164–177, 1996.
- A. A. Gonchar and E. A. Rakhmanov, “Equilibrium distributions and the rate of rational approximation of analytic functions,” Mathematics of the USSR – Sbornik, vol. 62, no. 2, pp. 305–348, 1989.
- V. A. Prokhorov, “Rational approximation of analytic functions,” Sbornik: Mathematics, vol. 78, no. 1, pp. 139–164, 1994.
- C. Schwartz, “High-accuracy approximation techniques for analytic functions,” Journal of Mathematical Physics, vol. 26, no. 3, pp. 411–415, 1985.
- R. B. Platte, L. N. Trefethen, and A. B. J. Kuijlaars, “Impossibility of fast stable approximation of analytic functions from equispaced samples,” SIAM Review, vol. 53, no. 2, pp. 308–318, 2011.
- R. Kargar, N. R. Pascu, and A. Ebadian, “Locally univalent approximations of analytic functions,” Journal of Mathematical Analysis and Applications, vol. 453, no. 2, pp. 1005–1021, 2017.
- T. CoşKun, “Approximation of analytic functions of several variables by linear k-positive operators,” Turkish Journal of Mathematics, vol. 41, no. 2, pp. 426–435, 2017.
- M. Griebel and J. Oettershagen, “On tensor product approximation of analytic functions,” Journal of Approximation Theory, vol. 207, pp. 348–379, 2016.
- S.-M. Jung, “Approximation of analytic functions by Hermite functions,” Bulletin des Sciences Mathematiques, vol. 133, no. 7, pp. 756–764, 2009.
- Z. Bustamante and G. Lopes Lagomasino, “Hermite-pade approximation for nikishin systems of analytic functions,” Sbornik Mathematics, vol. 77, no. 2, pp. 367–384, 1994.
- S.-M. Jung, “Approximation of analytic functions by Airy functions,” Integral Transforms and Special Functions, vol. 19, no. 11-12, pp. 885–891, 2008.
- B. Fornberg and J. Zuev, “The Runge phenomenon and spatially variable shape parameters in RBF interpolation,” Computers & Mathematics with Applications, vol. 54, no. 3, pp. 379–398, 2007.
- N. Mai-Duy and T. Tran-Cong, “Approximation of function and its derivatives using radial basis function networks,” Applied Mathematical Modelling, vol. 27, no. 3, pp. 197–220, 2003.
- C. Shu and Y. L. Wu, “Integrated radial basis functions-based differential quadrature method and its performance,” International Journal for Numerical Methods in Fluids, vol. 53, no. 6, pp. 969–984, 2007.
- G. Turchetti, S. Vaienti, and F. Zanlungo, “Asymptotic distribution of global errors in the numerical computations of dynamical systems,” Physica A: Statistical Mechanics and its Applications, vol. 389, no. 21, pp. 4994–5006, 2010.
- A. H. Cheng, “Multiquadric and its shape parameter—a numerical investigation of error estimate, condition number, and round-off error by arbitrary precision computation,” Engineering Analysis with Boundary Elements, vol. 36, no. 2, pp. 220–239, 2012.
- C.-S. Huang, C.-F. Lee, and A. H.-D. Cheng, “Error estimate, optimal shape factor, and high precision computation of multiquadric collocation method,” Engineering Analysis with Boundary Elements, vol. 31, no. 7, pp. 614–623, 2007.
- L. Breiman, “Random forests,” Machine Learning, vol. 45, no. 1, pp. 5–32, 2001.
- S. Rippa, “An algorithm for selecting a good value for the parameter c in radial basis function interpolation,” Advances in Computational Mathematics, vol. 11, no. 2-3, pp. 193–210, 1999.
- J. G. Wang and G. R. Liu, “On the optimal shape parameters of radial basis functions used for 2-D meshless methods,” Computer Methods in Applied Mechanics and Engineering, vol. 191, no. 23-24, pp. 2611–2630, 2002.
- G. E. Fasshauer and J. G. Zhang, “On choosing “optimal” shape parameters for RBF approximation,” Numerical Algorithms, vol. 45, no. 1–4, pp. 345–368, 2007.
- M. Hou and X. Han, “Constructive approximation to multivariate function by decay RBF neural network,” IEEE Transactions on Neural Networks and Learning Systems, vol. 21, no. 9, pp. 1517–1523, 2010.
- MATLAB, version R2017a, MathWorks Inc., Natick, Mass, USA, 2017.
- C. M. T. Tien, N. Thai-Quang, N. Mai-Duy, C.-D. Tran, and T. Tran-Cong, “A three-point coupled compact integrated RBF scheme for second-order differential problems,” CMES: Computer Modeling in Engineering & Sciences, vol. 104, no. 6, pp. 425–469, 2015.
- C. M. T. Tien, N. Pham-Sy, N. Mai-Duy, C.-D. Tran, and T. Tran-Cong, “A high-order coupled compact integrated RBF approximation based domain decomposition algorithm for second-order differential problems,” CMES: Computer Modeling in Engineering & Sciences, vol. 104, no. 4, pp. 251–304, 2015.
- N. G. Babouskos and J. T. Katsikadelis, “Optimum design of thin plates via frequency optimization using BEM,” Archive of Applied Mechanics, vol. 85, no. 9-10, pp. 1175–1190, 2015.
- A. J. Yiotis and J. T. Katsikadelis, “Buckling of cylindrical shell panels: a MAEM solution,” Archive of Applied Mechanics, vol. 85, no. 9-10, pp. 1545–1557, 2015.
- Y. Fu and J. Zhang, “Size-dependent pull-in phenomena in electrically actuated nanobeams incorporating surface energies,” Applied Mathematical Modelling: Simulation and Computation for Engineering and Environmental Systems, vol. 35, no. 2, pp. 941–951, 2011.
- K. Hong and J. Chen, Boundary Element Method, Taipei, Taiwan, 1993.
- D. H. Bailey, K. Jeyabalan, and X. S. Li, “A comparison of three high-precision quadrature schemes,” Experimental Mathematics, vol. 14, no. 3, pp. 317–329, 2005.
- N. Mai-Duy, T. T. Le, C. M. Tien, D. Ngo-Cong, and T. Tran-Cong, “Compact approximation stencils based on integrated flat radial basis functions,” Engineering Analysis with Boundary Elements, vol. 74, pp. 79–87, 2017.
- S. Makridakis and N. Bakas, “Forecasting and uncertainty: a survey,” Risk and Decision Analysis, vol. 6, no. 1, pp. 37–64, 2016.
- S. Heyman, Google Books: a Complex and Controversial Experiment, New York Times, 2015.
Copyright © 2019 Nikolaos P. Bakas. Exclusive licensee Science and Technology Review Publishing House. Distributed under a Creative Commons Attribution License (CC BY 4.0).