Метод глобальной оптимизации с селективным усреднением дискретных искомых переменных
Предложен функционал покомпонентного селективного усреднения искомых дискретных переменных. В положительное убывающее ядро функционала введен положительный коэффициент селективности. При его увеличении усреднение в пределе обеспечивает получение оптимального значения искомых дискретных переменных. На основе оценки функционала селективного усреднения синтезирован базовый алгоритм глобальной оптимизации на множестве дискретных переменных с упорядоченными возможными значениями при наличии ограничений неравенств. На тестовом примере продемонстрированы высокие скорость сходимости и помехоустойчивость базового алгоритма. Статистическое исследование алгоритма показало, что оценка вероятности получения истинного решения достигает единицы.
The global optimization method with selective averaging of the discrete decision variables.pdf The problem of search of a global extremum of objective functions on admissible set of decision variables (continuous, discrete or continuous-discrete) belongs to the very complex class [1-27]. The specificity of global optimization is caused by multiextremal view of the objective functions, their discontinuous nature, very different sensitivity of objective functions in relation to decision variables, the discrete nature of part or all the variables, the presence of noises, the presence of a considerable quantity of decision variables and constraints of inequalities type and equalities type. If objective functions are not calculated, they are measured in points of admissible set of decision variables. The majority of algorithms is oriented only on cases of continuous decision variables and on elemental constraints of inequalities type. The comparative analysis of base algorithm of a method with selective averaging of continuous decision variables [6, 7, 10, 14, 24] in relation to existing heuristic algorithms showed its advantages on the rate of convergence, a noise stability and total computing complexity. In [27] the variant of base algorithm of a solution of a problem of global optimization on set of continuous-discrete variables is proposed. It is rational to develop this effective method of global optimization on the set of discrete variables. In this paper for a solution of global optimization problems on a set of discrete variables the approach based on the selective averaging of decision variables with adaptive reorganization of an admissible set of trial movements is proposed. It is constructed the functional of selective averaging of discrete decision variables. The selectivity coefficient is entered into kernel of functional. With an increase in the core selectivity coefficient, it becomes possible for the functional to distinguish the positions of the global minimum. It is shown that when selectivity coefficient of kernel tends to infinity the averaging gives optimal value of decision discrete variables. The computing scheme of base algorithm of global optimization at continuous variables is transformed to the similar scheme at discrete variables. The base algorithm of global optimization on a set of discrete variables with ordered possible values at the presence of inequalities constraints is synthesized. Trial and working steps are also separated in time. Before performance of each working step the series of calculations of the minimized function in the sampling points is carried out. Based on this information at the fixed selectivity coefficient of kernel, the selective averaging of decision variables will be executed numerically. For each discrete variable the continuous auxiliary non-dimension variable which contains numbers of possible values of a discrete variable and the identical the adjoining each other subintervals covering these numbers is put in compliance. Due to one-to-one compliance the transition in the sampling points from continuous variables to discrete possible values is carried out. The same (but already reverse) transition occurs for received averaged values of decision variables. Also, the adaptive reorganization of sizes of a set of possible trial movements is carried out and functions of inequalities constraints are considered. The example shows the high convergence rate and noise stability of the base algorithm. It also provides near-to-one the estimate of the probability of obtaining a true solution. 1. Statement of problem The problem of search of a global minimum of objective function f (y) on a set of discrete variables with ordered possible values at the presence of inequalities constraints is solving: f(y) = globmin, ф7. (y) < 0, j = 1,m, (1) where y = (y,...,yh) is vector h of discrete variables. Each discrete variable yt has rt possible ordered values yt^..^ yt^ . Inequalities constraints select (narrow) admissible set of possible values in which search of minimum of global minimum is carried out. It’s required to define the position ymm of global minimum of objective function f (y) on limited set of change of its variables. Function f ( y) is multiextreme and can be distorted by noises. Functions of constraints can be nonconvex. Search of extremum is carried out on basis only measurements or calculations of specified functions f (y), ф (y), j = 1,m in the selected sampling points which satisfy to the inequalities constraints: фj (y) < 0, j = 1, m. We assume that a global minimum of function f ( y) on an admissible set of points with discrete values of variables is unique. 2. The selective averaging of discrete decision variables The selective averaging of decision continuous variables [6, 7, 10, 14, 24] is a mathematical expectation with special probability density function of these variables. Probability density function at a decreasing kernel (with increase of its normalized argument from 0 to 1) allows to approach with growth of selectivity coefficient of a kernel to the specified average value of decision variables i.e. to the true position of global minimum. This theoretical result gave to chance of construct the structure of a base numerical algorithm, which successfully applied at the presence of inequalities constraints. Due to the expansion of possibilities of this algorithm, the algorithms of single-objective global optimization at the constraints such as inequalities and equalities are synthesized. The algorithms of the solution of other extreme problems are obtained: multiobjective and minimax global optimization, search of the main minima of multiextremal functions [14]. Let’s transfer idea of selective averaging [14] on solution the problem of global optimization (1) on set of possible values of the discrete decision variables which satisfy the inequalities constraints (1). At first we will consider the one-dimensional version of optimization problem (1). Discrete variable y has r possible ordered values (yx,...,yr). We enter the notation: /mm, /max are smallest and largest values of minimized function on an admissible set of possible values; ymm is admissible value of discrete variable at which function f (y) is reaching the minimum value: f Omn) = fmm . The averaged value (mathematical expectation) of decision variable is equal to value: (2) [yl = I PsigJy, Ц=1 k=1 where Hg„) = Ps(gu)/ Z Ps(gk) is normalized (on 1) positive decreasing kernel (analog of probability of a random event): ^ps(gp) = 1; kernels ps(gp) and ps(gp) lie in interval [0; 1]; s is selectivity coeffi- P=1 cient of kernel (1 ф(ymin) .... yh,mln) is the same as for one-dimensional case. We take the h functions ф(y) = y, t = 1, h and we receive limit values for all coordinates Ik/l ^oo >-kf,min? t = \\ h , _ R _ where [yt\\s = ^ /)s(gLl )У, Ll- t = \\,h, у LL is coordinate with number t in point with number p. This is cop=i ordinate-wise averaging. It’s written in vector form: [y > ymin (y1,min,..., yh,min) , - R ^ where [y]x = Z Ps (gLi )>'ll • Л is admissible point with number p at one of combinations of possible values p=1 of its variables. By search of a maximum of function f the arguments of kernels are calculated on another: gp = (fmax - f (Ур)V(/max - fmin) and the point Утах corresponds to global maximum value: f Cy^ = fmax and gmax = °. 3. Basic algorithm of optimization The method is based on separation in time of trial and working steps, uniform distribution of sampling points on admissible set of possible values of discrete decision variables, numerical selective averaging (calculation of mathematical expectation) of decision variables by results of calculated (or measured) values of optimized function in sampling points. Adaptive reorganization of the sizes of the set of sampling points is carried out also on each working step. The basic algorithm of global optimization based on selective averaging of decision continuous variables allows implementation on a set of discrete and continuous-discrete variables. In [27] the specified algorithm was generalized on a case of continuous and discrete variables with ordered possible values. Based on the scheme presented in [27], in this work the algorithm for a case only of discrete variables is constructed. The solution of problem of optimization with discrete variables is based on transition from each discrete variable yt to the corresponding auxiliary continuous variable xt. From possible values of a discrete variable yt transition to their numbers are carries out. Calculations on each working step are conducted for the number x(possible values of discrete variables yt. Averaged values of variables (estimates of mathematical expectation) and the sizes (also averaged) the variation sets of variables are calculated. For receiving of n sampling points y(i), i = 1, n consistently by uniform distribution are generated on a «rectangular» set of a points and from them only those which satisfy inequalities constraints are left. After the l -th working step the generation of sampling points is carried out equally: (3) x() = xt + AXtuX, uX) e [-1; 1], t = 1,h, i = 1,n, In a formula (3) uis elements of pseudo-random sequence of uniform distributed of the continuous random value. This uniform law of distribution causes identical probabilities of emergence of possible values (and their numbers) all discrete variables. In the received sampling points value of minimized function f(i) = f (y(i)), i = 1,n is calculated. Further, the position of the minimum is specified. New value xl+1 on auxiliary variables and the sizes AXl+1 of «rectangular» set of trial movements are calculated by the following formulas: -1+1 _ ^ -(i) -(i) (4) = у X(i) p() t = 1 h = A xt,Nps,min ,1 = 1,h , x, 7=1 1/q f{l) - f • a(0 _J_J min ’ о min - 'r 'r J max J mir P() ■ = r s,min » Axl+1 =Yq I A | X(N - x}'q"(i) t = 1, h, (j) min i=1 ) A Ps (g, j=1 / = 0,1, 2,[0
Ключевые слова
constraints of inequality type,
multiextreme function,
discrete variable,
selective averaging of decision variables,
global optimization,
ограничения типа неравенств,
многоэкстремальная функция,
селективное усреднение искомых переменных,
дискретные переменные,
глобальная оптимизацияАвторы
Рубан Анатолий Иванович | Сибирский федеральный университет | профессор, доктор технических наук, заслуженный деятель науки РФ, профессор кафедры информатики Института космических и информационных технологий | ai-rouban@mail.ru |
Михалев Антон Сергеевич | Сибирский федеральный университет | старший преподаватель кафедры информатики Института космических и информационных технологий | asmikhalev@yandex.ru |
Всего: 2
Ссылки
Korn, G.A. & Korn, T. (1973) Mathematical Handbook. New York, San Francisco, Toronto, London, Sydney: [s.n.].
Rouban, A.I. & Mikhalev, A.S. (2017) Global optimization with selective averaging of mixed variables: continuous and discrete with the ordered possible values. Nauchnyy vestnik Novosibirskogo gosudarstvennogo tekhnicheskogno universiteta - Scientific Bulletin of NSTU. 3(68). pp. 126-141. DOI: 10.17212/1814-1196-2017-3-126-141
Carbas, S. (2016) Design optimization of steel frames using an enhanced firefly algorithm. Engineering Optimization. pp. 1 -19. DOI: 10.1080/0305215X.2016.1145217
Baghlani, A. & Makiabadi, M. & Sarcheshmehpour, M. (2014) Discrete optimum design of truss structures by an improved firefly algorithm. Advances in Structural Engineering. 17(10). pp. 1517-1530. DOI: 10.1260/1369-4332.17.10.1517
Rouban, A.I. (2013) Global optimization method based on the selective averaging coordinates with restrictions. Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie vychislitelnaja tehnika i informatika - Tomsk State University Journal of Control and Computer Science. 22. pp. 114-123. DOI: 10.17212/1814-1196-2017-3-126-141
Gandomi, A.H., Yang, X.S. & Alavi, A.H. (2011) Mixed variable structural optimization using firefly algorithm. Computers & Structures. 89(23). pp. 2325-2336. DOI: 10.1016/j.compstruc.2011.08.002
Luh, G.C. & Lin, C.Y. (2011) Optimal design of truss-structures using particle swarm optimization. Computers & Structures. 89(23-24). pp. 2221-2232. DOI: 10.1016/j.compstruc.2011.08.013
Kripakaran, P., Brian, H. & Abhinav, G. (2010) A genetic algorithm for design of moment-resisting steel frames. Structural Multidisciplinary Optimization. 32(3). pp. 559-574. DOI: 10.1007/s00158-011-0654-7
Rao, S.S. (2009) Engineering optimization: theory andpractice. 4th ed. John Wiley & Sons.
Spillers, W.R. & MacBain, K.M. (2009) Structural Optimization. Boston, MA: Springer.
Kaveh, A. & Talatahari, S. (2010) An improved ant colony optimization for the design of planar steel frames. Engineering Structures. 32(3). pp. 864-873. DOI: 10.1016/j.engstruct.2009.12.012
Floudas, C.A. & Pardalos, P.M. (2009) Encyclopedia of Optimization. 2th ed. Boston, MA: Springer.
Camp, C.V., Bichon, B.J. & Stovall, S.P. (2005) Design of steel frames using ant colony optimization. Journal of Structural Engineering. 131(3). pp. 369-379. DOI: 10.1061/(ASCE)0733-9445(2005)131:3(369)
Kaveh, A. & Talatahari, S. (2008) A hybrid particle swarm and ant colony optimization for design of truss structures. Asian Journal of Civil Engineering. 9(4). pp. 329-348.
Pezeshk, S., Camp, C. & Chen, D. (2000) Design of nonlinear framed structures using genetic optimization. Journal of Structural Engineering. 126(3). pp. 382-388. DOI: 10.1061/(ASCE)0733-9445(2000)126:3(382)
Salajegheh, J. (2001) Continuous and discrete optimization of space structures using approximation concepts. Ph.D. Thesis. University of Kerman. Iran. (In Persian).
Ruban, A.I. (2004) Global’naya optimizatsiya metodom usredneniya koordinat [Global optimization by a method of averaging of coordinates]. Krasnoyarsk: State Technical University.
Beckers, M. (2000) Dual methods for discrete structural optimization problems. International Journal for Numerical Methods in Engineering. 48. pp. 1761-1784. DOI: 10.1002/1097-0207(20000830)48:12<1761::AID-NME963>3.0.CO;2-R
Ruban, A.I. (1997) Global extremum of continuous functions. Computer Science and Control Systems. 2. pp. 3-11.
Gutkowski, W. (1997) Discrete structural optimization: design problems and exact solution methods. Discrete structural optimization. Vienna: Springer. pp. 1-53.
Salajegheh, E. (1996) Discrete variable optimization of plate structures using dual methods. Computers & Structures. 58(6). pp. 1131-1138.
Ruban, A.I. (1995) The nonparametric search optimization method. Russian Physics Journal. 38(9). pp. 65-73.
Ruban, A.I. (1994) The nonparametric search global optimization method. Cybernetics and Higher Educational Institution. vol. 28 (Intellectual information technology). Tomsk: Tomsk Polytechnic University. pp. 107-114.
Cohn, M.Z. & Dinovitzer, A.S. (1994) Application of structural optimization. Journal of Structural Engineering. 120(2). pp. 617 DOI: 10.1061/(ASCE)0733-9445(1994)120:2(617)
Gupta, O.K. & Ravindran, A. (1983) Nonlinear integer programming and discrete optimization. Journal of Mechanisms, Transmissions, and Automation in Design. 105(2). pp. 160-164.
Olsen, G. & Vanderplaats, G.N. (1989) A method for nonlinear optimization with discrete variables. AIAA J. 27(11). pp. 1584-1589.
Rajeev, S. & Krishnamoorthy, C.S. (1992) Discrete optimization of structures using genetic algorithms. Journal of Structural Engineering. 118(5). pp. 1233-1250. DOI: 10.1061/(ASCE)0733-9445(1992)118:5(1233)
Schmit, L.A. & Farshi, B. (1974) Some approximation concepts for structural synthesis. AIAA J. 12(5). pp. 692-699.