Dynamic programming

View this topic in
In mathematics and computer science, dynamic programming is a method for solving complex problems by breaking them down into simpler subproblems. (Wikipedia.org)






Conferences related to Dynamic programming

Back to Top

2019 49th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN)

Promote the exchange of ideas between academia and industry in the field of computer and networks dependability


2018 20th International Conference on Advanced Communication Technology (ICACT)

With technically co-sponsored by IEEE ComSoc(Communications Society), IEEE ComSoc CISTC(Communications & Information Security Technical Community), and IEEE ComSoc ONTC(Optical Networking Technical Community), the ICACT(International Conference on Advanced Communications Technology) Conference has been providing an open forum for scholars, researchers, and engineers to the extensive exchange of information on newly emerging technologies, standards, services, and applications in the area of the advanced communications technology. The conference official language is English. All the presented papers have been published in the Conference Proceedings, and posted on the ICACT Website and IEEE Xplore Digital Library since 2004. The honorable ICACT Out-Standing Paper Award list has been posted on the IEEE Xplore Digital Library also, and all the Out-Standing papers are subjected to the invited paper of the "ICACT Transactions on the Advanced Communications Technology" Journal issued by GIRI

  • 2017 19th International Conference on Advanced Communication Technology (ICACT)

    With technically co-sponsored by IEEE ComSoc(Communications Society), IEEE ComSoc CISTC(Communications & Information Security Technical Community), and IEEE ComSoc ONTC(Optical Networking Technical Community), the ICACT(International Conference on Advanced Communications Technology) Conference has been providing an open forum for scholars, researchers, and engineers to the extensive exchange of information on newly emerging technologies, standards, services, and applications in the area of the advanced communications technology. The conference official language is English. All the presented papers have been published in the Conference Proceedings, and posted on the ICACT Website and IEEE Xplore Digital Library since 2004. The honorable ICACT Out-Standing Paper Award list has been posted on the IEEE Xplore Digital Library also, and all the Out-Standing papers are subjected to the invited paper of the "ICACT Transactions on the Advanced Communications Technology" Journal issued by

  • 2016 18th International Conference on Advanced Communication Technology (ICACT)

    With technically co-sponsored by IEEE ComSoc(Communications Society), IEEE ComSoc CISTC(Communications & Information Security Technical Community), and IEEE ComSoc ONTC(Optical Networking Technical Community), the ICACT(International Conference on Advanced Communications Technology) Conference has been providing an open forum for scholars, researchers, and engineers to the extensive exchange of information on newly emerging technologies, standards, services, and applications in the area of the advanced communications technology. The conference official language is English. All the presented papers have been published in the Conference Proceedings, and posted on the ICACT Website and IEEE Xplore Digital Library since 2004. The honorable ICACT Out-Standing Paper Award list has been posted on the IEEE Xplore Digital Library also, and all the Out-Standing papers are subjected to the invited paper of the "ICACT Transactions on the Advanced Communications Technology" Journal issued by GiRI.

  • 2015 17th International Conference on Advanced Communication Technology (ICACT)

    With technically co-sponsored by IEEE ComSoc(Communications Society), IEEE ComSoc CISTC(Communications & Information Security Technical Community), and IEEE ComSoc ONTC(Optical Networking Technical Community), the ICACT(International Conference on Advanced Communications Technology) Conference has been providing an open forum for scholars, researchers, and engineers to the extensive exchange of information on newly emerging technologies, standards, services, and applications in the area of the advanced communications technology. The conference official language is English. All the presented papers have been published in the Conference Proceedings, and posted on the ICACT Website and IEEE Xplore Digital Library since 2004. The honorable ICACT Out-Standing Paper Award list has been posted on the IEEE Xplore Digital Library also, and all the Out-Standing papers are subjected to the invited paper of the "ICACT Transactions on the Advanced Communications Technology" Journal issued by GiRI.

  • 2014 16th International Conference on Advanced Communication Technology (ICACT)

    Technology, service, architecture, strategy, and policy in newly emerging system, standard, service, and variety of application on the area of telecommunications. ICACT 2014 provides an open forum for scholar, researcher, engineer, policy maker, network planner, and service provider in the advanced communication technologies.

  • 2013 15th International Conference on Advanced Communication Technology (ICACT)

    Technology, standard, service, architecture, strategy, and policy in newly emerging systems and a variety of applications in the area of communications. ICACT2013 provides an open forum for scholar, researcher, engineer, policy maker, network planner, and service provider in the advanced communications technologies.

  • 2012 14th International Conference on Advanced Communication Technology (ICACT)

    Technology, service, architecture, strategy, and policy in newly emerging systems, standards, service, and a variety of applications in the area of telecommunicatons. ICACT 2012 provides an open forum for scholars, researchers, engineers, policy makers, network planners, and service providers in the advanced communication technologies.

  • 2011 13th International Conference on Advanced Communication Technology (ICACT)

    International Conference on Advanced Communication Technology (ICACT) provides an open forum for researchers, engineers, policy, network planners, and service providers in the advanced communication technologies. Extensive exchange of information will be provided on newly emerging systems, standards, services, and variety of applications on the area of telecommunications.

  • 2010 12th International Conference on Advanced Communication Technology (ICACT)

    ICACT is an annual conference providing an open forum for researchers, engineers, network planners, and service providers in telecommunications. Extensive exchange of information will be provided on newly emerging systems, standards, services, and variety of applications in the area of telecommunications.

  • 2009 11th International Conference on Advanced Communication Technology (ICACT)

    ICACT is an annual conference providing an open forum for researchers, engineers, network planners, and service providers in telecommunications. Extensive exchange of information will be provided on newly emerging systems, standards, services, and variety of applications in the area of telecommunications.

  • 2008 10th International Conference Advanced Communication Technology (ICACT)

  • 2007 9th International Conference Advanced Communication Technology (ICACT)

  • 2006 8th International Conference Advanced Communication Technology (ICACT)

  • 2005 7th International Conference Advanced Communication Technology (ICACT)

  • 2004 6th International Conference Advanced Communication Technology (ICACT)


2018 25th IEEE International Conference on Image Processing (ICIP)

The International Conference on Image Processing (ICIP), sponsored by the IEEE Signal Processing Society, is the premier forum for the presentation of technological advances and research results in the fields of theoretical, experimental, and applied image and video processing. ICIP 2018, the 25th in the series that has been held annually since 1994, brings together leading engineers and scientists in image and video processing from around the world.


2018 Design, Automation & Test in Europe Conference & Exhibition (DATE)

The DATE conference addresses all aspects of research into technologies for electronic and embedded system engineering. It covers the design process, test, and automation tools for electronics ranging from integrated circuits to distributed embedded systems. This includes both hardware and embedded software design issues. The conference scope also includes the elaboration of design requirements and new architectures for challenging application fields such as telecoms, wireless communications, multimedia, healthcare, smart energy and automotive systems. Companies also present innovative industrial designs to foster the feedback fromrealworld design to research. DATE also hosts a number of special sessions, events within the main technical programme such as panels, hot-topic sessions, tutorials and workshops technical programme such as panels, hot-topic sessions, tutorials and workshops.

  • 2017 Design, Automation & Test in Europe Conference & Exhibition (DATE)

    The DATE conference addresses all aspects of research into technologies for electronic and embedded system engineering. It covers the design process, test, and automation tools for electronics ranging from integrated circuits to distributed embedded systems. This includes both hardware and embedded software design issues. The conference scope also includes the elaboration of design requirements and new architectures for challenging application fields such as telecoms, wireless communications, multimedia, healthcare, smart energy and automotive systems. Companies also present innovative industrial designs to foster the feedback fromrealworld design to research. DATE also hosts a number of special sessions, events within the main technical programme such as panels, hot-topic sessions, tutorials and workshops technical programme such as panels, hot-topic sessions, tutorials and workshops.

  • 2016 Design, Automation & Test in Europe Conference & Exhibition (DATE)

    The DATE conference addresses all aspects of research into technologies for electronic andembedded system engineering. It covers the design process, test, and automation tools forelectronics ranging from integrated circuits to distributed embedded systems. This includes bothhardware and embedded software design issues. The conference scope also includes theelaboration of design requirements and new architectures for challenging application fields suchas telecoms, wireless communications, multimedia, healthcare, smart energy and automotivesystems. Companies also present innovative industrial designs to foster the feedback from realworlddesign to research. DATE also hosts a number of special sessions, events within the maintechnical programme such as panels, hot-topic sessions, tutorials and workshops technical programme such as panels, hot-topic sessions, tutorials and workshops

  • 2015 Design, Automation & Test in Europe Conference & Exhibition (DATE)

    The DATE conference addresses all aspects of research into technologies for electronic and embedded system engineering. It covers the design process, test, and automation tools for electronics ranging from integrated circuits to distributed embedded systems. This includes both hardware and embedded software design issues. The conference scope also includes the elaboration of design requirements and new architectures for challenging application fields such as telecoms, wireless communications, multimedia, healthcare, smart energy and automotive systems. Companies also present innovative industrial designs to foster the feedback from realworld design to research. DATE also hosts a number of special sessions, events within the main technical programme such as panels, hot-topic sessions, tutorials and workshops.

  • 2014 Design, Automation & Test in Europe Conference & Exhibition (DATE)

    The DATE conference addresses all aspects of research into technologies for electronic and embedded system engineering. It covers the design process, test, and automation tools for electronics ranging from integrated circuits to distributed embedded systems. This includes both hardware and embedded software design issues. The conference scope also includes the elaboration of design requirements and new architectures for challenging application fields such as telecoms, wireless communications, multimedia, healthcare, smart energy and automotive systems. Companies also present innovative industrial designs to foster the feedback from real-world design to research. DATE also hosts a number of special sessions, events within the main technical programme such as panels, hot-topic sessions, tutorials and workshops

  • 2013 Design, Automation & Test in Europe Conference & Exhibition (DATE 2013)

    DATE is the complete event for the European electronic and test community. A leading world conference and exhibition, DATE unites 2,000 professionals with approximately 60 exhibiting companies, cutting edge R&D, industrial designers and technical managers from around the world.

  • 2012 Design, Automation & Test in Europe Conference & Exhibition (DATE 2012)

    DATE is the complete event for the European electronic system and test community. A leading world conference and exhibition, DATE unites 2,000 professionals with some 60 exhibiting companies, cutting edge R&D, industrial designers and technical managers from around the world.

  • 2011 Design, Automation & Test in Europe Conference & Exhibition (DATE 2011)

    DATE is the complete event for the European electronic system and test community. A world leading conference and exhibition, DATE unites 2,000 professionals with some 60 exhibiting companies, cutting edge R&D, industrial designers and technical managers from around the world.

  • 2010 Design, Automation & Test in Europe Conference & Exhibition (DATE 2010)

    All aspects of research into technologies for electronic and (embedded) systems engineering. It covers the design process, test, and tools for design automation of electronic products ranging from integrated circuits to distributed large-scale systems.

  • 2009 Design, Automation & Test in Europe Conference & Exhibition (DATE 2009)

    The Design, Automation, and Test in Europe (DATE) conference is the world's premier conference dedicated to electronics system design & test. The technical programme features: Four distinctive and integrated themes, covering all aspects of systems design and engineering. Two special days are focusing on SoC Development Strategies and Multicore Applications.

  • 2008 Design, Automation & Test in Europe Conference & Exhibition (DATE 2008)

    The 11th DATE conference and exhibition is the main European event bringing together designers and design automation users, researchers and vendors, as well as specialists in the hardware and software design, test and manufacturing of electronic circuits and systems. It puts strong emphasis on ICs/SoCs, reconfigurable hardware and embedded systems, including embedded software. The five-day event consists of a conference with plenary invited papers, regular papers, panels, hot-topic sessions, tutorials.

  • 2007 Design, Automation & Test in Europe Conference & Exhibition (DATE 2007)

    DATE is the main European event bringing together designers and design automation users, researchers and vendors, as well as specialists in the hardware and software design, test and manufacturing of electronic circuits and systems. It puts strong emphasis on both ICs/SoCs, reconfigurable hardware and embedded systems, including embedded software.

  • 2006 Design, Automation & Test in Europe Conference & Exhibition (DATE 2006)

  • 2005 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 2004 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 2003 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 2002 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 2001 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 2000 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 1999 Design, Automation & Test in Europe Conference & Exhibition (DATE)


2018 Federated Conference on Computer Science and Information Systems (FedCSIS)

The mission of the FedCSIS Conference Series is to provide a highly acclaimed multi-conference forum in computer science and information systems. The forum invites researchers from around the world to contribute their research results and participate in Events focused on their scientific and professional interests in computer science and information systems.The FedCSIS multi-conference consists of a significant number of recurring Events and it welcomes proposals for new Events (conferences, symposia, workshops, special sessions). Each Event may run over any span of time within the conference dates (from half-day to three days). Since 2012, Proceedings of the FedCSIS conference are indexed in the Web of Science and other indexing services.

  • 2017 Federated Conference on Computer Science and Information Systems (FedCSIS)

    The FedCSIS Multiconference consists of Events (conferences, symposia, workshops, special sessions). Each Event may run over any span of time within the conference dates (from half-day to three days). The FedCSIS Events provide a platform for bringing together researchers, practitioners, and academia to present and discuss ideas, challenges and potential solutions on established or emerging topics related to research and practice in computer science and information systems. Since 2012, Proceedings of the FedCSIS conference are indexed in the Thomson Reuters Web of Science.

  • 2016 Federated Conference on Computer Science and Information Systems (FedCSIS)

    The FedCSIS Multiconference consists of Events (conferences, symposia, workshops, special sessions). Each Event may run over any span of time within the conference dates (from half-day to three days). The FedCSIS Events provide a platform for bringing together researchers, practitioners, and academia to present and discuss ideas, challenges and potential solutions on established or emerging topics related to research and practice in computer science and information systems. Since 2012, Proceedings of the FedCSIS conference are indexed in the Thomson Reuters Web of Science.

  • 2015 Federated Conference on Computer Science and Information Systems (FedCSIS)

    The FedCSIS Multiconference consists of Events (conferences, symposia, workshops, special sessions). Each Event may run over any span of time within the conference dates (from half-day to three days). The FedCSIS Events provide a platform for bringing together researchers, practitioners, and academia to present and discuss ideas, challenges and potential solutions on established or emerging topics related to research and practice in computer science and information systems.

  • 2014 Federated Conference on Computer Science and Information Systems (FedCSIS)

    The FedCSIS Multiconference consists of Events (conferences, symposia, workshops, special sessions). Each Event may run over any span of time within the conference dates (from half-day to three days). The FedCSIS Events provide a platform for bringing together researchers, practitioners, and academia to present and discuss ideas, challenges and potential solutions on established or emerging topics related to research and practice in computer science and information systems.

  • 2013 Federated Conference on Computer Science and Information Systems (FedCSIS)

    FedCSIS Multiconference consists of Events (conferences, symposia, workshops, special sessions) that provide a platform for bringing together researchers, practitioners, and academia to present and discuss ideas, challenges and potential solutions on topics related to research and practice in CS/IS.

  • 2012 Federated Conference on Computer Science and Information Systems (FedCSIS)

    Continuation of FedCSIS 2011, scope depends on the scopes of individual events that FedCSIS consists of.

  • 2011 Federated Conference on Computer Science and Information Systems (FedCSIS)


More Conferences

Periodicals related to Dynamic programming

Back to Top

Aerospace and Electronic Systems Magazine, IEEE

The IEEE Aerospace and Electronic Systems Magazine publishes articles concerned with the various aspects of systems for space, air, ocean, or ground environments.


Antennas and Wireless Propagation Letters, IEEE

IEEE Antennas and Wireless Propagation Letters (AWP Letters) will be devoted to the rapid electronic publication of short manuscripts in the technical areas of Antennas and Wireless Propagation.


Applied Superconductivity, IEEE Transactions on

Contains articles on the applications and other relevant technology. Electronic applications include analog and digital circuits employing thin films and active devices such as Josephson junctions. Power applications include magnet design as well asmotors, generators, and power transmission


Audio, Speech, and Language Processing, IEEE Transactions on

Speech analysis, synthesis, coding speech recognition, speaker recognition, language modeling, speech production and perception, speech enhancement. In audio, transducers, room acoustics, active sound control, human audition, analysis/synthesis/coding of music, and consumer audio. (8) (IEEE Guide for Authors) The scope for the proposed transactions includes SPEECH PROCESSING - Transmission and storage of Speech signals; speech coding; speech enhancement and noise reduction; ...


Automatic Control, IEEE Transactions on

The theory, design and application of Control Systems. It shall encompass components, and the integration of these components, as are necessary for the construction of such systems. The word `systems' as used herein shall be interpreted to include physical, biological, organizational and other entities and combinations thereof, which can be represented through a mathematical symbolism. The Field of Interest: shall ...


More Periodicals

Most published Xplore authors for Dynamic programming

Back to Top

Xplore Articles related to Dynamic programming

Back to Top

A study of the partitioned dynamic programming algorithm for genome comparison in FPGA

[{u'author_order': 1, u'affiliation': u'Department of Electrical and Electronic Engineering, Centre for Bio-Inspired Technology, Institute of Biomedical Engineering, Imperial College London, SW7 2AZ, UK', u'full_name': u'Yuanqi Hu'}, {u'author_order': 2, u'affiliation': u'Department of Electrical and Electronic Engineering, Centre for Bio-Inspired Technology, Institute of Biomedical Engineering, Imperial College London, SW7 2AZ, UK', u'full_name': u'Pantelis Georgiou'}] 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013), None

This paper explores the potential of partitioning the dynamic programming algorithm to utilise the capabilities of FPGA platforms for parallel genome sequence comparison and assembly. We use this to solve the prefix-suffix approximate matching problem to find overlaps between DNA strands in a given sequence. This is achieved by partitioning the basic dynamic programming (DP) algorithm into a series of ...


An iterated local search algorithm for the multi-vehicle covering tour problem

[{u'author_order': 1, u'affiliation': u'Dept. Computer Science and Mathematical Informatics, Graduate School of Information Science, Nagoya University, Japan', u'full_name': u'Yosuke Takada'}, {u'author_order': 2, u'affiliation': u'Dept. Computer Science and Mathematical Informatics, Graduate School of Information Science, Nagoya University, Japan', u'full_name': u'Yannan Hu'}, {u'author_order': 3, u'affiliation': u'Dept. Logistics and Information Engineering, Tokyo University of Marine Science and Technology, Japan', u'full_name': u'Hideki Hashimoto'}, {u'author_order': 4, u'affiliation': u'Dept. Computer Science and Mathematical Informatics, Graduate School of Information Science, Nagoya University, Japan', u'full_name': u'Mutsunori Yagiura'}] 2015 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), None

Given two sets of vertices V and W, where each vertex in V covers a subset of W, the multi-vehicle covering tour problem asks to determine a number of vehicle routes on a subset of V so as to minimize the total distance under the constraint that every vertex in W must be covered by vertices in the routes. We ...


Short-term hydro-thermal coordination based on interior point nonlinear programming and genetic algorithms

[{u'author_order': 1, u'affiliation': u'Dept. of Electr. Eng., Seville Univ., Spain', u'full_name': u'J. L. M. Ramos'}, {u'author_order': 2, u'full_name': u'A. T. Lora'}, {u'author_order': 3, u'full_name': u'J. R. Santos'}, {u'author_order': 4, u'full_name': u'A. G. Exposito'}] 2001 IEEE Porto Power Tech Proceedings (Cat. No.01EX502), None

This paper presents a combined primal-dual logarithmic-barrier interior point and genetic algorithm for short-term hydro-thermal coordination. The genetic algorithm is used to compute the optimal on/off status of thermal units, while the interior point module deals with the optimal solution of the hydraulically-coupled short-term economic dispatch of thermal and hydro units. Inter-temporal constraints both due to cascaded reservoirs and maximum ...


Optimal Restoration of Distribution Systems Using Dynamic Programming

[{u'author_order': 1, u'affiliation': u'Arizona State Univ., Tempe, AZ', u'full_name': u'Ra\xdal Perez-Guerrero'}, {u'author_order': 2, u'affiliation': u'Arizona State Univ., Tempe, AZ', u'full_name': u'Gerald Thomas Heydt'}, {u'author_order': 3, u'full_name': u'Nevida J. Jack'}, {u'author_order': 4, u'full_name': u'Brian K. Keel'}, {u'author_order': 5, u'full_name': u'Armindo R. Castelhano'}] IEEE Transactions on Power Delivery, 2008

This paper solves the distribution system restoration problem using dynamic programming with state reduction. The algorithm is an operator-permissive, automated approach to the restoration of distribution systems after a blackout. The timing and selection of feeders to be energized are represented as states in a dynamic programming formulation. An enhanced dynamic programming method reduces the number of states by grouping ...


A Comparison of Three Programming Models for Telecom Service Composition

[{u'author_order': 1, u'affiliation': u'IBM China Research Laboratory', u'full_name': u'Yuan Yuan'}, {u'author_order': 2, u'affiliation': u'IBM China Research Laboratory', u'full_name': u'Jia Jia Wen'}, {u'author_order': 3, u'affiliation': u'IBM China Research Laboratory', u'full_name': u'Wei Li'}, {u'author_order': 4, u'affiliation': u'IBM China Research Laboratory', u'full_name': u'Bing Bing Zhang'}] Telecommunications, 2007. AICT 2007. The Third Advanced International Conference on, None

Service composition technologies are very important to telecom industry today since they allow application developers to make use of existing services as building blocks to create new services in a rapid and flexible manner in order to catch the fast changing market dynamics. The building block services are usually telecom network capabilities exposed through various protocols (e.g., SIP, Parlay) as ...


More Xplore Articles

Educational Resources on Dynamic programming

Back to Top

eLearning

No eLearning Articles are currently tagged "Dynamic programming"

IEEE-USA E-Books

  • Tools for Tree Searches: Dynamic Programming

    This chapter contains sections titled: Introduction Top‐Down Approach Bottom‐Up Approach Automata Theory and Dynamic Programming Parallel Algorithms Dynamic Programming Heuristics Conclusions References

  • Global Adaptive Dynamic Programming for Nonlinear Polynomial Systems

    This chapter brings more advanced optimization techniques, such as semidefinite programming (SDP) and sum¿¿¿of¿¿¿squares (SOS) programming, into adaptive dynamic programming (ADP) design. The goal is to achieve adaptive suboptimal online learning and, at the same time, maintain global asymptotic stability of the closed¿¿¿loop system. The chapter considers an auxiliary optimization problem, which helps to obtain a suboptimal solution to the minimization problem, and develops a policy iteration method for polynomial systems using SOS¿¿¿based methods. The chapter also develops an online learning method based on the idea of ADP to implement the iterative scheme with real¿¿¿time data, instead of identifying the system dynamics. Finally, it extends the proposed global ADP method to deal with an enlarged class of nonlinear systems, and covers the numerical simulation for four different examples.

  • Robust Adaptive Dynamic Programming

    This chapter introduces a new concept of robust adaptive dynamic programming (RADP), a natural extension of ADP to uncertain dynamic systems. It presents an online learning strategy for the design of robust adaptive suboptimal controllers that globally asymptotically stabilize the system. The chapter introduces the robust redesign technique to achieve RADP for nonlinear systems. To begin with, it considers the nonlinear system with dynamic uncertainties. The RADP methodologies can be viewed as natural extensions of ADP to dynamically perturbed uncertain systems. The RADP framework decomposes the uncertain environment into two parts: the reduced¿¿¿order system (ideal environment) with known system order and fully accessible state, and the dynamic uncertainties, with unknown system order and dynamics, interacting with the ideal environment. The presence of dynamic uncertainty gives rise to interconnected systems for which the controller design and robustness analysis become technically challenging.

  • Adaptive Dynamic Programming for Uncertain Linear Systems

    This chapter presents a reinforcement learning¿¿¿inspired adaptive dynamic programming (ADP) approach for finding a new class of online adaptive optimal controllers for uncertain linear systems. Comparing the on¿¿¿policy and the off¿¿¿policy learning strategies, it can be seen that the former spreads the computational burden into different iteration time points, at the price of a longer learning process. The latter can achieve faster learning by making full use of the online measurements, at the expense of heavier computational efforts at a single iteration time point. The chapter uses two examples to validate, through numerical simulations, the effectiveness of the proposed algorithms. The first example is created using Simulink Version 8.5 (R2015a). It illustrates how the on¿¿¿policy learning can be applied to a third¿¿¿order linear system. The second example is implemented in MATLAB scripts. It applies the off¿¿¿policy learning strategy to design an approximate optimal feedback control policy for a diesel engine.

  • Solving the KCT Problem: Large‐Scale Neighborhood Search and Solution Merging

    This chapter contains sections titled: Introduction Hybrid Algorithms for the KCT Problem Experimental Analysis Conclusions References

  • Robust Adaptive Dynamic Programming for Large¿¿¿Scale Systems

    This chapter explains the robust adaptive dynamic programming (RADP) theory for the decentralized optimal control of a generalized class of large¿¿¿scale systems. The controller design of each subsystem only utilizes local state variables, without knowing the system dynamics. By integrating a simple version of the cyclic¿¿¿small¿¿¿gain theorem, asymptotic stability can be achieved by assigning appropriate weighting matrices for each subsystem. As a by¿¿¿product, certain suboptimality properties can be obtained. The chapter describes the class of large¿¿¿scale uncertain systems to be studied. Then, an RADP¿¿¿based decentralized optimal controller design scheme is presented. It is also shown that the closed¿¿¿loop interconnected system enjoys some suboptimality properties. In addition, the effectiveness of the proposed methodology is demonstrated via its application to the online learning control of a ten¿¿¿machine power system with governor controllers.

  • Semi¿¿¿Global Adaptive Dynamic Programming

    This chapter explores the adaptive dynamic programming (ADP) methods to handle affine nonlinear systems via neural network¿¿¿based approximation. An online learning method with convergence analysis is provided and it achieves semi¿¿¿global stabilization for nonlinear systems in that the domain of attraction can be made arbitrarily large, but bounded, by tuning the controller parameters or design functions. Two most frequently used techniques in reinforcement learning are value iteration and policy iteration. When the system dynamics are uncertain, the approximation can be realized using online information via reinforcement learning and ADP methods. Neural network¿¿¿based ADP methods for nonlinear control systems are being actively developed by a good number of researchers. Some recent theoretical results include ADP for non¿¿¿affine nonlinear systems, ADP for saturated control design, ADP for nonlinear games, and ADP for nonlinear tracking problems.

  • Unit Commitment

    This chapter introduces several major techniques for solving the unit commitment (UC) problem, such as the priority method, dynamic programming, and the Lagrange relaxation method. Several new algorithms are then added to tackle UC problems. These are the evolutionary programming-based tabu search method, particle swarm optimization, and the analytic hierarchy process (AHP). The chapter provides a number of numerical examples and analyses. The classic UC problem is to minimize total operational cost and is subject to minimum up- and downtime constraints, crew constraints, unit capability limits, generation constraints, and reserve constraints. The AHP is a decision-making approach. It presents alternatives and criteria, evaluates trade-off, and performs a synthesis to arrive at a final decision. This chapter addresses future UC requirements in a deregulated environment where network constraints, reliability, value of generation, and variational changes in demands and other costs may be factors.

  • Introduction

    This chapter presents an overview of key concepts covered in this book. The book studies adaptive dynamic programming (ADP) for uncertain linear systems, of which the only a priori knowledge is an initial, stabilizing static state¿¿¿feedback control policy. Two ADP methods, on¿¿¿policy learning and off¿¿¿policy learning, are introduced to achieve online implementation of conventional policy iteration. The book then focuses on the theory of global ADP (GADP). It aims at simultaneously improving the closed¿¿¿loop system performance and achieving global asymptotic stability of the overall system at the origin. The book also applies the robust ADP (RADP) framework to solve the decentralized optimal control problem for a class of large¿¿¿scale uncertain systems, and studies sensorimotor control with static and dynamic uncertainties under the framework of RADP.

  • Robust Adaptive Dynamic Programming as A Theory of Sensorimotor Control

    Many tasks that humans perform in our everyday life involve different sources of uncertainties. However, it is interesting and surprising to notice how the central nervous system (CNS) can gracefully coordinate our movements to deal with these uncertainties. This chapter studies sensorimotor control with static and dynamic uncertainties under the framework of robust adaptive dynamic programming (RADP). The linear version of RADP is extended for stochastic systems by taking into account signal¿¿¿dependent noise, and the proposed method is applied to study the sensorimotor control problem with both static and dynamic uncertainties. Results presented in the chapter suggest that the CNS may use RADP¿¿¿like learning strategy to coordinate movements and to achieve successful adaptation in the presence of static and/or dynamic uncertainties. In the absence of dynamic uncertainties, the learning strategy reduces to an ADP¿¿¿like mechanism.



Standards related to Dynamic programming

Back to Top

(Replaced) IEEE Standard VHDL Language Reference Manual

his standard revises and enhances the VHDL language reference manual (LRM) by including a standard C language interface specification; specifications from previously separate, but related, standards IEEE Std 1164 -1993,1 IEEE Std 1076.2 -1996, and IEEE Std 1076.3-1997; and general language enhancements in the areas of design and verification of electronic systems.



Jobs related to Dynamic programming

Back to Top