Dynamic programming

View this topic in
In mathematics and computer science, dynamic programming is a method for solving complex problems by breaking them down into simpler subproblems. (Wikipedia.org)






Conferences related to Dynamic programming

Back to Top

2019 49th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN)

Promote the exchange of ideas between academia and industry in the field of computer and networks dependability


2018 20th International Conference on Advanced Communication Technology (ICACT)

With technically co-sponsored by IEEE ComSoc(Communications Society), IEEE ComSoc CISTC(Communications & Information Security Technical Community), and IEEE ComSoc ONTC(Optical Networking Technical Community), the ICACT(International Conference on Advanced Communications Technology) Conference has been providing an open forum for scholars, researchers, and engineers to the extensive exchange of information on newly emerging technologies, standards, services, and applications in the area of the advanced communications technology. The conference official language is English. All the presented papers have been published in the Conference Proceedings, and posted on the ICACT Website and IEEE Xplore Digital Library since 2004. The honorable ICACT Out-Standing Paper Award list has been posted on the IEEE Xplore Digital Library also, and all the Out-Standing papers are subjected to the invited paper of the "ICACT Transactions on the Advanced Communications Technology" Journal issued by GIRI

  • 2017 19th International Conference on Advanced Communication Technology (ICACT)

    With technically co-sponsored by IEEE ComSoc(Communications Society), IEEE ComSoc CISTC(Communications & Information Security Technical Community), and IEEE ComSoc ONTC(Optical Networking Technical Community), the ICACT(International Conference on Advanced Communications Technology) Conference has been providing an open forum for scholars, researchers, and engineers to the extensive exchange of information on newly emerging technologies, standards, services, and applications in the area of the advanced communications technology. The conference official language is English. All the presented papers have been published in the Conference Proceedings, and posted on the ICACT Website and IEEE Xplore Digital Library since 2004. The honorable ICACT Out-Standing Paper Award list has been posted on the IEEE Xplore Digital Library also, and all the Out-Standing papers are subjected to the invited paper of the "ICACT Transactions on the Advanced Communications Technology" Journal issued by

  • 2016 18th International Conference on Advanced Communication Technology (ICACT)

    With technically co-sponsored by IEEE ComSoc(Communications Society), IEEE ComSoc CISTC(Communications & Information Security Technical Community), and IEEE ComSoc ONTC(Optical Networking Technical Community), the ICACT(International Conference on Advanced Communications Technology) Conference has been providing an open forum for scholars, researchers, and engineers to the extensive exchange of information on newly emerging technologies, standards, services, and applications in the area of the advanced communications technology. The conference official language is English. All the presented papers have been published in the Conference Proceedings, and posted on the ICACT Website and IEEE Xplore Digital Library since 2004. The honorable ICACT Out-Standing Paper Award list has been posted on the IEEE Xplore Digital Library also, and all the Out-Standing papers are subjected to the invited paper of the "ICACT Transactions on the Advanced Communications Technology" Journal issued by GiRI.

  • 2015 17th International Conference on Advanced Communication Technology (ICACT)

    With technically co-sponsored by IEEE ComSoc(Communications Society), IEEE ComSoc CISTC(Communications & Information Security Technical Community), and IEEE ComSoc ONTC(Optical Networking Technical Community), the ICACT(International Conference on Advanced Communications Technology) Conference has been providing an open forum for scholars, researchers, and engineers to the extensive exchange of information on newly emerging technologies, standards, services, and applications in the area of the advanced communications technology. The conference official language is English. All the presented papers have been published in the Conference Proceedings, and posted on the ICACT Website and IEEE Xplore Digital Library since 2004. The honorable ICACT Out-Standing Paper Award list has been posted on the IEEE Xplore Digital Library also, and all the Out-Standing papers are subjected to the invited paper of the "ICACT Transactions on the Advanced Communications Technology" Journal issued by GiRI.

  • 2014 16th International Conference on Advanced Communication Technology (ICACT)

    Technology, service, architecture, strategy, and policy in newly emerging system, standard, service, and variety of application on the area of telecommunications. ICACT 2014 provides an open forum for scholar, researcher, engineer, policy maker, network planner, and service provider in the advanced communication technologies.

  • 2013 15th International Conference on Advanced Communication Technology (ICACT)

    Technology, standard, service, architecture, strategy, and policy in newly emerging systems and a variety of applications in the area of communications. ICACT2013 provides an open forum for scholar, researcher, engineer, policy maker, network planner, and service provider in the advanced communications technologies.

  • 2012 14th International Conference on Advanced Communication Technology (ICACT)

    Technology, service, architecture, strategy, and policy in newly emerging systems, standards, service, and a variety of applications in the area of telecommunicatons. ICACT 2012 provides an open forum for scholars, researchers, engineers, policy makers, network planners, and service providers in the advanced communication technologies.

  • 2011 13th International Conference on Advanced Communication Technology (ICACT)

    International Conference on Advanced Communication Technology (ICACT) provides an open forum for researchers, engineers, policy, network planners, and service providers in the advanced communication technologies. Extensive exchange of information will be provided on newly emerging systems, standards, services, and variety of applications on the area of telecommunications.

  • 2010 12th International Conference on Advanced Communication Technology (ICACT)

    ICACT is an annual conference providing an open forum for researchers, engineers, network planners, and service providers in telecommunications. Extensive exchange of information will be provided on newly emerging systems, standards, services, and variety of applications in the area of telecommunications.

  • 2009 11th International Conference on Advanced Communication Technology (ICACT)

    ICACT is an annual conference providing an open forum for researchers, engineers, network planners, and service providers in telecommunications. Extensive exchange of information will be provided on newly emerging systems, standards, services, and variety of applications in the area of telecommunications.

  • 2008 10th International Conference Advanced Communication Technology (ICACT)

  • 2007 9th International Conference Advanced Communication Technology (ICACT)

  • 2006 8th International Conference Advanced Communication Technology (ICACT)

  • 2005 7th International Conference Advanced Communication Technology (ICACT)

  • 2004 6th International Conference Advanced Communication Technology (ICACT)


2018 25th IEEE International Conference on Image Processing (ICIP)

The International Conference on Image Processing (ICIP), sponsored by the IEEE Signal Processing Society, is the premier forum for the presentation of technological advances and research results in the fields of theoretical, experimental, and applied image and video processing. ICIP 2018, the 25th in the series that has been held annually since 1994, brings together leading engineers and scientists in image and video processing from around the world.


2018 Design, Automation & Test in Europe Conference & Exhibition (DATE)

The DATE conference addresses all aspects of research into technologies for electronic and embedded system engineering. It covers the design process, test, and automation tools for electronics ranging from integrated circuits to distributed embedded systems. This includes both hardware and embedded software design issues. The conference scope also includes the elaboration of design requirements and new architectures for challenging application fields such as telecoms, wireless communications, multimedia, healthcare, smart energy and automotive systems. Companies also present innovative industrial designs to foster the feedback fromrealworld design to research. DATE also hosts a number of special sessions, events within the main technical programme such as panels, hot-topic sessions, tutorials and workshops technical programme such as panels, hot-topic sessions, tutorials and workshops.

  • 2017 Design, Automation & Test in Europe Conference & Exhibition (DATE)

    The DATE conference addresses all aspects of research into technologies for electronic and embedded system engineering. It covers the design process, test, and automation tools for electronics ranging from integrated circuits to distributed embedded systems. This includes both hardware and embedded software design issues. The conference scope also includes the elaboration of design requirements and new architectures for challenging application fields such as telecoms, wireless communications, multimedia, healthcare, smart energy and automotive systems. Companies also present innovative industrial designs to foster the feedback fromrealworld design to research. DATE also hosts a number of special sessions, events within the main technical programme such as panels, hot-topic sessions, tutorials and workshops technical programme such as panels, hot-topic sessions, tutorials and workshops.

  • 2016 Design, Automation & Test in Europe Conference & Exhibition (DATE)

    The DATE conference addresses all aspects of research into technologies for electronic andembedded system engineering. It covers the design process, test, and automation tools forelectronics ranging from integrated circuits to distributed embedded systems. This includes bothhardware and embedded software design issues. The conference scope also includes theelaboration of design requirements and new architectures for challenging application fields suchas telecoms, wireless communications, multimedia, healthcare, smart energy and automotivesystems. Companies also present innovative industrial designs to foster the feedback from realworlddesign to research. DATE also hosts a number of special sessions, events within the maintechnical programme such as panels, hot-topic sessions, tutorials and workshops technical programme such as panels, hot-topic sessions, tutorials and workshops

  • 2015 Design, Automation & Test in Europe Conference & Exhibition (DATE)

    The DATE conference addresses all aspects of research into technologies for electronic and embedded system engineering. It covers the design process, test, and automation tools for electronics ranging from integrated circuits to distributed embedded systems. This includes both hardware and embedded software design issues. The conference scope also includes the elaboration of design requirements and new architectures for challenging application fields such as telecoms, wireless communications, multimedia, healthcare, smart energy and automotive systems. Companies also present innovative industrial designs to foster the feedback from realworld design to research. DATE also hosts a number of special sessions, events within the main technical programme such as panels, hot-topic sessions, tutorials and workshops.

  • 2014 Design, Automation & Test in Europe Conference & Exhibition (DATE)

    The DATE conference addresses all aspects of research into technologies for electronic and embedded system engineering. It covers the design process, test, and automation tools for electronics ranging from integrated circuits to distributed embedded systems. This includes both hardware and embedded software design issues. The conference scope also includes the elaboration of design requirements and new architectures for challenging application fields such as telecoms, wireless communications, multimedia, healthcare, smart energy and automotive systems. Companies also present innovative industrial designs to foster the feedback from real-world design to research. DATE also hosts a number of special sessions, events within the main technical programme such as panels, hot-topic sessions, tutorials and workshops

  • 2013 Design, Automation & Test in Europe Conference & Exhibition (DATE 2013)

    DATE is the complete event for the European electronic and test community. A leading world conference and exhibition, DATE unites 2,000 professionals with approximately 60 exhibiting companies, cutting edge R&D, industrial designers and technical managers from around the world.

  • 2012 Design, Automation & Test in Europe Conference & Exhibition (DATE 2012)

    DATE is the complete event for the European electronic system and test community. A leading world conference and exhibition, DATE unites 2,000 professionals with some 60 exhibiting companies, cutting edge R&D, industrial designers and technical managers from around the world.

  • 2011 Design, Automation & Test in Europe Conference & Exhibition (DATE 2011)

    DATE is the complete event for the European electronic system and test community. A world leading conference and exhibition, DATE unites 2,000 professionals with some 60 exhibiting companies, cutting edge R&D, industrial designers and technical managers from around the world.

  • 2010 Design, Automation & Test in Europe Conference & Exhibition (DATE 2010)

    All aspects of research into technologies for electronic and (embedded) systems engineering. It covers the design process, test, and tools for design automation of electronic products ranging from integrated circuits to distributed large-scale systems.

  • 2009 Design, Automation & Test in Europe Conference & Exhibition (DATE 2009)

    The Design, Automation, and Test in Europe (DATE) conference is the world's premier conference dedicated to electronics system design & test. The technical programme features: Four distinctive and integrated themes, covering all aspects of systems design and engineering. Two special days are focusing on SoC Development Strategies and Multicore Applications.

  • 2008 Design, Automation & Test in Europe Conference & Exhibition (DATE 2008)

    The 11th DATE conference and exhibition is the main European event bringing together designers and design automation users, researchers and vendors, as well as specialists in the hardware and software design, test and manufacturing of electronic circuits and systems. It puts strong emphasis on ICs/SoCs, reconfigurable hardware and embedded systems, including embedded software. The five-day event consists of a conference with plenary invited papers, regular papers, panels, hot-topic sessions, tutorials.

  • 2007 Design, Automation & Test in Europe Conference & Exhibition (DATE 2007)

    DATE is the main European event bringing together designers and design automation users, researchers and vendors, as well as specialists in the hardware and software design, test and manufacturing of electronic circuits and systems. It puts strong emphasis on both ICs/SoCs, reconfigurable hardware and embedded systems, including embedded software.

  • 2006 Design, Automation & Test in Europe Conference & Exhibition (DATE 2006)

  • 2005 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 2004 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 2003 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 2002 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 2001 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 2000 Design, Automation & Test in Europe Conference & Exhibition (DATE)

  • 1999 Design, Automation & Test in Europe Conference & Exhibition (DATE)


2018 Federated Conference on Computer Science and Information Systems (FedCSIS)

The mission of the FedCSIS Conference Series is to provide a highly acclaimed multi-conference forum in computer science and information systems. The forum invites researchers from around the world to contribute their research results and participate in Events focused on their scientific and professional interests in computer science and information systems.The FedCSIS multi-conference consists of a significant number of recurring Events and it welcomes proposals for new Events (conferences, symposia, workshops, special sessions). Each Event may run over any span of time within the conference dates (from half-day to three days). Since 2012, Proceedings of the FedCSIS conference are indexed in the Web of Science and other indexing services.

  • 2017 Federated Conference on Computer Science and Information Systems (FedCSIS)

    The FedCSIS Multiconference consists of Events (conferences, symposia, workshops, special sessions). Each Event may run over any span of time within the conference dates (from half-day to three days). The FedCSIS Events provide a platform for bringing together researchers, practitioners, and academia to present and discuss ideas, challenges and potential solutions on established or emerging topics related to research and practice in computer science and information systems. Since 2012, Proceedings of the FedCSIS conference are indexed in the Thomson Reuters Web of Science.

  • 2016 Federated Conference on Computer Science and Information Systems (FedCSIS)

    The FedCSIS Multiconference consists of Events (conferences, symposia, workshops, special sessions). Each Event may run over any span of time within the conference dates (from half-day to three days). The FedCSIS Events provide a platform for bringing together researchers, practitioners, and academia to present and discuss ideas, challenges and potential solutions on established or emerging topics related to research and practice in computer science and information systems. Since 2012, Proceedings of the FedCSIS conference are indexed in the Thomson Reuters Web of Science.

  • 2015 Federated Conference on Computer Science and Information Systems (FedCSIS)

    The FedCSIS Multiconference consists of Events (conferences, symposia, workshops, special sessions). Each Event may run over any span of time within the conference dates (from half-day to three days). The FedCSIS Events provide a platform for bringing together researchers, practitioners, and academia to present and discuss ideas, challenges and potential solutions on established or emerging topics related to research and practice in computer science and information systems.

  • 2014 Federated Conference on Computer Science and Information Systems (FedCSIS)

    The FedCSIS Multiconference consists of Events (conferences, symposia, workshops, special sessions). Each Event may run over any span of time within the conference dates (from half-day to three days). The FedCSIS Events provide a platform for bringing together researchers, practitioners, and academia to present and discuss ideas, challenges and potential solutions on established or emerging topics related to research and practice in computer science and information systems.

  • 2013 Federated Conference on Computer Science and Information Systems (FedCSIS)

    FedCSIS Multiconference consists of Events (conferences, symposia, workshops, special sessions) that provide a platform for bringing together researchers, practitioners, and academia to present and discuss ideas, challenges and potential solutions on topics related to research and practice in CS/IS.

  • 2012 Federated Conference on Computer Science and Information Systems (FedCSIS)

    Continuation of FedCSIS 2011, scope depends on the scopes of individual events that FedCSIS consists of.

  • 2011 Federated Conference on Computer Science and Information Systems (FedCSIS)


More Conferences

Periodicals related to Dynamic programming

Back to Top

Aerospace and Electronic Systems Magazine, IEEE

The IEEE Aerospace and Electronic Systems Magazine publishes articles concerned with the various aspects of systems for space, air, ocean, or ground environments.


Antennas and Wireless Propagation Letters, IEEE

IEEE Antennas and Wireless Propagation Letters (AWP Letters) will be devoted to the rapid electronic publication of short manuscripts in the technical areas of Antennas and Wireless Propagation.


Applied Superconductivity, IEEE Transactions on

Contains articles on the applications and other relevant technology. Electronic applications include analog and digital circuits employing thin films and active devices such as Josephson junctions. Power applications include magnet design as well asmotors, generators, and power transmission


Audio, Speech, and Language Processing, IEEE Transactions on

Speech analysis, synthesis, coding speech recognition, speaker recognition, language modeling, speech production and perception, speech enhancement. In audio, transducers, room acoustics, active sound control, human audition, analysis/synthesis/coding of music, and consumer audio. (8) (IEEE Guide for Authors) The scope for the proposed transactions includes SPEECH PROCESSING - Transmission and storage of Speech signals; speech coding; speech enhancement and noise reduction; ...


Automatic Control, IEEE Transactions on

The theory, design and application of Control Systems. It shall encompass components, and the integration of these components, as are necessary for the construction of such systems. The word `systems' as used herein shall be interpreted to include physical, biological, organizational and other entities and combinations thereof, which can be represented through a mathematical symbolism. The Field of Interest: shall ...


More Periodicals

Most published Xplore authors for Dynamic programming

Back to Top

Xplore Articles related to Dynamic programming

Back to Top

Optimal Sequence Detection and Optimal Symbol-by-Symbol Detection: Similar Algorithms

[{u'author_order': 1, u'affiliation': u'McGill University, Montreal, P.Q., Canada', u'full_name': u'J. Hayes'}, {u'author_order': 2, u'full_name': u'T. Cover'}, {u'author_order': 3, u'full_name': u'J. Riera'}] IEEE Transactions on Communications, 1982

An algorithm is derived which performs optimal symbol-by-symbol detection of a pulse amplitude modulated sequence. The algorithm is similar to the Viterbi algorithm with the optimality criterion optimal symbol detection rather than optimal sequence detection. A salient common feature is the merge phenomenon which allows common decisions to be made before the entire sequence is received.


An optimized algorithm of high spatial-temporal efficiency for Megablast

[{u'author_order': 1, u'affiliation': u'Inst. of Comput. Technol., Chinese Acad. of Sci., Beijing, China', u'full_name': u'Guangming Tan'}, {u'author_order': 2, u'affiliation': u'Inst. of Comput. Technol., Chinese Acad. of Sci., Beijing, China', u'full_name': u'Lin Xu'}, {u'author_order': 3, u'affiliation': u'Inst. of Comput. Technol., Chinese Acad. of Sci., Beijing, China', u'full_name': u'Yishan Jiao'}, {u'author_order': 4, u'affiliation': u'Inst. of Comput. Technol., Chinese Acad. of Sci., Beijing, China', u'full_name': u'Shengzhong Feng'}, {u'author_order': 5, u'affiliation': u'Inst. of Comput. Technol., Chinese Acad. of Sci., Beijing, China', u'full_name': u'Dongbo Bu'}, {u'author_order': 6, u'affiliation': u'Inst. of Comput. Technol., Chinese Acad. of Sci., Beijing, China', u'full_name': u'Ninghui Sun'}] 11th International Conference on Parallel and Distributed Systems (ICPADS'05), None

BLAST (basic local alignment search tool), as a heuristic algorithm, is one of the most widely used sequence similarity search tools. MegaBlast, as an improved version of BLAST, speeds up the searches and improves the total throughput owing to greedy algorithm and batch processing. However, MegaBlast consumes a great deal of memory, which is proportional to the product of the ...


Power Control for Uplink Transmission With Mobile Users

[{u'author_order': 1, u'affiliation': u'Department of Information Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong, SAR', u'full_name': u'Zhou Kenan'}, {u'author_order': 2, u'affiliation': u'Department of Information Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong, SAR', u'full_name': u'Tat Ming Lok'}] IEEE Transactions on Vehicular Technology, 2011

In this paper, we introduce an uplink transmission model with mobile users, where each user maximizes his/her utility to achieve the best performance. We propose a power allocation scheme for each mobile user when all channel information is available. Moreover, we illustrate that one user would expect to predict the aggregate interference to maximize the utility when the channel information ...


Lagrangian relaxation neural networks for job shop scheduling

[{u'author_order': 1, u'affiliation': u'Dept. of Electr. & Syst. Eng., Connecticut Univ., Storrs, CT, USA', u'full_name': u'P. B. Luh'}, {u'author_order': 2, u'full_name': u'Xing Zhao'}, {u'author_order': 3, u'full_name': u'Yajun Wang'}, {u'author_order': 4, u'full_name': u'L. S. Thakur'}] IEEE Transactions on Robotics and Automation, 2000

Manufacturing scheduling is an important but difficult task. In order to effectively solve such combinatorial optimization problems, the paper presents a Lagrangian relaxation neural network (LRNN) for separable optimization problems by combining recurrent neural network optimization ideas with Lagrangian relaxation (LR) for constraint handling. The convergence of the network is proved, and a general framework for neural implementation is established, ...


Efficient worst case timing analysis of data caching

[{u'author_order': 1, u'affiliation': u'Dept. of Comput. Eng., Seoul Nat. Univ., South Korea', u'full_name': u'Sung-Kwan Kim'}, {u'author_order': 2, u'affiliation': u'Dept. of Comput. Eng., Seoul Nat. Univ., South Korea', u'full_name': u'Sang Lyul Min'}, {u'author_order': 3, u'full_name': u'Rhan Ha'}] Proceedings Real-Time Technology and Applications, None

Recent progress in worst case timing analysis of programs has made it possible to perform accurate timing analysis of pipelined execution and instruction caching. However there has not been much progress in worst case timing analysis of data caching. This is mainly due to load/store instructions that reference multiple memory locations such as those used to implement array and pointer ...


More Xplore Articles

Educational Resources on Dynamic programming

Back to Top

eLearning

No eLearning Articles are currently tagged "Dynamic programming"

IEEE-USA E-Books

  • Approximate Dynamic Programming for Optimizing Oil Production

  • Semi¿¿¿Global Adaptive Dynamic Programming

    This chapter explores the adaptive dynamic programming (ADP) methods to handle affine nonlinear systems via neural network¿¿¿based approximation. An online learning method with convergence analysis is provided and it achieves semi¿¿¿global stabilization for nonlinear systems in that the domain of attraction can be made arbitrarily large, but bounded, by tuning the controller parameters or design functions. Two most frequently used techniques in reinforcement learning are value iteration and policy iteration. When the system dynamics are uncertain, the approximation can be realized using online information via reinforcement learning and ADP methods. Neural network¿¿¿based ADP methods for nonlinear control systems are being actively developed by a good number of researchers. Some recent theoretical results include ADP for non¿¿¿affine nonlinear systems, ADP for saturated control design, ADP for nonlinear games, and ADP for nonlinear tracking problems.

  • Global Adaptive Dynamic Programming for Nonlinear Polynomial Systems

    This chapter brings more advanced optimization techniques, such as semidefinite programming (SDP) and sum¿¿¿of¿¿¿squares (SOS) programming, into adaptive dynamic programming (ADP) design. The goal is to achieve adaptive suboptimal online learning and, at the same time, maintain global asymptotic stability of the closed¿¿¿loop system. The chapter considers an auxiliary optimization problem, which helps to obtain a suboptimal solution to the minimization problem, and develops a policy iteration method for polynomial systems using SOS¿¿¿based methods. The chapter also develops an online learning method based on the idea of ADP to implement the iterative scheme with real¿¿¿time data, instead of identifying the system dynamics. Finally, it extends the proposed global ADP method to deal with an enlarged class of nonlinear systems, and covers the numerical simulation for four different examples.

  • Robust Adaptive Dynamic Programming

    This chapter introduces a new concept of robust adaptive dynamic programming (RADP), a natural extension of ADP to uncertain dynamic systems. It presents an online learning strategy for the design of robust adaptive suboptimal controllers that globally asymptotically stabilize the system. The chapter introduces the robust redesign technique to achieve RADP for nonlinear systems. To begin with, it considers the nonlinear system with dynamic uncertainties. The RADP methodologies can be viewed as natural extensions of ADP to dynamically perturbed uncertain systems. The RADP framework decomposes the uncertain environment into two parts: the reduced¿¿¿order system (ideal environment) with known system order and fully accessible state, and the dynamic uncertainties, with unknown system order and dynamics, interacting with the ideal environment. The presence of dynamic uncertainty gives rise to interconnected systems for which the controller design and robustness analysis become technically challenging.

  • Robust Adaptive Dynamic Programming for Large¿¿¿Scale Systems

    This chapter explains the robust adaptive dynamic programming (RADP) theory for the decentralized optimal control of a generalized class of large¿¿¿scale systems. The controller design of each subsystem only utilizes local state variables, without knowing the system dynamics. By integrating a simple version of the cyclic¿¿¿small¿¿¿gain theorem, asymptotic stability can be achieved by assigning appropriate weighting matrices for each subsystem. As a by¿¿¿product, certain suboptimality properties can be obtained. The chapter describes the class of large¿¿¿scale uncertain systems to be studied. Then, an RADP¿¿¿based decentralized optimal controller design scheme is presented. It is also shown that the closed¿¿¿loop interconnected system enjoys some suboptimality properties. In addition, the effectiveness of the proposed methodology is demonstrated via its application to the online learning control of a ten¿¿¿machine power system with governor controllers.

  • Introduction

    This chapter presents an overview of key concepts covered in this book. The book studies adaptive dynamic programming (ADP) for uncertain linear systems, of which the only a priori knowledge is an initial, stabilizing static state¿¿¿feedback control policy. Two ADP methods, on¿¿¿policy learning and off¿¿¿policy learning, are introduced to achieve online implementation of conventional policy iteration. The book then focuses on the theory of global ADP (GADP). It aims at simultaneously improving the closed¿¿¿loop system performance and achieving global asymptotic stability of the overall system at the origin. The book also applies the robust ADP (RADP) framework to solve the decentralized optimal control problem for a class of large¿¿¿scale uncertain systems, and studies sensorimotor control with static and dynamic uncertainties under the framework of RADP.

  • Tools for Tree Searches: Dynamic Programming

    This chapter contains sections titled: Introduction Top‐Down Approach Bottom‐Up Approach Automata Theory and Dynamic Programming Parallel Algorithms Dynamic Programming Heuristics Conclusions References

  • Robust Adaptive Dynamic Programming as A Theory of Sensorimotor Control

    Many tasks that humans perform in our everyday life involve different sources of uncertainties. However, it is interesting and surprising to notice how the central nervous system (CNS) can gracefully coordinate our movements to deal with these uncertainties. This chapter studies sensorimotor control with static and dynamic uncertainties under the framework of robust adaptive dynamic programming (RADP). The linear version of RADP is extended for stochastic systems by taking into account signal¿¿¿dependent noise, and the proposed method is applied to study the sensorimotor control problem with both static and dynamic uncertainties. Results presented in the chapter suggest that the CNS may use RADP¿¿¿like learning strategy to coordinate movements and to achieve successful adaptation in the presence of static and/or dynamic uncertainties. In the absence of dynamic uncertainties, the learning strategy reduces to an ADP¿¿¿like mechanism.

  • Adaptive Dynamic Programming for Uncertain Linear Systems

    This chapter presents a reinforcement learning¿¿¿inspired adaptive dynamic programming (ADP) approach for finding a new class of online adaptive optimal controllers for uncertain linear systems. Comparing the on¿¿¿policy and the off¿¿¿policy learning strategies, it can be seen that the former spreads the computational burden into different iteration time points, at the price of a longer learning process. The latter can achieve faster learning by making full use of the online measurements, at the expense of heavier computational efforts at a single iteration time point. The chapter uses two examples to validate, through numerical simulations, the effectiveness of the proposed algorithms. The first example is created using Simulink Version 8.5 (R2015a). It illustrates how the on¿¿¿policy learning can be applied to a third¿¿¿order linear system. The second example is implemented in MATLAB scripts. It applies the off¿¿¿policy learning strategy to design an approximate optimal feedback control policy for a diesel engine.

  • Solving the KCT Problem: Large‐Scale Neighborhood Search and Solution Merging

    This chapter contains sections titled: Introduction Hybrid Algorithms for the KCT Problem Experimental Analysis Conclusions References



Standards related to Dynamic programming

Back to Top

(Replaced) IEEE Standard VHDL Language Reference Manual

his standard revises and enhances the VHDL language reference manual (LRM) by including a standard C language interface specification; specifications from previously separate, but related, standards IEEE Std 1164 -1993,1 IEEE Std 1076.2 -1996, and IEEE Std 1076.3-1997; and general language enhancements in the areas of design and verification of electronic systems.



Jobs related to Dynamic programming

Back to Top