控制科学与工程系

杨永亮

副教授

单      位:控制科学与工程系
职      务:学院外事秘书
职      称:副教授
所在梯队:复杂系统控制与建模
通信地址: 北京市海淀区学院路30号北京科技大学自动化学院
邮      编:100083
电子邮件:yangyongliang@ustb.edu.cn
社会职务:IEEE Transactions on Neural Networks and Learning Systems期刊副主编;中国自动化学会自适应动态规划与强化学习专业委员会委员;中国人工智能学会智能控制与智能管理专业委员会委员;IEEE计算智能专业委员会会员

  • 教育背景
  • 工作履历
  • 研究方向
  • 主讲课程
  • 代表性论著
  • 代表性项目
  • 成果、荣誉
  • 发明专利

2011年至2018年,北京科技大学,自动化学院,博士

2007年至2011年,河北大学,电气信息工程学院,学士


20151月至20171月,美国密苏里科技大学,电气与计算机工程系,访问学者

20182月至201912月,北京科技大学,博士后

20201月,北京科技大学,自动化学院,控制系,讲师

20207月,北京科技大学,自动化学院,控制系,副教授

20208月至20218月,澳门大学,访问学者


²  无人驾驶与人机交互

²  强化学习与自适应动态规划

²  多智能体系统分布式学习、优化与控制



本科生课程:

1)    《智能机器人控制》

2)    《控制系统仿真》

3)    《工业组态软件》

4)    《智能控制理论基础》

研究生课程:

1)    《机器人学》


代表性论文

专著

1.       杨永亮基于强化学习的数据驱动优化控制方法[M]. 科学出版社, 2022.中国博士后科学基金优秀学术专著出版资助ISBN: 978-7-03-072869-2

期刊文章

1.       Yongliang Yang*, Hamidreza Modares, Kyriakos G. Vamvoudakis, Frank L. Lewis. Cooperative Finitely Excited Learning for Dynamical Games, IEEE Transactions on Cybernetics, doi: 10.1109/TCYB.2023.3274908, to appear, 2023.

2.       Yongliang Yang, Yongping Pan*, Cheng-Zhong Xu, Donald C. Wunsch. Hamiltonian-Driven Adaptive Dynamic Programming with Efficient Experience Replay[J]. IEEE Transactions on Neural Networks and Learning Systemsdoi: 10.1109/TNNLS.2022.3213566 , to appear, 2022.

3.       Yongliang Yang, Bahare Kiumarsi, Hamidreza Modares, Cheng-Zhong Xu*. Model-Free λ-Policy Iteration for Discrete-Time Linear Quadratic Regulation[J]. IEEE Transactions on Neural Networks and Learning Systems, vol. 34, no. 2, pp. 635-649, 2023.

4.       Rui Wang, Liqiang Tang, Yongliang Yang*, Shuo Wang, Min Tan, Cheng-Zhong Xu. Adaptive Trajectory Tracking Control with Novel Heading Angle and Velocity Compensation for Autonomous Underwater Vehicles[J]. IEEE Transactions on Intelligent Vehicles, vol. 8, no. 3, pp. 2135 - 2147, 2023.

5.       Yongliang Yang, Weinan Gao, Hamidreza Modares, Cheng-Zhong Xu*. Robust Actor-Critic Learning for Continuous-Time Nonlinear Systems with Unmodeled Dynamics[J]. IEEE Transactions on Fuzzy Systemsvol. 30, no. 6, pp. 2101-2112, 2022. (ESI热点)

6.       Yongliang Yang, Cheng-Zhong Xu*. Adaptive fuzzy Leader-Follower Synchronization of Constrained Heterogeneous Multiagent Systems[J]. IEEE Transactions on Fuzzy Systemsvol. 30, no. 1, pp. 205-219, 2022. (ESI高被引)

7.       Yongliang Yang, Hamidreza Modares, Kyriakos G Vamvoudakis, Wei He, Cheng-Zhong Xu*, Donald C Wunsch. Hamiltonian-Driven Adaptive Dynamic Programming with Approximation Errors[J]. IEEE Transactions on Cybernetics, vol. 52, no. 12, pp. 13762-13773, 2022.

8.       Yongliang Yang, Zihao Ding, Rui Wang*, Hamidreza Modares, Donald C Wunsch. Data-Driven Human-Robot Interaction without Velocity Measurement Using Off-Policy Reinforcement Learning[J]. IEEE/CAA Journal of Automatica Sinicavol. 9, no. 1, pp. 47-63, 2022.

9.       Yongliang Yang, Liqiang Tang, Wencheng Zou, Jian Guo, Choon Ki Ahn. Dynamic Event-Triggered Design with Fixed-Time Performance and Input Dead-Zone[J]. IEEE Transactions on Circuits and Systems II: Express Briefs, vol. 69, no. 11, pp. 4344-4348, 2022.

10.    Majid Mazouchi, Yongliang Yang, Hamidreza Modares*. Data-Driven Dynamic Multiobjective Optimal Control: An Aspiration-Satisfying Reinforcement Learning Approach[J]. IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 11, pp. 6183-6193, 2022.

11.    Yongliang Yang*, Kyriakos G Vamvoudakis, Hamidreza Modares, Yixin Yin, Donald C Wunsch. Hamiltonian-Driven Hybrid Adaptive Dynamic Programming[J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 51, no. 10, pp. 6423-6434, 2021(ESI高被引)

12.    Yongliang Yang, Zhijie Liu*, Qing Li, Donald C Wunsch. Output Constrained Adaptive Controller Design for Nonlinear Saturation Systems[J]. IEEE/CAA Journal of Automatica Sinica, vol. 8, no. 2, pp. 441-454, 2021.

13.    Yongliang Yang*, Kyriakos G Vamvoudakis, Hamidreza Modares, Yixin Yin, Donald C Wunsch. Safe Intermittent Reinforcement Learning with Static and Dynamic Event Generators[J]. IEEE Transactions on Neural Networks and Learning Systems, vol. 31, no. 12, pp. 5441-5455, 2020.

14.    Yongliang Yang*, Hamidreza Modares, Kyriakos G Vamvoudakis, Yixin Yin, Donald C Wunsch. Dynamic Intermittent Feedback Design for H-infinity Containment Control on a Directed Graph[J]. IEEE Transactions on Cybernetics, vol. 50, no. 8, pp. 3752-3765, 2020.

15.    Yongliang Yang, Zhishan Guo, Haoyi Xiong, Da-Wei Ding*, Yixin Yin, Donald C Wunsch. Data-Driven Robust Control of Discrete-Time Uncertain Linear Systems via Off-Policy Reinforcement Learning[J]. IEEE Transactions on Neural Networks and Learning Systems, vol. 30, no. 12, pp. 3735-3747, 2019.

16.    Yongliang Yang, Hamidreza Modares, Donald C Wunsch, Yixin Yin*. Optimal Containment Control of Unknown Heterogeneous Systems with Active Leaders[J]. IEEE Transactions on Control Systems Technology, vol. 27, no. 3, pp. 1228-1236, 2019.

17.    Yongliang Yang*, Hamidreza Modares, Donald C. Wunsch, Yixin Yin. Leader-Follower Output Synchronization of Linear Heterogeneous Systems with Active Leader Using Reinforcement Learning[J]. IEEE Transactions on Neural Networks and Learning Systems, vol, 29, no. 6, pp. 2139–2153, 2018.

18.    Yongliang Yang*, Donald Wunsch, Yixin Yin. Hamiltonian-Driven Adaptive Dynamic Programming for Continuous Nonlinear Dynamical Systems[J]. IEEE Transactions on Neural Networks and Learning Systems, vol. 28, no. 8, pp. 1929-1940, 2017.

19.    Yongliang Yang, Liqiang Tang, Wencheng Zou, Da-Wei Ding, Choon Ki Ahn*. A Unified Fixed-time Framework of Adaptive Fuzzy Controller Design for Unmodeled Dynamical Systems with Intermittent Feedback[J]. Information Sciences, vol. 611, pp. 628-648, 2022.

20.    Yongliang Yang, Hufei Zhu, Qichao Zhang, Bo Zhao*, Zhenning Li, Donald C Wunsch. Sparse Online Kernelized Actor-Critic Learning in Reproducing Kernel Hilbert Space[J]. Artificial Intelligence Reviewvol. 55, no. 1, pp. 23-58, 2022.

21.    Yongliang Yang, Liqiang Tang, Wencheng Zou, Choon Ki Ahn*. Novel command-filtered Nussbaum design for continous-time nonlinear dynamical systems with multiple unknown high-frequency gains[J]. Nonlinear Dynamics, doi: vol. 111, pp. 4313–4323, 2023.

22.    Yongliang Yang, Da-Wei Ding*, Haoyi Xiong, Yixin Yin, Donald C Wunsch. Online Barrier-Actor-Critic Learning for H-infinity Control with Full-State Constraints and Input Saturation[J]. Journal of the Franklin Institute, vol. 357, no. 6, pp. 3316-3344, 2020.

23.    Yongliang Yang, Zhijie Liu*, Haoyi Xiong, Yixin Yin. Adaptive Singularity-Free Controller Design of Constrained Nonlinear Systems with Prescribed Performance[J]. Neurocomputing, vol. 417, pp. 212-223, 2020.

24.    Liqiang Tang, Yongliang Yang*, Wencheng Zou, Ruizhuo Song. Neuro-adaptive fixed-time control with novel command filter design for nonlinear systems with input dead-zone[J]. Neurocomputing, vol. 511, pp. 308-318, 2022.

25.    Guilong Liu, Yongliang Yang*, Da-Wei Ding, Qing Li. Adaptive event-based fixedtime tracking design for strict-feedback nonlinear systems with unknown control coefficients, Neurocomputing, vol. 541, pp. 126278, 2023.

26.    Yongliang Yang, Liqiang Tang, Wencheng Zou*, Da-Wei Ding. Robust Adaptive Control of Uncertain Nonlinear Systems with Unmodeled Dynamics Using Command Filter[J]. International Journal of Robust and Nonlinear Control, vol. 31, no. 16, pp. 7764-7784, 2021.

27.    Yongliang Yang, Majid Mazouchi, Hamidreza Modares*. Hamiltonian-Driven Adaptive Dynamic Programming for Mixed H2/H-infinity Performance Using Sum-of-Squares[J]. International Journal of Robust and Nonlinear Control, vol. 31, no. 6, pp. 1941-1963, 2021.

28.    Yongliang Yang*, Kyriakos G Vamvoudakis, Hamidreza Modares. Safe Reinforcement Learning for Dynamical Games[J]. International Journal of Robust and Nonlinear Control, vol. 30, no. 9, pp. 3706-3726, 2020.

29.    Yongliang Yang*, Kyriakos G Vamvoudakis, Henrique Ferraz, Hamidreza Modares. Dynamic Intermittent Q-Learning-Based Model-Free Suboptimal Co-Design of L2-Stabilization[J]. International Journal of Robust and Nonlinear Control, vol. 29, no. 9, pp. 2673-2694, 2019.

30.    Yongliang Yang, Yixin Yin*, Donald Wunsch, Sen Zhang, Xianzhong Chen, Xiaoli Li, Shusen Cheng, Min Wu, Kang-Zhi Liu. Development of Blast Furnace Burden Distribution Process Modeling and Control[J]. ISIJ International, vol. 57, no. 8, pp. 1350-1363, 2017.


 

会议文章

1.       Liqiang Tang, Yongliang Yang*, Da-Wei Ding, Cheng-Zhong Xu. Adaptive Constrained Control of Nonlinear Systems with Time-Varying Delays and Unknown Control Directions[C]. Proceedings of the 41th Chinese Control Conference (CCC2022), pp. 2315-2320, July 25-27, 2022, Hefei, China.

2.       Liqiang Tang, Yongliang Yang*, Yixin Yin, Wencheng Zou. Command Filtered Control for Time-Delay Systems with Asymmetric Full State Constraints[C]. 2021 China Automation Congress (CAC), pp. 6008-6013, October 22-24, 2021, Beijing, China.

3.       Liqiang Tang, Hufei Zhu, Yongliang Yang*, Wencheng Zou, Cheng-Zhong Xu, Yixin Yin. Output Feedback Design with Dynamic Surface for Nonlinear Systems with Unmodeled Dynamics[C]. Proceedings of the 40th Chinese Control Conference (CCC2021), pp. 2239-2244, July 26-28, 2021, Shanghai, China.

4.       Yongliang Yang*, Hamidreza Modares, Kyriakos G Vamvoudakis, Cheng-Zhong Xu. Optimal Recursive Backstepping for Nonlinear Systems in a Strict-Feedback Form with Continuous and Intermittent Updates[C]. 59th IEEE Conference on Decision and Control (CDC2020), pp. 6216-6221, December 14-18, 2020, Jeju Island, Republic of Korea.

5.       Yongliang Yang*, Majid Mazouchi, Hamidreza Modares. Data-Driven Solutions to Mixed  Control: A Hamilton-Inequality-Driven Reinforcement Learning Approach[C]. 2020 IEEE Conference on Control Technology and Applications (CCTA2020), pp. 340-345, August 24-26, 2020. Montréal, Canada.

6.       Ailiang Xing*, Yongliang Yang, Bo Zhao, Da-Wei Ding, Yixin Yin. Observer-Based Adaptive Controller Design for Nonlinear Saturation Systems with Output Constraints[C]. 3rd IFAC Workshop on Cyber-Physical & Human Systems (CPHS2020), pp. 675-680, December 3-5, 2020, Beijing, China.

7.       Majid Mazouchi*, Yongliang Yang, Hamidreza Modares. Data-Driven Dynamic Multi-Objective Optimal Control: A Hamiltonian-Inequality Driven Satisficing Reinforcement Learning Approach[C]. IFAC World Congress 2020 (IFAC2020), pp. 8070-8075, July 11-17, 2020. Berlin, Germany.

8.       Yongliang Yang, Kyriakos G Vamvoudakis, Hamidreza Modares, Wei He*, Yixin Yin, Donald C Wunsch. Safe Intermittent Reinforcement Learning for Nonlinear Systems[C]. 58th IEEE Conference on Decision and Control (CDC2019), pp. 690-697, December 11-13, 2019. Nice, France.

9.       Lu Li, Liming Wang, Yongliang Yang*, Jie Dong, Yixin Yin, Shusen Cheng. Model-Free Solution to the Discrete-Time Coupled Riccati Equation Using Off-Policy Reinforcement Learning[C]. Proceedings of the 38th Chinese Control Conference (CCC2019), pp. 6813-6818, July 27-30, 2019, Guangzhou, China.

10.    Liming Wang*, Yongliang Yang, Dawei Ding, Yixin Yin, Zhishan Guo, Donald C Wunsch. Model-Free Temporal Difference Learning for Non-Zero-Sum Games[C]. 2019 International Joint Conference on Neural Networks (IJCNN2019), pp. 1-6, July 14-19, 2019, Budapest, Hungary.

11.    Yongliang Yang*, Yixin Yin, Wei He, Kyriakos G Vamvoudakis, Hamidreza Modares, Donald C Wunsch. Safety-Aware Reinforcement Learning Framework with an Actor-Critic-Barrier Structure[C]. 2019 American Control Conference (ACC2019), pp. 2352-2358, July 10-12, 2019, Philadelphia, PA, USA.

12.    Yongliang Yang*, Kyriakos G Vamvoudakis, Henrique Ferraz, Hamidreza Modares. Dynamic Intermittent Q-Learning for Systems with Reduced Bandwidth[C]. 57th IEEE Conference on Decision and Control (CDC2018), pp. 924-931, December 17-19, 2018, Miami, FL, USA.

13.    Yongliang Yang*, Kyriakos G Vamvoudakis, Hamidreza Modares, Dawei Ding, Yixin Yin, Donald C Wunsch. Dynamic Intermittent Suboptimal Control: Performance Quantification and Comparisons[C]. Proceedings of the 37th Chinese Control Conference (CCC2018), pp. 2017-2022, July 25-27, 2018, Wuhan, China.

14.    Yongliang Yang*, Xianzhong Chen, Yixin Yin, Donald C Wunsch. Off-Policy Integral Reinforcement Learning for Semi-Global Constrained Output Regulation of Continuous-Time Linear Systems[C]. 2018 International Joint Conference on Neural Networks (IJCNN2018), pp. 1-6, July 8-13, 2018, Rio de Janeiro, Brazil.

15.    Yongliang Yang*, Hamidreza Modares, Kyriakos G Vamvoudakis, Yixin Yin, Donald C Wunsch. Model-Free Event-Triggered Containment Control of Multi-Agent Systems[C]. 2018 American Control Conference (ACC2018), pp.877-884, June 27-29, 2018, Milwaukee, WI, USA.

16.    Yongliang Yang*, Dawei Ding, Yixin Yin, Donald C Wunsch. Model-Free Semi-Global Output Regulation for Discrete-Time Linear Systems Subject to Input Amplitude Saturation[C]. 33rd Youth Academic Annual Conference of Chinese Association of Automation (YAC2018), pp. 150-155, May 18-20, 2018, Nanjing, China.

17.    Yongliang Yang*, Ruizhuo Song, Yixin Yin, Donald C Wunsch, Hamidreza Modares. Containment Control of Heterogeneous Systems with Active Leaders of Bounded Unknown Control Using Reinforcement Learning[C]. 2017 IEEE Symposium Series on Computational Intelligence (SSCI2017), pp. 1-7, Nov 27-Dec 01, 2017, Honolulu, HI, USA.

18.    Yongliang Yang*, Zhishan Guo, Donald Wunsch, Yixin Yin. Off-Policy Reinforcement Learning for Robust Control of Discrete-Time Uncertain Linear Systems[C]. Proceedings of the 36th Chinese Control Conference (CCC2017), pp. 2507-2512, July 26-28, 2017, Dalian, China.

19.    Yongliang Yang*, Donald Wunsch, Yixin Yin. Hamiltonian-Driven Adaptive Dynamic Programming for Nonlinear Discrete-Time Dynamic Systems[C]. 2017 International Joint Conference on Neural Networks (IJCNN2017), pp. 1339-1346, May 14-19, 2017, Anchorage, AK, USA.

20.    Yongliang Yang*, Donald Wunsch, Zhishan Guo, Yixin Yin. Hamiltonian-Driven Adaptive Dynamic Programming Based on Extreme Learning Machine[C]. 14th International Symposium on Neural Networks (ISNN2017), pp. 197-205, June 21-26, 2017, Sapporo, Japan.



主持项目

1.国家自然科学基金面上项目62373039,主持

2.京津冀合作专项项目J210005,主持

3.澳门大学濠江学者人才计划UMMTP-2019-02,主持

4.国家自然科学基金青年项目61903028,主持

5.中国博士后科学基金优秀学术专著出版资助,主持

6.中国博士后科学基金面上项目2018M641197,主持

7.中央高校基本科研业务费FRF-TP-18-031A1,主持 


 科研奖励

1.     杨永亮欧盟玛丽居里学者计划,2023.02

2.     杨永亮澳门濠江学者计划,2020.01

3.    杨永亮中国人工智能学会优秀博士学位论文奖,2019.11

4.    杨永亮北京科技大学优秀博士后,2019.12

5.    杨永亮北京市优秀毕业生,2018.01

6.    杨永亮北京科技大学优秀博士学位论文,2018.01

教学荣誉

1.     杨永亮北京科技大学第十八届“校长奖章”优秀指导教师,2023.06

2.     杨永亮北京科技大学优秀硕士学位论文指导教师,2023.06

3.     杨永亮北京科技大学第十八届“十佳学术之星”优秀指导教师,2023.01


4.     杨永亮北京科技大学第九届“研师亦友--我最喜爱的导师”提名,2023.06