×

Bilateral telerobotic system using type-2 fuzzy neural network based moving horizon estimation force observer for enhancement of environmental force compliance and human perception. (English) Zbl 1429.93252

Summary: This paper firstly develops a novel force observer using type-2 fuzzy neural network (T2FNN)-based moving horizon estimation (MHE) to estimate external force/torque information and simultaneously filter out the system disturbances. Then, by using the proposed force observer, a new bilateral teleoperation system is proposed that allows the slave industrial robot to be more compliant to the environment and enhances the situational awareness of the human operator by providing multi-level force feedback. Compared with existing force observer algorithms that highly rely on knowing exact mathematical models, the proposed force estimation strategy can derive more accurate external force/torque information of the robots with complex mechanism and with unknown dynamics. Applying the estimated force information, an external-force-regulated sliding mode control (SMC) strategy with the support of machine vision is proposed to enhance the adaptability of the slave robot and the perception of the operator about various scenarios by virtue of the detected location of the task object. The proposed control system is validated by the experiment platform consisting of a universal robot (UR10), a haptic device and an RGB-D sensor.

MSC:

93C85 Automated systems (robots, etc.) in control theory
93C42 Fuzzy control/observation systems
93B12 Variable structure systems

Software:

PCL
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Agarwal, V.; Parthasarathy, H., Disturbance estimator as a state observer with extended kalman filter for robotic manipulator, Nonlinear Dynamics, 85, 4, 2809-2825 (2016) · Zbl 1349.93280
[2] Ahn, H. S., Synchronization of bilateral teleoperation systems using state and force observer, (Control automation and systems (ICCAS), 2010 international conference on (2010), IEEE), 1362-1365
[3] Amini, H.; Farzaneh, B.; Azimifar, F.; Sarhan, A. A.D., Sensor-less force-reflecting macro – micro telemanipulation systems by piezoelectric actuators, ISA Transactions, 64, 293-302 (2016)
[4] Aziminejad, A.; Tavakoli, M.; Patel, R. V.; Moallem, M., Transparent time-delayed bilateral teleoperation using wave variables, IEEE Transactions on Control Systems Technology, 16, 3, 548-555 (2008)
[5] Chan, L.; Naghdy, F.; Stirling, D., Extended active observer for force estimation and disturbance rejection of robotic manipulators, Robotics and Autonomous Systems, 61, 12, 1277-1287 (2013)
[6] Chan, L.; Naghdy, F.; Stirling, D., Position and force tracking for non-linear haptic telemanipulator under varying delays with an improved extended active observer, Robotics and Autonomous Systems, 75, 145-160 (2016)
[7] Chan, L.; Naghdy, F.; Stirling, D., An improved extended active observer for adaptive control of a n \(-\) DOF robot manipulator, Journal of Intelligent and Robotic Systems, 85, 3-4, 679-692 (2017)
[8] Chan, L.; Naghdy, F.; Stirling, D.; Field, M., Nonlinear bilateral teleoperation using extended active observer for force estimation and disturbance suppression, Robotica, 33, 1, 61-86 (2015)
[9] Chawda, V.; O’Malley, M. K., Position synchronization in bilateral teleoperation under time-varying communication delays, IEEE/ASME Transactions on Mechatronics, 20, 1, 245-253 (2015)
[10] Daly, J. M.; Wang, D. W., Time-delayed bilateral teleoperation with force estimation for n-DOF nonlinear robot manipulators, (Intelligent robots and systems (IROS), 2010 IEEE/RSJ international conference on (2010), IEEE), 3911-3918
[11] Daly, J. M.; Wang, D. W., Time-delayed output feedback bilateral teleoperation with force estimation for \(n\)-Dof nonlinear manipulators, IEEE Transactions on Control Systems Technology, 22, 1, 299-306 (2014)
[12] Feng, G., A survey on analysis and design of model-based fuzzy control systems, IEEE Transactions on Fuzzy systems, 14, 5, 676-697 (2006)
[13] Forouzantabar, A.; Talebi, H. A.; Sedigh, A. K., Bilateral control of master – slave manipulators with constant time delay, ISA Transactions, 51, 1, 74-80 (2012)
[14] Ghorbanian, A.; Rezaei, S. M.; Khoogar, A. R.; Zareinejad, M.; Baghestan, K., A novel control framework for nonlinear time-delayed dual-master/single-slave teleoperation, ISA Transactions, 52, 2, 268-277 (2013)
[15] Gustafson, D. E.; Kessel, W. C., Fuzzy clustering with a fuzzy covariance matrix, (Decision and control including the 17th symposium on adaptive processes, 1978 IEEE conference on (1979), IEEE), 761-766
[16] Hashtrudi-Zaad, K.; Salcudean, S. E., Transparency in time-delayed systems and the effect of local force feedback for transparent teleoperation, IEEE Transactions on Robotics and Automation, 18, 1, 108-114 (2002)
[17] Hua, C. C.; Liu, X. P., Delay-dependent stability criteria of teleoperation systems with asymmetric time-varying delays, IEEE Transactions on Robotics, 26, 5, 925-932 (2010)
[18] Hyodo, S.; Soeda, Y.; Ohnishi, K., Verification of flexible actuator from position and force transfer characteristic and its application to bilateral teleoperation system, IEEE Transactions on Industrial Electronics, 56, 1, 36-42 (2009)
[19] Islam, S.; Liu, P. X.; El Saddik, A.; Dias, J.; Seneviratne, L., Bilateral shared autonomous systems with passive and nonpassive input forces under time varying delay, ISA Transactions, 54, 218-228 (2015)
[20] Jiang, Z. P.; Wang, Y., Input-to-state stability for discrete-time nonlinear systems, Automatica, 37, 6, 857-869 (2001) · Zbl 0989.93082
[21] Johansen, T. A.; Shorten, R.; Murray-Smith, R., On the interpretation and identification of dynamic Takagi-Sugenofuzzy models, IEEE Transactions on Fuzzy Systems, 8, 3, 297-313 (2000)
[22] Juang, Chia-Feng, & Tsao, Yu-Wei (2008). A self-evolving interval type-2 fuzzy neural network with online structure and parameter learning, 16(6); Juang, Chia-Feng, & Tsao, Yu-Wei (2008). A self-evolving interval type-2 fuzzy neural network with online structure and parameter learning, 16(6)
[23] Lawrence, D. A., Stability and transparency in bilateral teleoperation, IEEE Transactions on Robotics and Automation, 9, 5, 624-637 (1993)
[24] Lee, D.; Spong, M. W., Passive bilateral teleoperation with constant time delay, IEEE Transactions on Robotics, 22, 2, 269-281 (2006)
[25] Li, Y.; Tong, S.; Li, T., Hybrid fuzzy adaptive output feedback control design for uncertain MIMO nonlinear systems with time-varying delays and input saturation, IEEE Transactions on Fuzzy Systems, 24, 4, 841-853 (2016)
[26] Li, Z.; Xia, Y.; Sun, F., Adaptive fuzzy control for multilateral cooperative teleoperation of multiple robotic manipulators under random network-induced delays, IEEE Transactions on Fuzzy Systems, 22, 2, 437-450 (2014)
[27] Liang, Q., & Mendel, J. M. (1999). An introduction to type-2 TSK fuzzy logic systems. In Fuzzy systems conference proceedings, Vol. 3; Liang, Q., & Mendel, J. M. (1999). An introduction to type-2 TSK fuzzy logic systems. In Fuzzy systems conference proceedings, Vol. 3
[28] Liao, Q.; Sun, D., Interaction measures for control configuration selection based on interval type-2 Takagi-Sugeno fuzzy model, IEEE Transactions on Fuzzy Systems (2018)
[29] Liao, Q.; Sun, D., Sparse and decoupling control strategies based on Takagi-Sugeno fuzzy models, IEEE Transactions on Cybernetics (2019)
[30] Lichiardopol, S., Wouw, N. van. de., & Nijmeijer, H. Bilateral teleoperation for force sensorless 1-DOF robots. In ICINCO (2); Lichiardopol, S., Wouw, N. van. de., & Nijmeijer, H. Bilateral teleoperation for force sensorless 1-DOF robots. In ICINCO (2)
[31] Lin, Yang-Yin, Chang, Jyh-Yeong, & Lin, Chin-Teng (2014). A TSK-type-based self-evolving compensatory interval type-2 fuzzy neural network (TSCIT2FNN) and its applications, 61(1); Lin, Yang-Yin, Chang, Jyh-Yeong, & Lin, Chin-Teng (2014). A TSK-type-based self-evolving compensatory interval type-2 fuzzy neural network (TSCIT2FNN) and its applications, 61(1)
[32] Mendel, J. M., Computing derivatives in interval type-2 fuzzy logic systems, IEEE Transactions on Fuzzy Systems, 12, 1, 84-98 (2004)
[33] Mohammadi, A., Disturbance observer design for robotic and telerobotic systems (2011), University of Alberta, (Doctoral dissertation)
[34] Mohammadi, A.; Tavakoli, M.; Marquez, H. J.; Hashemzadeh, F., Nonlinear disturbance observer design for robotic manipulators, Control Engineering Practice, 21, 3, 253-267 (2013)
[35] Nuno, E.; Ortega, R.; Barabanov, N.; Basañez, L., A globally stable PD controller for bilateral teleoperators, IEEE Transactions on Robotics, 24, 3, 753-758 (2008)
[36] Rusu, R. B.; Cousins, S., 3d is here: Point cloud library (pcl), (Robotics and automation (ICRA), 2011 IEEE international conference on (2011), IEEE), 1-4
[37] S., Ahn H., Synchronization of bilateral teleoperation systems using state and force observer, (Control automation and systems (ICCAS), 2010 international conference on (2010), IEEE), 1362-1365
[38] Sariyildiz, E.; Ohnishi, K., An adaptive reaction force observer design, IEEE/ASME Transactions on Mechatronics, 20, 2, 750-760 (2015)
[39] del Sol, E.; King, R.; Scott, R.; Ferre, M., External force estimation for teleoperation based on proprioceptive sensors, International Journal of Advanced Robotic Systems, 11, 3, 52 (2014)
[40] Sun, D.; Liao, Q.; Gu, X.; Li, C.; Ren, H., Multilateral teleoperation with new cooperative structure based on reconfigurable robots and type-2 fuzzy logic, IEEE Transactions on Cybernetics, 99, 1-15 (2018)
[41] Sun, D.; Liao, Q. F.; Ren, H., Type-2 fuzzy modeling and control for bilateral teleoperation system with dynamic uncertainties and time-varying delays, IEEE Transactions on Industrial Electronics, 65, 1 (2018)
[42] Sun, D.; Liao, Q.; Ren, H., Type-2 fuzzy logic based time-delayed shared control in online-switching tele-operated and autonomous systems, Robotics and Autonomous Systems, 101, 138-152 (2018)
[43] Sun, D.; Naghdy, F.; Du, H., Application of wave-variable control to bilateral teleoperation systems: A survey, Annual Reviews in Control, 38, 1, 12-31 (2014)
[47] Wang, H. O.; Tanaka, K., (Fuzzy control system design and analysis: A LMI approach (2004), Wiley-Interscience Publication)
[50] Yang, Y.; Hua, C.; Guan, X., Adaptive fuzzy finite-time coordination control for networked nonlinear bilateral teleoperation system, IEEE Transactions on Fuzzy Systems, 22, 3, 631-641 (2014)
[51] Yang, Y.; Hua, C.; Guan, X., Finite time control design for bilateral teleoperation system with position synchronization error constrained, IEEE Transactions on Cybernetics, 46, 3, 609-619 (2016)
[52] Yang, C.; Peng, G.; Li, Y.; Cui, R.; Cheng, L.; Li, Z., Neural networks enhanced adaptive admittance control of optimized robot-environment interaction, IEEE Transactions on Cybernetics, 99, 1-12 (2018)
[53] Yang, L.; Yang, J., Nonsingular fast terminal sliding-mode control for nonlinear dynamical systems, International Journal of Robust and Nonlinear Control, 21, 16, 1865-1879 (2011) · Zbl 1237.93039
[54] Ying, H., General SISO Takagi-Sugeno fuzzy systems with linear rule consequent are universal approximators, IEEE Transactions on Fuzzy Systems, 6, 4, 582-587 (1998)
[55] Yuan, Y.; Wang, Y.; Guo, L., Force reflecting control for bilateral teleoperation system under time-varying delays, IEEE Transactions on Industrial Informatics, 15, 2, 1162-1172 (2019)
[56] Zhai, D. H.; Xia, Y., Adaptive fuzzy control of multilateral asymmetric teleoperation for coordinated multiple mobile manipulators, IEEE Transactions on Fuzzy Systems, 24, 1, 57-70 (2016)
[57] Zhai, D. H.; Xia, Y., Adaptive control for teleoperation system with varying time delays and input saturation constraints, IEEE Transactions on Industrial Electronics, 63, 11, 6921-6929 (2016)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.