Blerim Zylfiu – IWSSIP 2022 Mon, 02 May 2022 01:11:27 +0000 en-US hourly 1 https://wordpress.org/?v=6.1.1 ../../../wp-content/uploads/2021/11/cropped-logo_2-32x32.jpg Blerim Zylfiu – IWSSIP 32 32 Plamen Angelov: Explainable-by-design Deep Learning ../../../plamen-angelov-explainable-by-design-deep-learning/ Wed, 10 Nov 2021 09:16:05 +0000 ?p=218 Abstract

Machine Learning (ML) and AI justifiably attract the attention and interest not only of the wider scientific community and industry, but also society and policy makers. However, even the most powerful (in terms of accuracy) algorithms such as deep learning (DL) can give a wrong output, which may be fatal. Due to the opaque and cumbersome model structure used by DL, some authors started to talk about a dystopian “black box” society. Despite the success in this area, the way computers learn is still principally different from the way people acquire new knowledge, recognise objects and make decisions. People do not need a huge amount of annotated data. They learn by example, using similarities to previously acquired prototypes, not by using parametric analytical models. Current ML approaches are focused primarily on accuracy and overlook explainability, the semantic meaning of the internal model representation, reasoning and its link with the problem domain. They also overlook the efforts to collect and label training data and rely on assumptions about the data distribution that are often not satisfied. The ability to detect the unseen and unexpected and start learning these new class/es in real time with no or very little supervision is critically important and is something that no currently existing classifier can offer. The challenge is to fill this gap between high level of accuracy and the semantically meaningful solutions. The most efficient algorithms that have fuelled interest towards ML and AI recently are also computationally very hungry – they require specific hardware accelerators such as GPU, huge amounts of labeled data and time. They produce parameterised models with hundreds of millions of coefficients, which are also impossible to interpret or be manipulated by a human. Once trained, such models are inflexible to new knowledge. They cannot dynamically evolve their internal structure to start recognising new lasses. They are good only for what they were originally trained for. They also lack robustness, formal guarantees about their behavior and explanatory and normative transparency. This makes problematic use of such algorithms in high stake complex problems such as aviation, health, bailing from jail, etc. where the clear rationale for a particular decision is very important and the errors are very costly. All these challenges and identified gaps require a dramatic paradigm shift and a radical new approach. In this talk the speaker will present such a new approach towards the next generation of computationally lean ML and AI algorithms that can learn in real-time using normal CPUs on computers, laptops, and smartphones or even be implemented on chip that will change dramatically the way these new technologies are being applied. It is explainable-by-design. It focuses on addressing the open research challenge of developing highly efficient, accurate ML algorithms and AI models that are transparent, interpretable, explainable and fair by design. Such systems are able to self-learn lifelong, and continuously improve without the need for complete re-training, can start learning from few training data samples, explore the data space, detect and learn from unseen data patterns, collaborate with humans or other such algorithms seamlessly.

References:
[1] E. A. Soares, P. Angelov, Towards Explainable Deep Neural Networks (xDNN), Neural Networks, 130: 185-194, October 2020.
[2] E. Soares, P. Angelov, M. P. G. Castro, S. Nageshrao, B. Costa, D. FIlev, Explaining Deep Learning Models Through Rule-Based Approximation and Visualization, IEEE Transactions on Fuzzy Systems, published online 3 June 2020, DOI: 10.1109/TFUZZ.2020.2999776.
[3] P. P. Angelov, X. Gu, Deep rule-based classifier with human-level performance and characteristics, Information Sciences, vol. 463-464, pp.196-213, Oct. 2018.
[4] P. P. Angelov, X. Gu, Toward anthropomorphic machine learning, IEEE Computer, 51(9):18–27, 2018.
[5] P. Angelov. X. Gu, Empirical Approach to Machine Learning, Springer, 2019, ISBN 978-3-030-02383-6.
[6] P. Angelov, X. Gu, J. Principe, A generalized methodology for data analysis, IEEE Transactions on Cybernetics, 48(10): 2981-2993, Oct 2018.

Biography: Prof. Plamen Angelov (MEng 1989, PhD 1993, DSc 2015) is a Fellow of the IEEE, of the IET and of the HEA. He is Governor of the International Neural Networks Society (INNS) being his Vice President for two terms till end of 2020. He holds a Personal Chair in Intelligent Systems at Lancaster University, UK. He has authored or co-authored 350+ peer-reviewed publications in leading journals, peer-reviewed conference proceedings, 6 patents, three research monographs (by Wiley, 2012 and Springer, 2002 and 2019) cited over 11000+ times with an h-index of 55. He is the founding Director of LIRA (Lancaster Intelligent, Robotic and Autonomous systems) Research Centre (www.lancaster.ac.uk/lira) which includes over 50 academics across 15 Departments from all Faculties of the University. He has an active research portfolio in the area of computational intelligence and machine learning and internationally recognised results into online and evolving learning and explainable AI. Prof. Angelov leads numerous projects (including several multimillion ones) funded by UK research councils, EU, industry, UK MoD. His research was recognised by ‘The Engineer Innovation and Technology 2008 Special Award’ and ‘For outstanding Services’ (2013) by IEEE and INNS. He is also the founding co-Editor-in-Chief of Springer’s journal on Evolving Systems and Associate Editor of several leading international scientific journals, including IEEE Transactions on Fuzzy Systems, of the IEEE Transactions on Cybernetics (the IEEE Transactions with the highest impact factor, 11.47), IEEE Transactions on AI as well as of several other journals such as Fuzzy Sets and Systems, Soft Computing, etc. He gave over a dozen plenary and key note talks at high profile conferences. Prof. Angelov was General co-Chair of a number of high profile conferences. He was also a member of International Program Committee of 100+ international conferences (primarily IEEE). More details can be found at www.lancs.ac.uk/staff/angelov

]]>
Ljiljana Trajkovic : Complex Networks ../../../2021/11/lic-complex-networksjiljana-trajkov/ Wed, 10 Nov 2021 08:32:08 +0000 ?p=161 Abstract

The Internet, social networks, power grids, gene regulatory networks, neuronal systems, food webs, social systems, and networks emanating from augmented and virtual reality platforms are all examples of complex networks. Collection and analysis of data from these networks is essential for their understanding. Traffic traces collected from various deployed communication networks and the Internet have been used to characterize and model network traffic, analyze network topologies, and classify network anomalies. Data mining and statistical analysis of network data have been employed to determine traffic loads, analyze patterns of users’ behavior,
and predict future network traffic while spectral graph theory has been applied to analyze network topologies and capture historical trends in their development. Recent machine learning techniques have proved valuable for predicting anomalous traffic behavior and for classifying anomalies in complex networks. Further applications of these tools will help improve our understanding of the underlying mechanisms that govern behavior, improve performance, and enhance security of computer networks.

 

Biography: Ljiljana Trajkovic received the Dipl. Ing. degree from University of Pristina, Yugoslavia, in 1974, the M.Sc. degrees in electrical engineering and computer engineering from Syracuse University, Syracuse, NY, in 1979 and 1981, respectively, and the Ph.D. degree in electrical engineering from University of California at Los Angeles, in 1986. She is currently a Professor in the School of Engineering Science at Simon Fraser University, Burnaby, British Columbia, Canada. From 1995 to 1997, she was a National Science Foundation (NSF) Visiting Professor in the Electrical Engineering and Computer Sciences Department, University of California, Berkeley. She was a Research Scientist at Bell Communications Research, Morristown, NJ, from 1990 to 1997, and a Member of the Technical Staff at AT&T Bell Laboratories, Murray Hill, NJ, from 1988 to 1990. Her research interests include high-performance communication networks, control of communication systems, computer-aided circuit analysis and design, and theory of nonlinear circuits and dynamical systems. Dr. Trajkovic serves as IEEE Division X Delegate/Director (2019–2020) and served as IEEE Division X Delegate-Elect/Director-Elect (2018). She also serves as Senior Past President (2018–2019) of the IEEE Systems, Man, and Cybernetics Society and served as Junior Past President (2016–2017), President (2014–2015), President-Elect (2013), Vice President Publications (2012–2013, 2010–2011), Vice President Long-Range Planning and Finance (2008–2009), and a Member at Large of its Board of Governors (2004–2006). She served as 2007 President of the IEEE Circuits and Systems Society. She was a member of the Board of Governors of the IEEE Circuits and Systems Society (2004–2005, 2001–2003). She is Chair of the IEEE Circuits and Systems Society joint Chapter of the Vancouver/Victoria Sections. She was Chair of the IEEE Technical Committee on Nonlinear Circuits and Systems (1998). She is General Co-Chair of SMC 2020 and SMC 2020 Workshop on BMI Systems and served as General Co-Chair of SMC 2019 and SMC 2018 Workshops on BMI Systems, SMC 2016, and HPSR 2014, Special Sessions Co-Chair of SMC 2017, Technical Program Chair of SMC 2017 and SMC 2016 Workshops on BMI Systems, Technical Program Co-Chair of SCAS 2005, and Technical Program Chair and Vice General Co-Chair of ISCAS 2004. She served as an Associate Editor of the IEEE Transactions on Circuits and Systems (Part I) (2004–2005, 1993–1995), the IEEE Transactions on Circuits and Systems (Part II) (2018, 2002-2003, 1999–2001), and the IEEE Circuits and Systems Magazine (2001–2003). She was a Distinguished Lecturer of the IEEE Circuits and Systems Society (2010–2011, 2002–2003). She is a Professional Member of IEEE-HKN and a Fellow of the IEEE

]]>