Zenodo (CERN European Organization for Nuclear Research), May 26, 2023
The progress in mobile technologies of Internet of Things (IoT) effectively supports the digitali... more The progress in mobile technologies of Internet of Things (IoT) effectively supports the digitalization of sports training equipment. In this demo, we show an assistant mobile application (digital arbiter) to track the quality of exercise performance by the user. We experiment with sports training equipment produced by the MB Barbell company. The exercise is bench press from the chest or similar. The equipment has a mechanism to attach user's smartphone. The problem is to estimate the lower and upper bounds for each round of execution. The measurement is based on data coming in real-time from the smartphone accelerometer. First, the mobile application can check the correctness as reaching the bounds. Second, the distance and time are estimated that the user has overcome during the exercise rounds. Since each user has own characteristics (e.g., arm length, grip method), individual calibration of the sensor system is needed before exercise performance on a given sports training equipment. Our experiments show that the mobile application has good accuracy and real-time performance, so the digital arbiter can be used as in individual daily physical activity or in mass sports events.
The progress of Internet of Things (IoT) leads to appearance of diverse networked environments wh... more The progress of Internet of Things (IoT) leads to appearance of diverse networked environments where specific class of service-oriented applications–-smart spaces–-are becoming developed and deployed. The deployment is based on certain software platforms, widely accepted as smart spaces middleware. This paper overviews this type of middleware with focus on the requirements that the middleware supports in IoT environments. We analyze and systemize the middleware requirements. The systemized requirements are mapped to the particular existing middleware solutions, leading to identification and comparison of basic approaches in the smart spaces development problem.
Frontiers in artificial intelligence and applications, Oct 14, 2021
Advanced technologies of Sensorics and Internet of Things (IoT) enable real-time data analytics b... more Advanced technologies of Sensorics and Internet of Things (IoT) enable real-time data analytics based on multiple sensors covering the target industrial production system and its manufacturing processes. The rolling bearings fault diagnosis is one of the most urgent problems and can be solved by using convolution neural networks and edge artificial intelligence (edge AI) devices. The limitations of the hardware platform must be taken into account to achieve maximum performance. In this paper, we analyze efficient CNN architecture for bearings fault diagnosis that is able to process data in real-time on edge AI devices. We observe that the accuracy of the proposed CNN is unsatisfactory for practical use, and better accuracy is possible with increasing the number of bearings in the training dataset.
The paper introduces an approach to collecting and mining health-related information on the patie... more The paper introduces an approach to collecting and mining health-related information on the patient based on sensed data from various medical devices as well as from other digitallyenabled sources. The regularly sensed data are semantically linked thus creating an additional information space-semantic layer. On the latter, a linked knowledge-rich structure-semantic network-is maintained and used to construct mobile services. The use of various medical devices and other data sources makes it possible to remotely monitor patients' vital physiological parameters and other important health-related events. It includes sensing the context of the physical environment, which is then coupled with the health state of the patient. Several patients and interested people can be virtually integrated into a group. Consequently, social methods can be used for enhancing the treatment adherence and for motivating the healthcare goals. As such, the healthcare services would have became more focused on the patients and their needs. Ultimately, the mobile healthcare moves towards the vision of At-Home Laboratory (AHL) that diminishes the necessity to visit the hospital and to directly use its facility.
DOAJ (DOAJ: Directory of Open Access Journals), Nov 1, 2016
During the 19th FRUCT Conference the SmartRoom system is used for assisting the organization and... more During the 19th FRUCT Conference the SmartRoom system is used for assisting the organization and collaborative activity of some conference sessions.
DOAJ (DOAJ: Directory of Open Access Journals), Oct 1, 2021
Internet content provides much information about a particular person, especially related to her/h... more Internet content provides much information about a particular person, especially related to her/his activity reflected in social networks as web-pages linked with information files. The problem is to find such information about a given person and with given search query constraints. A lot of data sources is had to be analyzed to find information for constructing digital personal profile. In this paper, we consider iterative Internet search algorithm that generates multiple search queries and evaluates the found links on the relation level to the given person. A rank is computed for each link that shows the relation level to the given person. Our experiments show that the method finds links among which 75% or more is essentially related to the person. When the content of a link is further analyzed (e.g., parsing) the search quality increases up to 90% and more.
Autonomous mobile robots have been discovering recently a wide range of applications in various a... more Autonomous mobile robots have been discovering recently a wide range of applications in various areas of human activities. A robot uses many data sources (sensors) to recognize its current situation, including video, inertial, acoustic, mechanical stress. The data flows from such sources are redundant, error prone, delivered with a rather high rate, and contain considerable information as for the ongoing events so present measurement noise, errors and insignificant data about minor fluctuations of the environment and the device. They present a source information for the inference modules such as navigation, localization, path planning, scheduling etc. The total number of the ongoing events can be large. They have different importance for the movement control. In this paper, we consider a method for intelligent data selection. The method is based on the Additive Increase Multiplicative Decrease (AIMD) algorithm. The effect is in filtering the most significant information to forward to the robot movement control.
This document briefly introduces the benefits brought by extending the Host Identity Protocol (HI... more This document briefly introduces the benefits brought by extending the Host Identity Protocol (HIP) with hierarchical information. In addition, two hierarchical extensions of HIP are introduced. The first one aims to transport hierarchical information in a parameter of the HIP header, while the second one extends DNS resource records in order to contain hierarchical information. Conventions used in this document The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC-2119 [RFC2119].
An equipment monitoring system is responsible for analytical services that assist the personnel i... more An equipment monitoring system is responsible for analytical services that assist the personnel in equipment diagnostics, fault prediction, and post-analysis. In this work, we consider a case study of using virtual and augmented reality (VR/AR) for effective analytics delivery to the production equipment personnel. The reference analytical services for our study come from our pilot development with metalcutting industry in Russia. The two service models are proposed: (a) Situation Center and (b) Virtual Assistant. We identify the VR/AR advantages compared with the traditional style of visualizing analytical services on computer screens. Our study is supported with prototype implementation of the VR/AR system for analytics delivery to the personnel.
A smart space enables semantics-oriented information sharing in a networked computing environment... more A smart space enables semantics-oriented information sharing in a networked computing environment, including the case of mobile settings. In this paper, we consider the emerging case of Internet of Things (IoT) environments. We introduce our study on personalization of such environments using mobile information services within a smart space. Such advanced services are defined now as "smart" or "intelligent". Their construction and delivery are provided by participants themselves, following the concepts of multiagent systems, peer-to-peer networks, and autonomic computing. This study identifies the key properties of a smart space to serve its mobile users and to provide them with all needed information assistance.
The massive introduction of video capturing devices in Internet of Things (IoT) environments lead... more The massive introduction of video capturing devices in Internet of Things (IoT) environments leads to development of various video data based services. In this paper, we consider the need and background on the video data based services in IoT environments. Based on the smart spaces approach, we introduce the architecture and distributed configurations to construct such services using primarily local devices and to deliver such services using smartphones. We discuss possible data models that can be used on such mediatory components as a local video server and a semantic information broker.
The development of smart spaces for Internet of Things (IoT) environments meets the scalability c... more The development of smart spaces for Internet of Things (IoT) environments meets the scalability challenge since many participants are involved into the distributed computation. In particular, many sensors continuously provide data, many reasoners analyze the sensed data to construct services, and many mobile clients regularly join and leave the smart space to consume the services. The network interaction is informationdriven, using a semantic information broker, which implements a passive strategy for subscription. The strategy leads to performance bottleneck. We continue our study of the active control strategy, when a part of subscription processing is delegated to the subscribers. The client multiplicatively decreases its check interval, if subscription notifications are lost, and additively increases the interval, otherwise. We study the role of strategy parameters: the client can select their values preliminary and keep fixed, or the client can change them dynamically depending on the recent situation. With the aim we provide mathematical model which represents important performance metrics as a function of strategy parameters. Analytical result are validated by experimental evaluation. Additionally, our simulation experiments evaluate the scalability in dependence on the number of participants.
A smart space enhances a networked computing environment by enabling information sharing for a mu... more A smart space enhances a networked computing environment by enabling information sharing for a multitude of local digital devices and global resources from the Internet. We consider the M3 architecture (multi-device, multi-vendor, multidomain) for creating smart spaces, which integrates technologies from two innovative concepts: the Semantic Web and the Internet of Things. Our research focus is on analyses of the capabilities of Smart-M3 platform, which provides software implementations for such a central element of an M3 smart space as Semantic Information Broker (SIB). The paper presents a state-of-the-art and contributes our systematized vision on the SIB design and implementation. The analyzed open source SIB implementations include the original Smart-M3 piglet-based SIB, its optimized descendant RedSIB, OSGi SIB for Java devices, pySIB for Python devices, and CuteSIB for Qt devices. We also analyze the design of proprietary or incomplete SIB implementations: RIBS for embedded devices and ADK SIB built upon the OSGi framework with integration in the Eclipse Integrated Development Environment. The theoretical study is augmented with experimental evaluation of available SIB implementations.
Despite of the elegance of smart spaces paradigm and its clear advantages, this area of developme... more Despite of the elegance of smart spaces paradigm and its clear advantages, this area of development of "smart" software for Internet of Things (IoT) still has very limited systematization and formal concept notation. The discussion paper provides a clarified vision onto the smart spaces terminology. The reference case is the M3 architecture, based on which we sequentially elaborate the notions of smart space, smart environment of knowledge sharing, smart space application, its services and its architecture. We consider P2P-based service formalism, on the top of which several architectural abstractions are presented. They provide means for designing smart space applications.
The information exchange-as a way of interaction for participants in an Internet environment-is a... more The information exchange-as a way of interaction for participants in an Internet environment-is a fundamental function of a distributed system within the computing paradigms of Internet of Things, Cyber-Physical Systems, Ambient Intelligence etc. Participants in an Internet environment are represented by software agents running typically on low-performance edge computing devices. Interaction is implemented through exchange of information collected by the participants in a shared information store that implements the «intelligence» of this environment. The organization of agents access to the shared information and of their interaction uses a semantic information broker that manages information flows between participants. With an increase in the number, diversity, and activity of participants, the workload on the broker and the data transmission network increases. In this paper, a novel method is proposed to reduce the workload by delegating part of the control of the information exchange to the participants themselves. The subscription mechanism is modified for information changes in a shared information store. Instead of the passive option, when the broker must notify all agents who have subscribed to the information being changed, the active option is used, when agents themselves can check for information changes. A new two-component control method based on the well-known backoff algorithm in combination with the well-known adaptive strategy for choosing the time of sending the next request from an agent to a broker for the presence of information changes is proposed. The control capabilities are studied experimentally using a simulated Internet environment.
This article is an open access article distributed under the terms and conditions of the Creative... more This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY
This paper is targeted to initiate discussion on how to describe and make formal definition of sm... more This paper is targeted to initiate discussion on how to describe and make formal definition of smart spaces in Internet of Things (IoT) environment by utilizing well-known models for Peer-to-Peer (P2P) networks. Indeed, when one starts studying smart spaces solutions and applying them in IoT environments then traditional models of P2P interaction come in mind as the first association. Every device, sensor, or network process could be represented by the corresponding agent (or peer). Services are emerged as a result of cooperative work of multiple agents in the smart space. Each agent contributes to the service by sharing its portion of knowledge in the smart space. We propose initial ideas on how a P2P model can virtualize physical objects and service construction processes by representing them as a network of interacting information objects in the smart space. Although interaction between objects is not physically direct communication, the model logically organizes direct interaction of objects as peers. This approach aims at higher interoperability in knowledge sharing and at an effective abstract level for service design.
Zenodo (CERN European Organization for Nuclear Research), May 26, 2023
The progress in mobile technologies of Internet of Things (IoT) effectively supports the digitali... more The progress in mobile technologies of Internet of Things (IoT) effectively supports the digitalization of sports training equipment. In this demo, we show an assistant mobile application (digital arbiter) to track the quality of exercise performance by the user. We experiment with sports training equipment produced by the MB Barbell company. The exercise is bench press from the chest or similar. The equipment has a mechanism to attach user's smartphone. The problem is to estimate the lower and upper bounds for each round of execution. The measurement is based on data coming in real-time from the smartphone accelerometer. First, the mobile application can check the correctness as reaching the bounds. Second, the distance and time are estimated that the user has overcome during the exercise rounds. Since each user has own characteristics (e.g., arm length, grip method), individual calibration of the sensor system is needed before exercise performance on a given sports training equipment. Our experiments show that the mobile application has good accuracy and real-time performance, so the digital arbiter can be used as in individual daily physical activity or in mass sports events.
The progress of Internet of Things (IoT) leads to appearance of diverse networked environments wh... more The progress of Internet of Things (IoT) leads to appearance of diverse networked environments where specific class of service-oriented applications–-smart spaces–-are becoming developed and deployed. The deployment is based on certain software platforms, widely accepted as smart spaces middleware. This paper overviews this type of middleware with focus on the requirements that the middleware supports in IoT environments. We analyze and systemize the middleware requirements. The systemized requirements are mapped to the particular existing middleware solutions, leading to identification and comparison of basic approaches in the smart spaces development problem.
Frontiers in artificial intelligence and applications, Oct 14, 2021
Advanced technologies of Sensorics and Internet of Things (IoT) enable real-time data analytics b... more Advanced technologies of Sensorics and Internet of Things (IoT) enable real-time data analytics based on multiple sensors covering the target industrial production system and its manufacturing processes. The rolling bearings fault diagnosis is one of the most urgent problems and can be solved by using convolution neural networks and edge artificial intelligence (edge AI) devices. The limitations of the hardware platform must be taken into account to achieve maximum performance. In this paper, we analyze efficient CNN architecture for bearings fault diagnosis that is able to process data in real-time on edge AI devices. We observe that the accuracy of the proposed CNN is unsatisfactory for practical use, and better accuracy is possible with increasing the number of bearings in the training dataset.
The paper introduces an approach to collecting and mining health-related information on the patie... more The paper introduces an approach to collecting and mining health-related information on the patient based on sensed data from various medical devices as well as from other digitallyenabled sources. The regularly sensed data are semantically linked thus creating an additional information space-semantic layer. On the latter, a linked knowledge-rich structure-semantic network-is maintained and used to construct mobile services. The use of various medical devices and other data sources makes it possible to remotely monitor patients' vital physiological parameters and other important health-related events. It includes sensing the context of the physical environment, which is then coupled with the health state of the patient. Several patients and interested people can be virtually integrated into a group. Consequently, social methods can be used for enhancing the treatment adherence and for motivating the healthcare goals. As such, the healthcare services would have became more focused on the patients and their needs. Ultimately, the mobile healthcare moves towards the vision of At-Home Laboratory (AHL) that diminishes the necessity to visit the hospital and to directly use its facility.
DOAJ (DOAJ: Directory of Open Access Journals), Nov 1, 2016
During the 19th FRUCT Conference the SmartRoom system is used for assisting the organization and... more During the 19th FRUCT Conference the SmartRoom system is used for assisting the organization and collaborative activity of some conference sessions.
DOAJ (DOAJ: Directory of Open Access Journals), Oct 1, 2021
Internet content provides much information about a particular person, especially related to her/h... more Internet content provides much information about a particular person, especially related to her/his activity reflected in social networks as web-pages linked with information files. The problem is to find such information about a given person and with given search query constraints. A lot of data sources is had to be analyzed to find information for constructing digital personal profile. In this paper, we consider iterative Internet search algorithm that generates multiple search queries and evaluates the found links on the relation level to the given person. A rank is computed for each link that shows the relation level to the given person. Our experiments show that the method finds links among which 75% or more is essentially related to the person. When the content of a link is further analyzed (e.g., parsing) the search quality increases up to 90% and more.
Autonomous mobile robots have been discovering recently a wide range of applications in various a... more Autonomous mobile robots have been discovering recently a wide range of applications in various areas of human activities. A robot uses many data sources (sensors) to recognize its current situation, including video, inertial, acoustic, mechanical stress. The data flows from such sources are redundant, error prone, delivered with a rather high rate, and contain considerable information as for the ongoing events so present measurement noise, errors and insignificant data about minor fluctuations of the environment and the device. They present a source information for the inference modules such as navigation, localization, path planning, scheduling etc. The total number of the ongoing events can be large. They have different importance for the movement control. In this paper, we consider a method for intelligent data selection. The method is based on the Additive Increase Multiplicative Decrease (AIMD) algorithm. The effect is in filtering the most significant information to forward to the robot movement control.
This document briefly introduces the benefits brought by extending the Host Identity Protocol (HI... more This document briefly introduces the benefits brought by extending the Host Identity Protocol (HIP) with hierarchical information. In addition, two hierarchical extensions of HIP are introduced. The first one aims to transport hierarchical information in a parameter of the HIP header, while the second one extends DNS resource records in order to contain hierarchical information. Conventions used in this document The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC-2119 [RFC2119].
An equipment monitoring system is responsible for analytical services that assist the personnel i... more An equipment monitoring system is responsible for analytical services that assist the personnel in equipment diagnostics, fault prediction, and post-analysis. In this work, we consider a case study of using virtual and augmented reality (VR/AR) for effective analytics delivery to the production equipment personnel. The reference analytical services for our study come from our pilot development with metalcutting industry in Russia. The two service models are proposed: (a) Situation Center and (b) Virtual Assistant. We identify the VR/AR advantages compared with the traditional style of visualizing analytical services on computer screens. Our study is supported with prototype implementation of the VR/AR system for analytics delivery to the personnel.
A smart space enables semantics-oriented information sharing in a networked computing environment... more A smart space enables semantics-oriented information sharing in a networked computing environment, including the case of mobile settings. In this paper, we consider the emerging case of Internet of Things (IoT) environments. We introduce our study on personalization of such environments using mobile information services within a smart space. Such advanced services are defined now as "smart" or "intelligent". Their construction and delivery are provided by participants themselves, following the concepts of multiagent systems, peer-to-peer networks, and autonomic computing. This study identifies the key properties of a smart space to serve its mobile users and to provide them with all needed information assistance.
The massive introduction of video capturing devices in Internet of Things (IoT) environments lead... more The massive introduction of video capturing devices in Internet of Things (IoT) environments leads to development of various video data based services. In this paper, we consider the need and background on the video data based services in IoT environments. Based on the smart spaces approach, we introduce the architecture and distributed configurations to construct such services using primarily local devices and to deliver such services using smartphones. We discuss possible data models that can be used on such mediatory components as a local video server and a semantic information broker.
The development of smart spaces for Internet of Things (IoT) environments meets the scalability c... more The development of smart spaces for Internet of Things (IoT) environments meets the scalability challenge since many participants are involved into the distributed computation. In particular, many sensors continuously provide data, many reasoners analyze the sensed data to construct services, and many mobile clients regularly join and leave the smart space to consume the services. The network interaction is informationdriven, using a semantic information broker, which implements a passive strategy for subscription. The strategy leads to performance bottleneck. We continue our study of the active control strategy, when a part of subscription processing is delegated to the subscribers. The client multiplicatively decreases its check interval, if subscription notifications are lost, and additively increases the interval, otherwise. We study the role of strategy parameters: the client can select their values preliminary and keep fixed, or the client can change them dynamically depending on the recent situation. With the aim we provide mathematical model which represents important performance metrics as a function of strategy parameters. Analytical result are validated by experimental evaluation. Additionally, our simulation experiments evaluate the scalability in dependence on the number of participants.
A smart space enhances a networked computing environment by enabling information sharing for a mu... more A smart space enhances a networked computing environment by enabling information sharing for a multitude of local digital devices and global resources from the Internet. We consider the M3 architecture (multi-device, multi-vendor, multidomain) for creating smart spaces, which integrates technologies from two innovative concepts: the Semantic Web and the Internet of Things. Our research focus is on analyses of the capabilities of Smart-M3 platform, which provides software implementations for such a central element of an M3 smart space as Semantic Information Broker (SIB). The paper presents a state-of-the-art and contributes our systematized vision on the SIB design and implementation. The analyzed open source SIB implementations include the original Smart-M3 piglet-based SIB, its optimized descendant RedSIB, OSGi SIB for Java devices, pySIB for Python devices, and CuteSIB for Qt devices. We also analyze the design of proprietary or incomplete SIB implementations: RIBS for embedded devices and ADK SIB built upon the OSGi framework with integration in the Eclipse Integrated Development Environment. The theoretical study is augmented with experimental evaluation of available SIB implementations.
Despite of the elegance of smart spaces paradigm and its clear advantages, this area of developme... more Despite of the elegance of smart spaces paradigm and its clear advantages, this area of development of "smart" software for Internet of Things (IoT) still has very limited systematization and formal concept notation. The discussion paper provides a clarified vision onto the smart spaces terminology. The reference case is the M3 architecture, based on which we sequentially elaborate the notions of smart space, smart environment of knowledge sharing, smart space application, its services and its architecture. We consider P2P-based service formalism, on the top of which several architectural abstractions are presented. They provide means for designing smart space applications.
The information exchange-as a way of interaction for participants in an Internet environment-is a... more The information exchange-as a way of interaction for participants in an Internet environment-is a fundamental function of a distributed system within the computing paradigms of Internet of Things, Cyber-Physical Systems, Ambient Intelligence etc. Participants in an Internet environment are represented by software agents running typically on low-performance edge computing devices. Interaction is implemented through exchange of information collected by the participants in a shared information store that implements the «intelligence» of this environment. The organization of agents access to the shared information and of their interaction uses a semantic information broker that manages information flows between participants. With an increase in the number, diversity, and activity of participants, the workload on the broker and the data transmission network increases. In this paper, a novel method is proposed to reduce the workload by delegating part of the control of the information exchange to the participants themselves. The subscription mechanism is modified for information changes in a shared information store. Instead of the passive option, when the broker must notify all agents who have subscribed to the information being changed, the active option is used, when agents themselves can check for information changes. A new two-component control method based on the well-known backoff algorithm in combination with the well-known adaptive strategy for choosing the time of sending the next request from an agent to a broker for the presence of information changes is proposed. The control capabilities are studied experimentally using a simulated Internet environment.
This article is an open access article distributed under the terms and conditions of the Creative... more This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY
This paper is targeted to initiate discussion on how to describe and make formal definition of sm... more This paper is targeted to initiate discussion on how to describe and make formal definition of smart spaces in Internet of Things (IoT) environment by utilizing well-known models for Peer-to-Peer (P2P) networks. Indeed, when one starts studying smart spaces solutions and applying them in IoT environments then traditional models of P2P interaction come in mind as the first association. Every device, sensor, or network process could be represented by the corresponding agent (or peer). Services are emerged as a result of cooperative work of multiple agents in the smart space. Each agent contributes to the service by sharing its portion of knowledge in the smart space. We propose initial ideas on how a P2P model can virtualize physical objects and service construction processes by representing them as a network of interacting information objects in the smart space. Although interaction between objects is not physically direct communication, the model logically organizes direct interaction of objects as peers. This approach aims at higher interoperability in knowledge sharing and at an effective abstract level for service design.
Uploads
Papers by Dmitry Korzun