Advances on Mechanics, Design Engineering and Manufacturing II, 2019
In this work, we present an Augmented Reality framework for handheld devices that enhance users i... more In this work, we present an Augmented Reality framework for handheld devices that enhance users in the comprehension of plant information traditionally conveyed through printed Piping and Instrumentation Diagrams (P&ID). The proposed framework augments on the P&ID of a plant some virtual interactive graphics (hotspots) referenced to specific components drawn on the P&ID. In this way, it is possible to easily find all the components belonging to the same category (e.g., all the pumps). By tapping, on the tablet screen, on a single hotspot further multimedia information can be displayed: technical data, 3D CAD model of the component, and 360° images of the plant section. The application is connected to the factory database where all the information associated with the plant components is stored. We used, as a case study, the cleaning section of a milling plant. With the tool presented in this work, technicians will be able to find information updated and in less time, so reducing the intervention time and increasing the accuracy of the operations. Furthermore, the cognitive load associated with the task of understanding the plant is highly reduced through the use of virtual information displayed using Augmented Reality.
Advances on Mechanics, Design Engineering and Manufacturing II, 2019
Scaffolds are porous biomaterials that serve to replace missing portions of bone. Scaffolds must ... more Scaffolds are porous biomaterials that serve to replace missing portions of bone. Scaffolds must possess a proper geometry and hence have to be adequately designed to correctly undergo to the load and to favor the differentiation of the mesenchymal stem cells invading it, into osteoblasts. It is commonly known that scaffold geometry affects the quality of the regenerated bone creating within the scaffold pores. Scaffold properly designed trigger favorable values of biophysical stimuli that are responsible for the reactions cascade leading to the bone formation. In this paper an optimization algorithm is proposed that, based on mechano-regulation criteria, identifies the optimal geometry of scaffolds, i.e. the geometry that favors the formation of the largest amounts of bone in the shortest time. In detail, the algorithm, written in the Matlab environment, incorporates parametric finite element models of different scaffold types, a computational mechanobiological model and structural...
ARSAS (Augmented reality supported Aging system), is a system developed for maintaining the work ... more ARSAS (Augmented reality supported Aging system), is a system developed for maintaining the work ability of older workers in industrial context. ARSAS integrates two main technologies the "video summarization" (automatic summary of video streams) and the spatial augmented reality. The system is able to project on the workbench surfaces pre-recorded instruction video and / or technical information from digital manuals. The operator performs his tasks normally, but is videotaped and, if necessary, assisted in his activities by AR instructions and multimedia. The main advantages of the system are: to provide a digital memory and reduce the cognitive load of the operator. A second benefit is that the system can easily acquire and store the knowledge of skilled and\or experienced workers in semi-automatic way. The preliminary tests showed a significant reduction in the risk of errors and execution times.
Characterisation of the mechanical behaviour of cancer cells is an issue of crucial importance as... more Characterisation of the mechanical behaviour of cancer cells is an issue of crucial importance as specific cell mechanical properties have been measured and utilized as possible biomarkers of cancer progression. Atomic force microscopy certainly occupies a prominent place in the field of the mechanical characterisation devices. We developed a hybrid approach to characterise different cell lines (SW620 and SW480) of the human colon carcinoma submitted to nanoindentation measurements. An ad hoc algorithm was written that compares the force-indentation curves experimentally retrieved with those predicted by a finite element model that simulates the nanoindentation process and reproduces the cell geometry and the surface roughness. The algorithm perturbs iteratively the values of the cell mechanical properties implemented in the finite element model until the difference between the experimental and numerical force-indentation curves reaches the minimum value. The occurrence of this indicates that the implemented material properties are very close to the real ones. Different hyperelastic constitutive models, such as Arruda-Boyce, Mooney-Rivlin and Neo-Hookean were utilized to describe the structural behaviour of indented cells. The algorithm was capable of separating, for all the cell lines investigated, the mechanical properties of cell cortex and cytoskeleton. Material properties determined via the algorithm were different with respect to those obtained with the Hertzian contact theory. This demonstrates that factors such as: the cell geometry/anatomy and the hyperelastic constitutive behaviour, which are not contemplated in the Hertz's theory hypotheses, do affect the nanoindentation measurements. The proposed approach represents a powerful tool that, only on the basis of nanoindentation measurements, is capable of characterising material at the subcellular level.
International Journal of Computer Aided Engineering and Technology, 2016
This paper presents a novel application of natural interaction techniques for technical documenta... more This paper presents a novel application of natural interaction techniques for technical documentation navigation in augmented reality maintenance. The objective is to provide technical information where and when needed in order to reduce the time spent in retrieving procedural data from manuals. The system integrates a video and depth camera for user gesture acquisition, a webcam for marker-based tracking and a see through head mounted display for digital information overlay. We designed a novel hand free gesture-based interface to access technical documentation while performing maintenance tasks. We implemented a specific flexible system to prototype natural interfaces using UML configurable state machines. It supports 2D and 3D content navigation, CAD assembly explosion, real time 3D sectioning and operation browsing. We differentiate the interaction metaphors for 2D documents and 3D CAD models in order to be intuitive and easy to learn. A case study and a user test demonstrated the feasibility and the good acceptance of the presented gesture interface.
IEEE Transactions on Visualization and Computer Graphics, 2014
Efficient text visualization in head-worn augmented reality (AR) displays is critical because it ... more Efficient text visualization in head-worn augmented reality (AR) displays is critical because it is sensitive to display technology, text style and color, ambient illumination and so on. The main problem for the developer is to know the optimal text style for the specific display and for applications where color coding must be strictly followed because it is regulated by laws or internal practices. In this work, we experimented the effects on readability of two head-worn devices (optical and video see-through), two backgrounds (light and dark), five colors (white, black, red, green, and blue), and two text styles (plain text and billboarded text). Font type and size were kept constant. We measured the performance of 15 subjects by collecting about 5,000 measurements using a specific test application and followed by qualitative interviews. Readability turned out to be quicker on the optical see-through device. For the video see-through device, background affects readability only in case of text without billboard. Finally, our tests suggest that a good combination for indoor augmented reality applications, regardless of device and background, could be white text and blue billboard, while a mandatory color should be displayed as billboard with a white text message.
In this work we integrate augmented reality technology in a product development process using rea... more In this work we integrate augmented reality technology in a product development process using real technical drawings as a tangible interface for design review. We present an original collaborative framework for Augmented Design Review Over Network (ADRON). It provides the following features: augmented technical drawings, interactive FEM simulation, multimodal annotation and chat tools, web content integration and collaborative client/server architecture. Our framework is intended to use common hardware instead of expensive and complex virtual or augmented facilities. We designed the interface specifically for users with little or no augmented reality expertise proposing tangible interfaces for data review and visual editing for all the functions and configurations. Two case studies are presented and discussed: a real-time ''touch and see'' stress/strain simulation and a collaborative distributed design review session of an industrial component.
... A3-1 XII ADM International Conference - Grand Hotel - Rimini Italy - Sept. 5th-7th, 2001 Pa... more ... A3-1 XII ADM International Conference - Grand Hotel - Rimini Italy - Sept. 5th-7th, 2001 Page 2. ... Each of these subjects is going to be widely discussed in the following chapters. A3-2 XII ADM International Conference - Grand Hotel - Rimini Italy - Sept. 5th-7th, 2001 Page 3. ...
Design of scaffolds for tissue engineering entails multi-disciplinary and multi-scale aspects. Si... more Design of scaffolds for tissue engineering entails multi-disciplinary and multi-scale aspects. Since in vivo analysis of the tissue regeneration process is quite difficult in terms of selecting experimental protocols and requires considerable amount of time, a variety of numerical models have been developed to simulate mechanisms of tissue differentiation. The tremendous enhancement in computing power led researchers to develop more and more sophisticated models mostly based on finite element techniques and mechano-regulation computational models. In this article, we present an algorithm that combines the finite element model of an open-porous scaffold, a numerical optimization routine and a mechanobiological model. This algorithm has been utilized to determine both, the best scaffold geometry and the best load value (to apply on the scaffold) that allow the bone formation to be maximized.
Abstract The application of augmented reality in industrial environments requires an effective vi... more Abstract The application of augmented reality in industrial environments requires an effective visualization of text on a see-through head-mounted display (HMD). The main contribution of this work is an empirical study of text styles as viewed through a monocular optical see-through display on three real workshop backgrounds, examining four colors and four different text styles. We ran 2,520 test trials with 14 participants using a mixed design and evaluated completion time and error rates. We found that both presentation mode and ...
Design review of CAD assemblies using bimanual natural interface Michele Fiorentino (a), Rafael R... more Design review of CAD assemblies using bimanual natural interface Michele Fiorentino (a), Rafael Radkowski (b), Christian Stritzke (b), Antonio E. Uva (a), Giuseppe Monno (a)
Title: Moire-holographic evaluation of the strain fields at the weld toes of welded structures. A... more Title: Moire-holographic evaluation of the strain fields at the weld toes of welded structures. Authors: Pappalettere, Carmine; Trentadue, Bartolo; Monno, Giuseppe. Affiliation: AA(Univ. of Bari). Publication: Proc. SPIE Vol. 1554B ...
We have developed a pen device for CAD applications in virtual reality which provides novel featu... more We have developed a pen device for CAD applications in virtual reality which provides novel features compared to existing systems. The SenStylus consists of a wireless pen designed to be ergonomically handled by the user for spatial interaction using a six degree of freedom optical tracking. In addition to the classic digital button(s) input, it provides analog multi-axial control, and a dual-rumble feedback output. We have integrated the device into an existing virtual reality CAD environment and extended the application functionalities with new devicespecific features. The SenStylus vibration feedback improves perception in the virtual world by controlling frequency, amplitude, and duration of the feedback, simulating a variety of responses during collisions and selection tasks. This capability enforces the visual depth sensitivity, which is critical when wo rking with complex CAD models. The multi-axial analog input provides a natural interaction paradigm to the user, thus simulating pen pressure and angle as in real world sketching and in real clay modeling. Dynamic tool-tip dimensioning and shaping are implemented as extra features. We present some applications to prove the added value of the SenStylus. The evaluation of the device received positive feedback by designers and engineers alike. The new features offered by this device can easily be extended to other VR applications using the API provided.
CiteSeerX - Document Details (Isaac Councill, Lee Giles): It is imperative for CAD, solid modelin... more CiteSeerX - Document Details (Isaac Councill, Lee Giles): It is imperative for CAD, solid modeling, grid generation, and data exchange applications that a complicated, surface-based geometry definition does not contain discontinuities in the form of overlapping surfaces, gaps between ...
Text legibility in augmented reality with optical see-through displays can be challenging due to ... more Text legibility in augmented reality with optical see-through displays can be challenging due to the interaction with the texture on the background. Literature presents several approaches to predict legibility of text superimposed over a specific image, but their validation with an AR display and with images taken from the industrial domain is scarce. In this work, we propose novel indices extracted from the background images, displayed on an LCD screen, and we compare them with those proposed in literature designing a specific user test. We collected the legibility user ratings by displaying white text over 13 industrial background images to 19 subjects using an optical see-through head-worn display. We found that most of the proposed indices have a significant correlation with user ratings. The main result of this work is that some of the novel indices proposed had a better correlation than those used before in the literature to predict legibility. Our results prove that industria...
Advances on Mechanics, Design Engineering and Manufacturing II, 2019
In this work, we present an Augmented Reality framework for handheld devices that enhance users i... more In this work, we present an Augmented Reality framework for handheld devices that enhance users in the comprehension of plant information traditionally conveyed through printed Piping and Instrumentation Diagrams (P&ID). The proposed framework augments on the P&ID of a plant some virtual interactive graphics (hotspots) referenced to specific components drawn on the P&ID. In this way, it is possible to easily find all the components belonging to the same category (e.g., all the pumps). By tapping, on the tablet screen, on a single hotspot further multimedia information can be displayed: technical data, 3D CAD model of the component, and 360° images of the plant section. The application is connected to the factory database where all the information associated with the plant components is stored. We used, as a case study, the cleaning section of a milling plant. With the tool presented in this work, technicians will be able to find information updated and in less time, so reducing the intervention time and increasing the accuracy of the operations. Furthermore, the cognitive load associated with the task of understanding the plant is highly reduced through the use of virtual information displayed using Augmented Reality.
Advances on Mechanics, Design Engineering and Manufacturing II, 2019
Scaffolds are porous biomaterials that serve to replace missing portions of bone. Scaffolds must ... more Scaffolds are porous biomaterials that serve to replace missing portions of bone. Scaffolds must possess a proper geometry and hence have to be adequately designed to correctly undergo to the load and to favor the differentiation of the mesenchymal stem cells invading it, into osteoblasts. It is commonly known that scaffold geometry affects the quality of the regenerated bone creating within the scaffold pores. Scaffold properly designed trigger favorable values of biophysical stimuli that are responsible for the reactions cascade leading to the bone formation. In this paper an optimization algorithm is proposed that, based on mechano-regulation criteria, identifies the optimal geometry of scaffolds, i.e. the geometry that favors the formation of the largest amounts of bone in the shortest time. In detail, the algorithm, written in the Matlab environment, incorporates parametric finite element models of different scaffold types, a computational mechanobiological model and structural...
ARSAS (Augmented reality supported Aging system), is a system developed for maintaining the work ... more ARSAS (Augmented reality supported Aging system), is a system developed for maintaining the work ability of older workers in industrial context. ARSAS integrates two main technologies the "video summarization" (automatic summary of video streams) and the spatial augmented reality. The system is able to project on the workbench surfaces pre-recorded instruction video and / or technical information from digital manuals. The operator performs his tasks normally, but is videotaped and, if necessary, assisted in his activities by AR instructions and multimedia. The main advantages of the system are: to provide a digital memory and reduce the cognitive load of the operator. A second benefit is that the system can easily acquire and store the knowledge of skilled and\or experienced workers in semi-automatic way. The preliminary tests showed a significant reduction in the risk of errors and execution times.
Characterisation of the mechanical behaviour of cancer cells is an issue of crucial importance as... more Characterisation of the mechanical behaviour of cancer cells is an issue of crucial importance as specific cell mechanical properties have been measured and utilized as possible biomarkers of cancer progression. Atomic force microscopy certainly occupies a prominent place in the field of the mechanical characterisation devices. We developed a hybrid approach to characterise different cell lines (SW620 and SW480) of the human colon carcinoma submitted to nanoindentation measurements. An ad hoc algorithm was written that compares the force-indentation curves experimentally retrieved with those predicted by a finite element model that simulates the nanoindentation process and reproduces the cell geometry and the surface roughness. The algorithm perturbs iteratively the values of the cell mechanical properties implemented in the finite element model until the difference between the experimental and numerical force-indentation curves reaches the minimum value. The occurrence of this indicates that the implemented material properties are very close to the real ones. Different hyperelastic constitutive models, such as Arruda-Boyce, Mooney-Rivlin and Neo-Hookean were utilized to describe the structural behaviour of indented cells. The algorithm was capable of separating, for all the cell lines investigated, the mechanical properties of cell cortex and cytoskeleton. Material properties determined via the algorithm were different with respect to those obtained with the Hertzian contact theory. This demonstrates that factors such as: the cell geometry/anatomy and the hyperelastic constitutive behaviour, which are not contemplated in the Hertz's theory hypotheses, do affect the nanoindentation measurements. The proposed approach represents a powerful tool that, only on the basis of nanoindentation measurements, is capable of characterising material at the subcellular level.
International Journal of Computer Aided Engineering and Technology, 2016
This paper presents a novel application of natural interaction techniques for technical documenta... more This paper presents a novel application of natural interaction techniques for technical documentation navigation in augmented reality maintenance. The objective is to provide technical information where and when needed in order to reduce the time spent in retrieving procedural data from manuals. The system integrates a video and depth camera for user gesture acquisition, a webcam for marker-based tracking and a see through head mounted display for digital information overlay. We designed a novel hand free gesture-based interface to access technical documentation while performing maintenance tasks. We implemented a specific flexible system to prototype natural interfaces using UML configurable state machines. It supports 2D and 3D content navigation, CAD assembly explosion, real time 3D sectioning and operation browsing. We differentiate the interaction metaphors for 2D documents and 3D CAD models in order to be intuitive and easy to learn. A case study and a user test demonstrated the feasibility and the good acceptance of the presented gesture interface.
IEEE Transactions on Visualization and Computer Graphics, 2014
Efficient text visualization in head-worn augmented reality (AR) displays is critical because it ... more Efficient text visualization in head-worn augmented reality (AR) displays is critical because it is sensitive to display technology, text style and color, ambient illumination and so on. The main problem for the developer is to know the optimal text style for the specific display and for applications where color coding must be strictly followed because it is regulated by laws or internal practices. In this work, we experimented the effects on readability of two head-worn devices (optical and video see-through), two backgrounds (light and dark), five colors (white, black, red, green, and blue), and two text styles (plain text and billboarded text). Font type and size were kept constant. We measured the performance of 15 subjects by collecting about 5,000 measurements using a specific test application and followed by qualitative interviews. Readability turned out to be quicker on the optical see-through device. For the video see-through device, background affects readability only in case of text without billboard. Finally, our tests suggest that a good combination for indoor augmented reality applications, regardless of device and background, could be white text and blue billboard, while a mandatory color should be displayed as billboard with a white text message.
In this work we integrate augmented reality technology in a product development process using rea... more In this work we integrate augmented reality technology in a product development process using real technical drawings as a tangible interface for design review. We present an original collaborative framework for Augmented Design Review Over Network (ADRON). It provides the following features: augmented technical drawings, interactive FEM simulation, multimodal annotation and chat tools, web content integration and collaborative client/server architecture. Our framework is intended to use common hardware instead of expensive and complex virtual or augmented facilities. We designed the interface specifically for users with little or no augmented reality expertise proposing tangible interfaces for data review and visual editing for all the functions and configurations. Two case studies are presented and discussed: a real-time ''touch and see'' stress/strain simulation and a collaborative distributed design review session of an industrial component.
... A3-1 XII ADM International Conference - Grand Hotel - Rimini Italy - Sept. 5th-7th, 2001 Pa... more ... A3-1 XII ADM International Conference - Grand Hotel - Rimini Italy - Sept. 5th-7th, 2001 Page 2. ... Each of these subjects is going to be widely discussed in the following chapters. A3-2 XII ADM International Conference - Grand Hotel - Rimini Italy - Sept. 5th-7th, 2001 Page 3. ...
Design of scaffolds for tissue engineering entails multi-disciplinary and multi-scale aspects. Si... more Design of scaffolds for tissue engineering entails multi-disciplinary and multi-scale aspects. Since in vivo analysis of the tissue regeneration process is quite difficult in terms of selecting experimental protocols and requires considerable amount of time, a variety of numerical models have been developed to simulate mechanisms of tissue differentiation. The tremendous enhancement in computing power led researchers to develop more and more sophisticated models mostly based on finite element techniques and mechano-regulation computational models. In this article, we present an algorithm that combines the finite element model of an open-porous scaffold, a numerical optimization routine and a mechanobiological model. This algorithm has been utilized to determine both, the best scaffold geometry and the best load value (to apply on the scaffold) that allow the bone formation to be maximized.
Abstract The application of augmented reality in industrial environments requires an effective vi... more Abstract The application of augmented reality in industrial environments requires an effective visualization of text on a see-through head-mounted display (HMD). The main contribution of this work is an empirical study of text styles as viewed through a monocular optical see-through display on three real workshop backgrounds, examining four colors and four different text styles. We ran 2,520 test trials with 14 participants using a mixed design and evaluated completion time and error rates. We found that both presentation mode and ...
Design review of CAD assemblies using bimanual natural interface Michele Fiorentino (a), Rafael R... more Design review of CAD assemblies using bimanual natural interface Michele Fiorentino (a), Rafael Radkowski (b), Christian Stritzke (b), Antonio E. Uva (a), Giuseppe Monno (a)
Title: Moire-holographic evaluation of the strain fields at the weld toes of welded structures. A... more Title: Moire-holographic evaluation of the strain fields at the weld toes of welded structures. Authors: Pappalettere, Carmine; Trentadue, Bartolo; Monno, Giuseppe. Affiliation: AA(Univ. of Bari). Publication: Proc. SPIE Vol. 1554B ...
We have developed a pen device for CAD applications in virtual reality which provides novel featu... more We have developed a pen device for CAD applications in virtual reality which provides novel features compared to existing systems. The SenStylus consists of a wireless pen designed to be ergonomically handled by the user for spatial interaction using a six degree of freedom optical tracking. In addition to the classic digital button(s) input, it provides analog multi-axial control, and a dual-rumble feedback output. We have integrated the device into an existing virtual reality CAD environment and extended the application functionalities with new devicespecific features. The SenStylus vibration feedback improves perception in the virtual world by controlling frequency, amplitude, and duration of the feedback, simulating a variety of responses during collisions and selection tasks. This capability enforces the visual depth sensitivity, which is critical when wo rking with complex CAD models. The multi-axial analog input provides a natural interaction paradigm to the user, thus simulating pen pressure and angle as in real world sketching and in real clay modeling. Dynamic tool-tip dimensioning and shaping are implemented as extra features. We present some applications to prove the added value of the SenStylus. The evaluation of the device received positive feedback by designers and engineers alike. The new features offered by this device can easily be extended to other VR applications using the API provided.
CiteSeerX - Document Details (Isaac Councill, Lee Giles): It is imperative for CAD, solid modelin... more CiteSeerX - Document Details (Isaac Councill, Lee Giles): It is imperative for CAD, solid modeling, grid generation, and data exchange applications that a complicated, surface-based geometry definition does not contain discontinuities in the form of overlapping surfaces, gaps between ...
Text legibility in augmented reality with optical see-through displays can be challenging due to ... more Text legibility in augmented reality with optical see-through displays can be challenging due to the interaction with the texture on the background. Literature presents several approaches to predict legibility of text superimposed over a specific image, but their validation with an AR display and with images taken from the industrial domain is scarce. In this work, we propose novel indices extracted from the background images, displayed on an LCD screen, and we compare them with those proposed in literature designing a specific user test. We collected the legibility user ratings by displaying white text over 13 industrial background images to 19 subjects using an optical see-through head-worn display. We found that most of the proposed indices have a significant correlation with user ratings. The main result of this work is that some of the novel indices proposed had a better correlation than those used before in the literature to predict legibility. Our results prove that industria...
Uploads
Papers by Giuseppe Monno