Academia.eduAcademia.edu

Realization of PLM application integration with AR technology

2020, Vol11 - Issue 4

The Augmented Reality (AR) can be used to simulate and improve production processes in a virtual manufacturing system before their physical implementation. These techniques make it possible to connect the real world with the virtual one in real time and in a threedimensional environment. Their effective application to the implementation of the product development phases would significantly limit its subsequent reworking and modifications. The difficulty, however, is to design and integrate AR with virtual production systems. The paper presents a proposal for a technical procedure for the implementation of the integration of a commercial PLM and a proprietary AR system.

ISSN 2683-345X journal homepage: http://ijiemjournal.uns.ac.rs/ International Journal of Industrial Engineering and Management Volume 11 / No 4 / December 2020 / 263 - 274 Original research article Realization of PLM application integration with AR technology J. Duda a*, S. Oleszek b a Politechnika Krakowska, Kraków, Polska; b Transition Technologies PSC sp. z o.o., Łódź, Polska ABSTRACT ARTICLE INFO The Augmented Reality (AR) can be used to simulate and improve production processes in a virtual manufacturing system before their physical implementation. These techniques make it possible to connect the real world with the virtual one in real time and in a threedimensional environment. Their effective application to the implementation of the product development phases would significantly limit its subsequent reworking and modifications. The difficulty, however, is to design and integrate AR with virtual production systems. The paper presents a proposal for a technical procedure for the implementation of the integration of a commercial PLM and a proprietary AR system. Received November 1, 2020 Revised December 11, 2020 Accepted December 14, 2020 Published online December 22, 2020 Article history: Keywords: Augmented Reality; CAx; Product Lifecycle Management *Corresponding author: Jan Duda [email protected] 1. Introduction Augmented reality includes techniques for adding virtual objects to the real world [1]. Augmented reality techniques are therefore defined as those who, in real-time and in a three-dimensional environment, make it possible to connect the real world with the virtual one [2,3]. In other words, the AR system is a system that connects the real world with a computer-generated world. The Virtual Factory (VF) paradigm is the basis for dealing with the problem of implementing method- ologies to support the design of production systems, processes, simulation, production control, visualization, and others. The ideal implementation of a virtual factory should therefore include the creation of a comprehensive, integral, upgradeable, and scalable representation of the actual factory. It should provide a virtual representation of buildings, resources, processes, and products. The entire factory should be simulated as a continuous and coherent digital model that can be used throughout the entire product lifecycle - from the product idea to the final disassembly of production plants and buildings [4]. Published by the University of Novi Sad, Faculty of Technical Sciences, Novi Sad, Serbia. This is an open access article distributed under the CC BY-NC-ND 4.0 terms and conditions DOI: http://doi.org/10.24867/IJIEM-2020-4-27 264 Duda and Oleszek 2. Management of development phases based on a common model of a product, process, and resource data 3. PLM system architecture integrated with the service performing tasks related to AR technologies A modern company has to cope with the co-evolution of products, processes, and production systems through strategic and operational management, promotion of engineering changes depending on market requirements, and the dynamics of legislative changes. The essence of these changes is to manage the implementation of development phases based on a common model of a product, process, and resource data (Product, Process, Resource; Figure 1). One way to implement the idea of a virtual factory is to use PLM class systems [5,6]. They integrate a set of applications supporting product development, which include [7]: Modern PLM systems operate according to the client-server model and communication between system clients (the client can be a web browser, another system or system component), and the system is based on HTTP protocol, i.e., in request-response mode. Thus, it is possible to propose a generalized PLM system architecture integrated with modules performing tasks related to VR or AR technologies. The architectural pattern of WWW application for the client-server system in the most general sense assumes organizing the whole system into three layers: data (also referred as persistence layer, includes i.a. database of the system and file server), application (also called processing or business layer) and presentation (client) [13]. At the level of the application layer, where PLM system services realizing business logic are located, an application performing tasks related to the preparation of data for use in VR or AR environments may be integrated. These tasks may include e.g. conversion of 3D data from native engineering formats (.prt, .CATPart, .sldprt, etc.) to a neutral or lightweight format, which enables easier transfer via HTTP protocol and easier display in mobile multimedia applications. They can also be more complex tasks, i.e. processing and preparing 3D models in such a way that they can be used directly in client applications, e.g. in mobile applications or augmented or virtual reality glasses. Response information from the client application, e.g. in the form of metadata, can be sent directly to the PLM system business layer - for further processing - via communication protocol requests. A proposal of a generalized • Product and Portfolio Management (PPM), • Computer-aided technologies (CAx), • Manufacturing Process Management (MPM), • Product Data Management (PDM). Although these systems provide support for most areas related to the planning and design phases and effectively support product data management and process virtualization, they do not provide certain functionalities relevant to business needs, especially in the area of interoperability [8,9,10]. As a result, the whole process of virtual factory realization cannot be carried out with the use of PLM systems in a continuous and coherent way. This is particularly visible in the lack of integration between technologies and data models used in the product design and the production systems design phases [11]. The concept of integration of development phases is discussed in the paper [12]. Figure 1. Management of development phases based on a common model of product, process, and resource data International Journal of Industrial Engineering and Management Vol 11 No 4 (2020) Duda and Oleszek 265 PLM system architecture integrated with the service performing tasks related to VR and AR technologies is presented in Figure 2. 4. The proposal of the procedure for the technical implementation of PLM system integration with AR techniques This section presents the concept of the procedure for the technical implementation of the integration of the PLM commercial system with the proprietary AR system, where the integration of an advanced CAx class system with a mobile application - in which the AR technology has been applied - was accomplished. This solution enables 3D modeling activities (based on product configurators’ techniques) directly in an AR environment. Simultaneously, in the CAx system, a parametric 3D model is created in a fully automated way [14]. The AR system consists of three components: (1) A mobile application created in Unity3D environment [15], in which the Vuforia [16] augmented reality library was used, (2) CAx class system, (3) An integration module in the form of an application created with the use of the CAx system programming interface in VB.net language, the aim of which is to provide communication with the mobile application and control the automated operations of the CAx system. The goal of the presented concept of PLM and AR systems integration is: • implementation of centralized management of standard elements, which are used in the process of modeling and configuration, based on the principles of standards management in PLM system (permission control, versioning, etc.), • integration of the developed configuration method in the AR environment with a consistent product lifecycle management process, • implementation of history tracking, status and state management, and versioning of modeled product concepts during their development, • introducing the possibility of a formalized version approval process for the product created by the customer during the configuration process. According to the authors’ intention, an integrated, uniform environment, including the PLM and AR systems, should allow for all configuration and modeling activities in the AR environment, as developed in [14]. However, all these activities should be performed within a PLM environment. Hence, it is necessary to automate operations such as: • establishing a connection between the AR and the PLM systems, Figure 2. The generalized architecture of the PLM system integrated with the service performing tasks related to VR and AR technologies International Journal of Industrial Engineering and Management Vol 11 No 4 (2020) 266 Duda and Oleszek • loading elements used in the configuration process from the PLM system standard library, •saving the 3D model developed in the process of configuration to the development container of the PLM system, •management of the status and lifecycle state of the 3D model developed in the configuration process, •end of session and logout from the PLM system. The procedure for the implementation of the above-mentioned activities using BPMN notation is discussed in the paper [12]. 5. Technical implementation of PLM system integration with the AR system - the procedure This section presents the procedure for the technical implementation of the integration of the proprietary AR system, which was presented in Section 4, with the commercial PLM system – PTC Windchill. The utilitarian goal of the AR system developed in [14] was to improve the efficiency of the product design process (as illustrated with the example of glass containers) through the active involvement of the (so far passive) user who orders a new product. The aim of the research was an attempt to answer the question of how to shorten the process of developing a new glass container, and thus, how to reflect the customer’s requirements in terms of obtained geometrical shape faster and more precisely, and at the same time reduce the costs associated with the project. The expected improvement should result from the correlation of the applied automation techniques used in product configurators and AR computer techniques. Compared with the conventional method of designing a product (using a CAx system), while using AR environment one can see and test a product in its target context during the process of designing (e.g. on a store shelf or next to the existing products). Consequently, one does not always need a physical prototype, because he or she is allowed to see more and thus, better understand the product. Therefore, the developed AR system should enable supporting the users in the process of designing glass containers in the following stages of the technical means development process: 1. the process of conceptualization, including: a. preliminary talks with the client regarding the development and selection of optimal concepts, b. gathering the requirements regarding a new project from the client, c. selection and comparison of variants of the virtual container models visible in the surroundings of the existing products, 2. design and configuration processes in the AR environment, including: a. developing a project and carrying out analyses regarding the appearance and shape with the active participation of the client, b. quickly developing many new variants and presenting them in the real world environment (e.g., surrounded by already existing, real-life glass containers), c. quickly introduce changes to new or existing 3D models of containers, d. analysis and evaluation of the developed 3D models in the target context, where the final product will appear, e.g., on a store shelf, on a table, on a shop window, etc., e. reconstruction of existing projects for which there is no digital documentation in the form of 3D models, f. shortening the time of creating a parametric model in the design office, 3. confirmation and faster approval of the requirements and the final project: a. on the side of the client ordering a new product, including the possibility of presenting the developed project without the need to order physical prototypes, b. on the manufacturer’s side, including the possibility of assessing and carrying out analyzes at various stages of the production process using a 3D model displayed in a given context against the background of the real world. As indicated in Section 4, the purpose of developing the AR system integration with the PLM environment was to integrate the developed method of supporting the design process in the AR environment with a uniform product lifecycle management process in the PLM environment. Thanks to this integration, it was possible to significantly expand the possibilities and improve the developed method and AR system. According to the authors, the greatest advantages are observed in the functionalities related to the versioning capabilities available in the PLM system, tracking and storing the history of design data, managing their state and status, as well as the ability to manage ac- International Journal of Industrial Engineering and Management Vol 11 No 4 (2020) Duda and Oleszek 267 cess and authorizations to modify them. Thanks to the introduction of a centralized and secure, based on the principles underlying the PLM system, the method of managing the design components used in the configuration process, and the product models developed as part of the configuration process, the security of this data has also significantly increased. Integration with the PLM system also enabled the formal approval process of virtual product models developed in the configuration process with the use of an automated workflow. PTC Windchill system is an advanced PLM class system, which is used in an organization as a collaborative environment. It aims at developing products and manages their lifecycle. PTC Windchill includes many modules and functionalities that comprehensively support the management of all stages of the product development process [17]. Two components of this system were used to carry out the research: • an advanced CAx class system – Creo Parametric, • PDM module – PDMLink. All actions performed by the user in the system during the configuration process are carried out using a mobile device. During design activities, communication between the AR system and the PLM system is performed in the background through the integration module, which acts as a communication interface in the system. Communication between the mobile device on which the AR system operates and the PLM system is carried out using the TCP/IP protocol, and the data is sent in two formats: • XML (Extensible Markup Language) – metadata and parameters, • OBJ – 3D models. The integrating module, in addition to ensuring data exchange between AR and PLM systems, also acts as a tool that automates design activities in Creo Parametric and activities in the PLM system, mainly related to CAD data management and changing their statuses. The class of the product that is configured in the described example remains the same as in [14] – they are glass containers. As it was presented in [12], activities in an integrated AR and PLM environment consist of the following steps: 1. Starting the configuration process, 2. Creating initial product shape in the AR environment, 3. Generating a parametric model in the CAx system, 4. Editing dimensional parameters of the 3D model, 5. Saving the created model in the PLM system, 6. Finishing the process. The activities in all steps listed above will be presented and further explained later in this section. 5.1 Starting the configuration process In the first step, the user runs the AR application on a mobile device (smartphone or tablet) and begins the design process. At the start of the configuration process in the AR application, the CAx system is launched on the server, and the user is logged into the PLM system in an automated manner. After this operation, a new session is created. Compared to the solution developed in [14], some significant changes have been introduced in the AR application. In the original version of the application, virtual models were positioned with the use of specially developed markers in the form of colorful images printed on paper. Such a tracking system is classified as marker-based AR. In the configuration process, four markers were used, one for each part of the container model (body, finish, neck, and heel). The markers had to be in the field of view of the camera, and the virtual 3D model that was assigned to it was displayed in the place where the marker was located. In the current version of the application, a more modern solution has been adopted, which enables the display of virtual models directly on the planes of the real world, eliminating the need for markers. This solution is based on the operation of sensors embedded in mobile devices (including GPS, accelerometer, gyroscope), as well as on more advanced image processing algorithms than in the case of solution based on markers. The new approach uses the newer version of the Vuforia AR engine, and its markerless tracking functionality referred to as Ground Plane [18]. Consequently, the mobile devices that can be used to run the new version of the AR application have to meet the requirements specified on the Vuforia Developer Portal [19]. Advanced features, such as e.g., Ground Plane, require support for the Positional Device Tracker using Vuforia Fusion [20]. On the list of recommended devices that are enabled via Vuforia Fusion are those, which either support their respective platform provided device tracking technology ARKit/ARCore [21], or they have been calibrated by Vuforia to support Visual-Inertial Si- International Journal of Industrial Engineering and Management Vol 11 No 4 (2020) 268 Duda and Oleszek multaneous Localization And Mapping (VISLAM) algorithm [20]. The product configuration process has also been improved. In the original version of the solution, first, it was necessary to select all parts of the model on the dedicated markers, and only then could they be attached to the container body on the main marker. In the current version, all activities are carried out directly on the target model. The user selects the individual parts of the model and sees the result immediately. The configuration process begins with placing the starting model on the selected plane, which has been recognized by the system and is marked with a white rectangle on the screen of the mobile device (Figure 3). With the virtual model visible on the screen, the product configuration process can begin. In the presented example, the configuration process will be carried out using a real glass container, which will be used as an example to recreate a virtual model. 5.2 Creation of the initial product shape in the AR environment Design activities in the AR application are carried out using techniques taken from product configurators. This means that in the first stage of the design process, the user obtains the initial shape of the product by selecting predefined parts of the container model, i.e., the finish, neck, body, and heel. To start the configuration process, the user selects the CONFIG button from the user interface of the mobile application. After performing this action, possible configuration options for individual parts of the model are visible on the display screen menu (Figure 4). In the next steps, the user has the option of view- Figure 3. Placing the virtual model on the plane recognized by the AR application algorithm Figure 4. The menu from which the process of selecting individual parts of the 3D model of the glass container begins International Journal of Industrial Engineering and Management Vol 11 No 4 (2020) Duda and Oleszek 269 ing all available parts of the container model and comparing the shape of the virtual model with the physical container. The process of viewing a part of the model is shown in Figure 5. After selecting and confirming the initial shape of the virtual container model, the user can move to the second stage of the design process. Then it will be possible to edit the dimensional parameters and obtain the exact shape of the 3D model. 5.3 Generating a parametric model in the CAx system As the initial shape of the 3D model is approved, an XML file is generated in the AR application, in which information about the parts selected during the configuration process and the dimensional parameters of the obtained model are saved. In the second step, the generated file is sent to the server on which the PLM system is running. The data from the XML file is loaded into the integrating module. Then, on the basis of the information read from the file, the appropriate design template and parts of the container, referred to as parametric user-defined features (UDF), are searched for in the standard library of the PLM system. Copies of the template and UDF models are saved to the workspace of the PLM system, that is dedicated to the configuration process. The content of the workspace after loading all the objects that will be used in the configuration process is shown in Figure 6. In the next step, the automatic process of generating a parametric 3D model of the container is started. The template is loaded from the workspace to the CAx session, then the user-defined features are loaded and added to the template (neck, finish and heel). During this process there also occurs multiple, iterative updates of the built model based on the parameters read from the XML file and design rules embedded in user-defined features. The final effect Figure 5. The process of obtaining the initial shape of a 3D model of a glass container in the AR environment Figure 6. View of the PLM system workspace to which the objects that were used to create the parametric model in the CAx system were copied International Journal of Industrial Engineering and Management Vol 11 No 4 (2020) 270 Duda and Oleszek of the parametric 3D model generation process is shown in Figure 7. After generating a parametric 3D model, a macro that is run saves it to the lightweight OBJ format. Then, the exported 3D model is sent by the integration module to the mobile application. In the last step, carried out in the mobile application, the transferred model is loaded onto the AR scene and displayed on the screen of the mobile device. 5.4 Editing dimensional parameters of the 3D model In the second phase of the configuration process, one can obtain the exact shape of the created 3D model of the product by editing the selected dimensional parameters. Editing parameters is carried out by entering values in the appropriate fields in a dedicated menu of the mobile application. Once approved, the parametric model update process is initiated. It is very similar to the process described in section 5.3. The entered parameter values are saved to an XML file, and then the file is sent to the server where the PLM system is running. Data read from the file are loaded into the integration module and transferred to the CAx system. The parametric model generated in the previous step is updated to the new parameter values. After the update, the same automated procedure that was used to generate the 3D model in section 5.3 is repeated (a macro that is run saves the updated 3D model to the OBJ format, and then it is sent in this format to the mobile application). In the last step, the model updated on the AR scene is displayed on the screen of the mobile device. These steps are iteratively repeated until the desired shape of the designed product is achieved. The activities related to editing the model parameters are shown in Figure 8. Virtual model shape modification performed in order to obtain the desired shape may, in practice, consist of many iterations. For simplicity, the Figure shows only some intermediate steps. Figure 7. Parametric model of a glass container automatically created in the CAx system based on data sent from the AR application Figure 8. Subsequent (selected) iterations of the virtual model shape modification in the AR envi onment International Journal of Industrial Engineering and Management Vol 11 No 4 (2020) Duda and Oleszek 271 5.5 Saving the created model in the PLM system After obtaining the target shape, the model is saved in the mobile application. When saving, it is needed to give a name to the designed product. After doing this, the name of the parametric model, which is in the workspace of the PLM system and in the CAx system session, is changed to the name defined in the mobile application. In the next step, the checkin operation of the parametric model is performed in the PLM system. As a result, the status of the created model is changed to ‘checked in.’ The model is also copied to the folder defined in the configuration settings in the common space of the PLM system. Once this action is done, the created model is visible to all system users, and the formal process of its validation and approval can begin. Figure 9 depicts the view of the collaboration space. 5.6 Finishing the process After saving the model, a new design session can be started or work in the system can be finished. Ending the operation of the mobile application results in the removal of all existing data from the PLM system workspace. In the next step, the session in the PLM system is closed, and the operation of the CAx system is ended. The final effect of the glass container design process is shown in Figure. 10. On the left, there is a virtual model of the container in the AR environment, next to the existing bottle. The parametric model created automatically in the PLM system is shown on the right. 5.7 Assessment of the implemented solution This paper presents the results of the research involving proprietary AR system and the commercial PLM system software integration. In its original version, the AR system was developed as an independent solution, which included two components the AR application for mobile devices and the CAx system operating on the server. Communication and data exchange between these components was carried out through an integration module, which also ran on the server. All data, both input, i.e., design templates and parametric user-defined features, as well as output, i.e., the effect of the configuration process, were stored in specific locations, e.g., on local or network drives. Therefore, it was not possible to track the history of changes, implement a formal Figure 9. View of the common space after the completion of design acti ities Figure10. The completed virtual model of the container in the AR environment and the corresponding parametric model International Journal of Industrial Engineering and Management Vol 11 No 4 (2020) 272 Duda and Oleszek review and approval process, manage states, manage permissions, and easily share virtual models of the products being developed. Equally important, the input data was not secure enough as it could have been accidentally modified, overwritten or even unintentionally deleted. The failure of the disk or server with the data stored was also possible. The integration developed and presented in this work enables the elimination of all the above-mentioned difficulties and threats. Both the input data and the developed virtual models of products are stored in the PLM environment at every stage of the process. The input data, which are design templates and UDF models, are stored in a dedicated PLM context - in the standard library. All users who participate in the configuration process have access to the data stored in the library. However, editing rights have been restricted and granted only and exclusively to selected users who are authorized to modify and further develop these components. All activities related to the development of parametric models of products with the use of the AR mobile application are carried out in a dedicated workspace. During the configuration process, these data are not visible to other users of the PLM system. Nevertheless, at the end of the configuration process, they are automatically promoted to the next status and copied to the PLM commonspace, so that the design process can be continued immediately. All data in the PLM system are subject to the rules that apply in this system. It is of particular importance to track the history of their modifications, version control, status monitoring and data access protection based on the rights granted. The data cannot be deleted or modified in an accidental and uncontrolled way. Data security in PLM systems is also ensured by a specially designed system and hardware architecture, which eliminates the risks associated with failures or other random events. During the work related to the development of integration, modifications to the AR system itself were also introduced. The first modification is related to the change of the marker-based tracking system to a newer solution that allows displaying virtual models without the use of markers. This solution introduces much greater flexibility. In the original solution, the configuration process could not be carried out without markers at all, so it was necessary to print them in the required quality and manage them in such a way that they were available at the time and in the place where the configuration process was carried out. The new tracking system completely eliminates these inconveniences. However, the markerless tracking system has some drawbacks. Although the surfaces are recognized by the algorithm very quickly, its operation to a much greater extent than in the case of a marker-based solution depends on the lighting of these surfaces. In case of insufficient lighting conditions, the surfaces may not be recognized at all or there may be errors related to the inappropriate scale of the virtual model in relation to the environment. The model may also be displayed in an unstable manner, e.g. its position may be changed randomly, there may be a shaking effect of the model or it may disappear temporarily. The second modification that was introduced in the AR system during the research was the change of a way the 3D model configuration process of the container is presented. The original solution, where only one part class was assigned to one dedicated marker, has been replaced with a more convenient solution, where the entire process is carried out in the target context. In the first version, the configuration had to be carried out gradually. First, the user selected individual parts from the available resources using dedicated marker, and then put them together into a complete model on one main marker. Changing the part placed on the model, e.g. the neck, also took place in many stages. First, it was necessary to remove the existing part from the model, then the user selected a new part using the appropriate marker, and then reinserted the selected part into the model. In the present solution, the whole process runs in a very natural way, and the user at every stage of the process performs actions in the target context. All changes in the configured model are presented in real-time. However, the authors see the possibilities of refining the user interface of the AR application in order to improve ergonomics, better use of the possibilities of touch operation, and to implement gesture control. 6. Discussion and Conclusions This paper presents practical definitions of virtual and augmented reality and virtual factory. The authors highlighted that one of the possible, although not perfect, implementations of the virtual factory paradigm is using modern PLM systems. In these systems, AR and VR technologies can be implemented at the presentation layer level. However, this requires the development and integration of additional services with the PLM system, the purpose of which is to carry out tasks related to data conversion and processing in a specific way (depending on the technology and purpose) so that they can be displayed in International Journal of Industrial Engineering and Management Vol 11 No 4 (2020) Duda and Oleszek 273 AR or VR devices. The paper also proposes a concept of PLM system integration with AR techniques based on generalized PLM system architecture. This concept is based on the assumption that at the level of the application layer integrated with the PLM system, there is a software service by means of which tasks related to AR technologies are performed. The next part of the paper presents the proposal of the procedure of the technical realization of integration based on the example of a commercial PLM and multi-module proprietary AR systems. The aim and benefits of obtaining a uniform PLM and AR environment have been defined, and additional functionalities that are possible to achieve (e.g. version control, statuses and states management, management of elements used in the configuration process based on the principles of the standards library in the PLM system) have been highlighted. The last part of the work presents the procedure of the integration of the proprietary AR system with the commercial PLM system. The implemented integration significantly improves the product configuration process in the AR environment. The most important advantages are: ensuring security and a much better-organized data management process (tracking data change history, protection against accidental modification). The PLM environment also facilitates the possibility to implement the design process collaboratively, as the parametric model developed in the AR environment is automatically made available in the common space of the PLM system. The developed integration is a prototype solution, so in order to implement it in the production environment, it is necessary to introduce improvements, especially in the area of code quality of the developed programs. Further research in the area of the tracking process may also be necessary to ensure greater stability of the display of virtual models in the AR environment. Nevertheless, thanks to the developed solution, numerous advantages of implementing AR technology in the PLM environment have been proven and confirmed. The unquestionable synergy resulting from the interaction of these technologies makes it possible to set directions for further research in this area. In the opinion of the authors, one of the most important is the use of both techniques, AR and VR, to support activities in the remaining stages of the product lifecycle, not only in the area of the design process. Another direction, which in the opinion of the authors is worth following, is the use of the AR system developed in [14] in a different than glass containers product domain. The authors also see oppor- tunities to improve the operation of the AR system from a technical point of view. The greatest benefit would be changing the existing communication protocol (that allows the exchange of data between the mobile application and PLM system) to the most popular HTTP protocol. This would enable the use of a universal REST (Representational State Transfer) communication interface [22-23]. As a result, the development of the system in this direction would enable easier integration of the mobile application with other commercial PLM systems. Acknowledgments This paper is an extended version of the original article published in the 41st IFIP International Conference on Advances in Production Management Systems (APMS2020) [12]. Funding This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. References [1] S.Mann, Intelligent image processing. Adaptive and learning systems for signal processing, communications, and control. IEEE, New York, NY, United States 2002. [2] W. Barfield, Fundamentals of wearable computers and augmented reality. 2nd ed., CRC Press, NW Boca Raton, FL, United States, 2015. [3] M. Januszka, Metoda wspomagania procesu projektowania i konstruowania z zastosowaniem poszerzonej rzeczywistości. PhD thesis, Silesian University of Technology, Gliwice, 2012. [4] G. Ghielmini, P. Pedrazzoli, D. Rovere, W. Terkaj, C. R. Boer, G. Dal Maso, F. Milella, M. Sacco. “Virtual Factory Manager for semantic data handling,” CIRP Journal of Manufacturing Science and Technology, vol. 6, pp. 281291, 2013. doi:10.1016/j.cirpj.2013.08.001 [5] J. Stark, Product Lifecycle Management (PLM), Product Lifecycle Management (Volume 1). Decision Engineering, Springer, Geneva, Switzerland, 2020, doi: 10.1007/978-3-030-28864-8. [6] A. Saaksvuori, A. Immonen, Product lifecycle management (third edition). Springer, Heidelberg, Germany, 2008. [7] J. Duda, Zarządzanie rozwojem wyrobów w ujęciu systemowym. Cracow University of Technology 2016. [8] W. Terkaj, G. Pedrielli, M. Sacco, “Virtual Factory Data Model,” CEUR Workshop Proceedings, vol. 886, pp. 29-43, 2012 [9] T. Tolio, D. Ceglarek, H.A. ElMaraghy, A. Fischer, S. Hu, L. Laperrière, S. Newman, J. Váncza, “SPECIES - Coevolution of Products, Processes and Production Systems,” CIRP Annals - Manufacturing Technology, vol. 59, No. 2, pp. 672-693, 2010, doi: 10.1016/j.cirp.2010.05.008 [10] T. Tolio, M. Sacco, W. Terkaj, M. Urgo, “Virtual Factory: International Journal of Industrial Engineering and Management Vol 11 No 4 (2020) 274 Duda and Oleszek an Integrated Framework for Manufacturing Systems Design and Analysis,” Forty Sixth CIRP Conference on Manufacturing Systems, 2013. [11] M. Lafleur, W. Terkaj, F. Belkadi, M. Urgo, A. Bernard, M. Colledani, “An Onto-Based Interoperability Framework for the Connection of PLM and Production Capability Tools,” pp. 134-145, 2016, doi: 10.1007/978-3-319-54660 -5_13 [12] J. Duda, and S. Oleszek, “Concept of PLM Application Integration with VR and AR Techniques,” in IFIP Advances in Information and Communication Technology, 2020, vol. 592 IFIP, pp. 91-99, doi: 10.1007/978-3-030-57997-5_11, 2020. [13] J. E. Sienkiewicz, P. Syty, “Architektura warstwowa aplikacji internetowych. Oblicza Internetu,” Conference Proceedings, PWSZ, Elblag (2008). [14] S. Oleszek, „Metoda wspomagania projektowania naczyń szklanych z zastosowaniem konfiguratora w środowisku poszerzonej rzeczywistości,”. PhD disertation, Silesian Univ. of Tech., Gliwice, 2018. [15] E. Lavieri. Getting Started with Unity 2018 - Third Edition: A Beginner’s Guide to 2D and 3D Game Development with Unity, Packt Publishing Ltd, 2018. [16] J. Linowes, K. Babilinski, Augmented Reality for Developers: Build practical augmented reality applications with Unity, ARCore, ARKit, and Vuforia. Packt Publishing Ltd, 2017. [17] PTC Windchill PLM Solutions, “PTC University”, https://precisionlms.ptc.com/viewer/course/en/34668550/ page/34668556 [Accessed: 07-Dec-2020]. [18] Vuforia, “Unity User Manual”, https://docs.unity3d. com/2017.4/Documentation/Manual/vuforia-sdk-overview. html [Accessed: 03-Oct-2020]. [19] Recommended Devices, “Vuforia Developer Library”, https://library.vuforia.com/content/vuforia-library/en/ platform-support/vuforia-engine-recommended-devices. html [Accessed: 08-Dec-2020]. [20] Vuforia Fusion, “Vuforia Developer Library”, https://library .vuforia.com/content/vuforia-library/en/articles/Training /vuforia-fusion-article.html [Accessed: 08-Dec-2020]. [21] P. Nowacki, M. Woda, “Capabilities of ARCore and ARKit Platforms for AR/VR Applications,” Engineering in De pendability of Computer Systems and Networks, pp. 358370. Edition: 987, Springer, 2020, doi: 10.1007/978-3-03019501-4_36. [22] H. A. Nguyen, H. Nguyen, H. T. Nguyen, A. C. Phan, and Y. Matsui, “Empirical study on the role of collaboration in new product development in manufacturing companies,” Int. J. Qual. Res., vol. 12, no. 2, pp. 363–384, 2018, doi: 10.18421/IJQR12.02-05. [23] M. Masse, REST API Design Rulebook. Oreilly and Associate Series, O’Reilly Media, 2011. International Journal of Industrial Engineering and Management Vol 11 No 4 (2020)