We present the WASABI 1 Song Corpus, a large corpus of songs enriched with metadata extracted fro... more We present the WASABI 1 Song Corpus, a large corpus of songs enriched with metadata extracted from music databases on the Web, and resulting from the processing of song lyrics and from audio analysis. More specifically, given that lyrics encode an important part of the semantics of a song, we focus here on the description of the methods we proposed to extract relevant information from the lyrics, such as their structure segmentation, their topics, the explicitness of the lyrics content, the salient passages of a song and the emotions conveyed. The corpus contains 1.73M songs with lyrics (1.41M unique lyrics) annotated at different levels with the output of the above mentioned methods. The corpus labels and the provided methods can be exploited by music search engines and music professionals (e.g. journalists, radio presenters) to better handle large collections of lyrics, allowing an intelligent browsing, categorization and recommendation of songs. We demonstrate the utility and versatility of the WASABI Song Corpus in three concrete application scenarios. Together with the work on the corpus, we present the work achieved to transition the dataset into a knowledge graph, the WASABI RDF Knowledge Graph, and we show how this will enable an even richer set of applications.
We present the WASABI 1 Song Corpus, a large corpus of songs enriched with metadata extracted fro... more We present the WASABI 1 Song Corpus, a large corpus of songs enriched with metadata extracted from music databases on the Web, and resulting from the processing of song lyrics and from audio analysis. More specifically, given that lyrics encode an important part of the semantics of a song, we focus here on the description of the methods we proposed to extract relevant information from the lyrics, such as their structure segmentation, their topics, the explicitness of the lyrics content, the salient passages of a song and the emotions conveyed. The corpus contains 1.73M songs with lyrics (1.41M unique lyrics) annotated at different levels with the output of the above mentioned methods. The corpus labels and the provided methods can be exploited by music search engines and music professionals (e.g. journalists, radio presenters) to better handle large collections of lyrics, allowing an intelligent browsing, categorization and recommendation of songs. We demonstrate the utility and versatility of the WASABI Song Corpus in three concrete application scenarios. Together with the work on the corpus, we present the work achieved to transition the dataset into a knowledge graph, the WASABI RDF Knowledge Graph, and we show how this will enable an even richer set of applications.
HAL (Le Centre pour la Communication Scientifique Directe), Dec 4, 2019
The development and porting of virtual instruments or audio effects on the Web platform is a hot ... more The development and porting of virtual instruments or audio effects on the Web platform is a hot topic. Several initiatives are emerging, from business enterprise based ones (Propellerhead Rack Extension running on the Web), to more community based 1 open-source projects [10]. Most of them aim to facilitate adapting existing code base (usually developed in native languages like C/C++) as well as facilitating the use of existing audio DSP languages and platforms. Our group previously presented an open format for WebAudio Plugins named WAP [11]. It aims to facilitate the interoperability of audio/MIDI plugins developed either using pure Web APIs, porting existing native code bases, or using Domain Specific Languages (DSL). In the DSL category, we already did developments to use the FAUST audio DSP language. In this paper, we present a solution based around FAUST, its redesigned Web based editor, and the integration of a plugin GUI editor allowing to directly test, generate and deploy WAP plugins. Recent improvements done in the toolchain, going from the DSP source to a ready-to-use WAP compatible plugin will be presented. The complete workflow, from the Faust DSP source written and tested in a fully functional editor, to a self-contained plugin running in a separate host application, will be demonstrated.
We propose to demo an online IDE based around the FAUST DSP audio language that includes a source... more We propose to demo an online IDE based around the FAUST DSP audio language that includes a source code editor, an embedded compiler and a GUI editor allowing to directly test, generate and deploy WebAudio Plugins (WAP). The tool is available online.
HAL (Le Centre pour la Communication Scientifique Directe), Dec 4, 2019
We propose to demo an online IDE based around the FAUST DSP audio language [1], that includes a s... more We propose to demo an online IDE based around the FAUST DSP audio language [1], that includes a source code editor, embedded compiler and GUI editor allowing to directly test, generate and deploy WebAudio Plugins (WAP). The tool is available online .
In this paper, we present the Virtual Diver project. The goal of the project is to apply Virtual ... more In this paper, we present the Virtual Diver project. The goal of the project is to apply Virtual Reality methods to the interactive exploration of artificial reefs. We concentrate here on the process of fusing geometric and photometric information in order to present a more realistic simulation. We present aspects of our adaptation of camera calibration methods registering a CAD model with images, and a novel texture-mapping algorithm based on the Z-buffer.
Cet article decrit principalement un bouquet de services mobiquitaires base sur un robot mobile e... more Cet article decrit principalement un bouquet de services mobiquitaires base sur un robot mobile et un environnement d’objets communicants, qui permet de faciliter la vie de personnes en situation de dependance. RoboDOMO est un prototype de robot d’assistance ; il est capable d’integrer et fournir des informations en provenance de multiples sources sans fil, de faciliter la communication avec une tierce personne grâce a la visioconference, ou encore d’etre pilote a distance par le telephone mobile de la famille ou du corps medical. La mise en œuvre de RoboDOMO et de son environnement d’objets communicants (capteurs, tags NFC, etc.) au sein d’une architecture standardisee ouverte est presentee dans son contexte pluridisciplinaire.
2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics
In the emerging field of E-Commerce we show the great potential interest to create 3D virtual sho... more In the emerging field of E-Commerce we show the great potential interest to create 3D virtual shopping centers. The study of a specific application: the creation of an electric household applicants warehouse enables us to highlight the possibilities of the VRML2.0 language to model, visualize and to do interactive walking inside the warehouse. Key features of VRML 2.0 are underlined and new extensions are proposed in order to achieve a better realistic and «human-like» behavior inside the virtual warehouse.
This article describes the work at INRIA on obstacle avoidance and trajectory planning for a mobi... more This article describes the work at INRIA on obstacle avoidance and trajectory planning for a mobile robot using stereo vision. Our mobile robot is equipped with a trinocular vision system that is being put into hardware and will be capable of delivering 3-D maps of the environment at rates between 1 and 5 Hz. The 3-D maps contain line segments extracted from the images and reconstructed in three dimensions. They are used for a variety of tasks, including obstacle avoidance and trajectory planning.
Sharing and indexing the resources available on the Web raises several issues that systems based ... more Sharing and indexing the resources available on the Web raises several issues that systems based on folksonomies (Vanderwal, 2004), such as del.icio.us for sharing bookmarks, have recently tried to address. The Semantic Web aims at supporting the exchange of information by developing the interoperability between applications available on the Web. To this end, several methods, tools and principles are proposed, among which formal ontologies play a central role. Generally, ontologies are defined as knowledge representations aiming at “specifying explicitly a conceptualization” (Gruber, 1993). More specifically, formal ontologies use formal semantics to specify this conceptualization and make it understandable by machines. The obstacles to a generalization of ontologies lie mainly in their cost of design and maintenance. Web 2.0 is a successful evolution of the Web supported by some principles and technologies. Social tagging and the resulting folksonomies are examples of technologies that have emerged and met a growing success within Web 2.0 applications. The simplicity of tagging combined with the culture of exchange allows the mass of users to share their annotations on the mass of resources. However, the exploitation of folksonomies raises several issues highlighted by Mathes (2004) and by Passant (2009):
Ce papier décrit WikiNEXT, un moteur de wiki créé pour la rédaction des applications web qui expl... more Ce papier décrit WikiNEXT, un moteur de wiki créé pour la rédaction des applications web qui exploitent le web de données directement dans le navigateur web. WikiNEXT est un wiki à la croisée des wikis et des outils de développement en ligne (« web based IDEs 1 »), ce qui fait son originalité. WikiNEXT propose aujourd'hui des fonctionnalités et une interface plutôt orientée vers les développeurs web voulant manipuler des données sémantiques à l'aide des technologies « front end » (JavaScript/HTML5), et offre des moyens pour bénéficier de services proposés par le wiki pour la persistance côté serveur, en fournissant notamment une base de données de graphe compatible RDF/SPARQL 1.1, et une base de données objet.
2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, 2011
Building on top of our results on semantic social network analysis, we present a community detect... more Building on top of our results on semantic social network analysis, we present a community detection algorithm, SemTagP, that takes benefits of the semantic data that were captured while structuring the RDF graphs of social networks. SemTagP not only offers to detect but also to label communities by exploiting (in addition to the structure of the social graph) the tags used by people during the social tagging process as well as the semantic relations inferred between tags. Doing so, we are able to refine the partitioning of the social graph with semantic processing and to label the activity of detected communities. We tested and evaluated this algorithm on the social network built from Ph.D. theses funded by ADEME, the French Environment and Energy Management Agency. We showed how this approach allows us to detect and label communities of interest and control the precision of the labels.
Handbook of Research on Methods and Techniques for Studying Virtual Communities
In this chapter we present our approach to analyzing such semantic social networks and capturing ... more In this chapter we present our approach to analyzing such semantic social networks and capturing collective intelligence from collaborative interactions to challenge requirements of Enterprise 2.0. Our tools and models have been tested on an anonymized dataset from Ipernity.com, one of the biggest French social web sites centered on multimedia sharing. This dataset contains over 60,000 users, around half a million declared relationships of three types, and millions of interactions (messages, comments on resources, etc.). We show that the enriched semantic web framework is particularly well-suited for representing online social networks, for identifying their key features and for predicting their evolution. Organizing huge quantity of socially produced information is necessary for a future acceptance of social applications in corporate contexts.
We present the WASABI 1 Song Corpus, a large corpus of songs enriched with metadata extracted fro... more We present the WASABI 1 Song Corpus, a large corpus of songs enriched with metadata extracted from music databases on the Web, and resulting from the processing of song lyrics and from audio analysis. More specifically, given that lyrics encode an important part of the semantics of a song, we focus here on the description of the methods we proposed to extract relevant information from the lyrics, such as their structure segmentation, their topics, the explicitness of the lyrics content, the salient passages of a song and the emotions conveyed. The corpus contains 1.73M songs with lyrics (1.41M unique lyrics) annotated at different levels with the output of the above mentioned methods. The corpus labels and the provided methods can be exploited by music search engines and music professionals (e.g. journalists, radio presenters) to better handle large collections of lyrics, allowing an intelligent browsing, categorization and recommendation of songs. We demonstrate the utility and versatility of the WASABI Song Corpus in three concrete application scenarios. Together with the work on the corpus, we present the work achieved to transition the dataset into a knowledge graph, the WASABI RDF Knowledge Graph, and we show how this will enable an even richer set of applications.
We present the WASABI 1 Song Corpus, a large corpus of songs enriched with metadata extracted fro... more We present the WASABI 1 Song Corpus, a large corpus of songs enriched with metadata extracted from music databases on the Web, and resulting from the processing of song lyrics and from audio analysis. More specifically, given that lyrics encode an important part of the semantics of a song, we focus here on the description of the methods we proposed to extract relevant information from the lyrics, such as their structure segmentation, their topics, the explicitness of the lyrics content, the salient passages of a song and the emotions conveyed. The corpus contains 1.73M songs with lyrics (1.41M unique lyrics) annotated at different levels with the output of the above mentioned methods. The corpus labels and the provided methods can be exploited by music search engines and music professionals (e.g. journalists, radio presenters) to better handle large collections of lyrics, allowing an intelligent browsing, categorization and recommendation of songs. We demonstrate the utility and versatility of the WASABI Song Corpus in three concrete application scenarios. Together with the work on the corpus, we present the work achieved to transition the dataset into a knowledge graph, the WASABI RDF Knowledge Graph, and we show how this will enable an even richer set of applications.
HAL (Le Centre pour la Communication Scientifique Directe), Dec 4, 2019
The development and porting of virtual instruments or audio effects on the Web platform is a hot ... more The development and porting of virtual instruments or audio effects on the Web platform is a hot topic. Several initiatives are emerging, from business enterprise based ones (Propellerhead Rack Extension running on the Web), to more community based 1 open-source projects [10]. Most of them aim to facilitate adapting existing code base (usually developed in native languages like C/C++) as well as facilitating the use of existing audio DSP languages and platforms. Our group previously presented an open format for WebAudio Plugins named WAP [11]. It aims to facilitate the interoperability of audio/MIDI plugins developed either using pure Web APIs, porting existing native code bases, or using Domain Specific Languages (DSL). In the DSL category, we already did developments to use the FAUST audio DSP language. In this paper, we present a solution based around FAUST, its redesigned Web based editor, and the integration of a plugin GUI editor allowing to directly test, generate and deploy WAP plugins. Recent improvements done in the toolchain, going from the DSP source to a ready-to-use WAP compatible plugin will be presented. The complete workflow, from the Faust DSP source written and tested in a fully functional editor, to a self-contained plugin running in a separate host application, will be demonstrated.
We propose to demo an online IDE based around the FAUST DSP audio language that includes a source... more We propose to demo an online IDE based around the FAUST DSP audio language that includes a source code editor, an embedded compiler and a GUI editor allowing to directly test, generate and deploy WebAudio Plugins (WAP). The tool is available online.
HAL (Le Centre pour la Communication Scientifique Directe), Dec 4, 2019
We propose to demo an online IDE based around the FAUST DSP audio language [1], that includes a s... more We propose to demo an online IDE based around the FAUST DSP audio language [1], that includes a source code editor, embedded compiler and GUI editor allowing to directly test, generate and deploy WebAudio Plugins (WAP). The tool is available online .
In this paper, we present the Virtual Diver project. The goal of the project is to apply Virtual ... more In this paper, we present the Virtual Diver project. The goal of the project is to apply Virtual Reality methods to the interactive exploration of artificial reefs. We concentrate here on the process of fusing geometric and photometric information in order to present a more realistic simulation. We present aspects of our adaptation of camera calibration methods registering a CAD model with images, and a novel texture-mapping algorithm based on the Z-buffer.
Cet article decrit principalement un bouquet de services mobiquitaires base sur un robot mobile e... more Cet article decrit principalement un bouquet de services mobiquitaires base sur un robot mobile et un environnement d’objets communicants, qui permet de faciliter la vie de personnes en situation de dependance. RoboDOMO est un prototype de robot d’assistance ; il est capable d’integrer et fournir des informations en provenance de multiples sources sans fil, de faciliter la communication avec une tierce personne grâce a la visioconference, ou encore d’etre pilote a distance par le telephone mobile de la famille ou du corps medical. La mise en œuvre de RoboDOMO et de son environnement d’objets communicants (capteurs, tags NFC, etc.) au sein d’une architecture standardisee ouverte est presentee dans son contexte pluridisciplinaire.
2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics
In the emerging field of E-Commerce we show the great potential interest to create 3D virtual sho... more In the emerging field of E-Commerce we show the great potential interest to create 3D virtual shopping centers. The study of a specific application: the creation of an electric household applicants warehouse enables us to highlight the possibilities of the VRML2.0 language to model, visualize and to do interactive walking inside the warehouse. Key features of VRML 2.0 are underlined and new extensions are proposed in order to achieve a better realistic and «human-like» behavior inside the virtual warehouse.
This article describes the work at INRIA on obstacle avoidance and trajectory planning for a mobi... more This article describes the work at INRIA on obstacle avoidance and trajectory planning for a mobile robot using stereo vision. Our mobile robot is equipped with a trinocular vision system that is being put into hardware and will be capable of delivering 3-D maps of the environment at rates between 1 and 5 Hz. The 3-D maps contain line segments extracted from the images and reconstructed in three dimensions. They are used for a variety of tasks, including obstacle avoidance and trajectory planning.
Sharing and indexing the resources available on the Web raises several issues that systems based ... more Sharing and indexing the resources available on the Web raises several issues that systems based on folksonomies (Vanderwal, 2004), such as del.icio.us for sharing bookmarks, have recently tried to address. The Semantic Web aims at supporting the exchange of information by developing the interoperability between applications available on the Web. To this end, several methods, tools and principles are proposed, among which formal ontologies play a central role. Generally, ontologies are defined as knowledge representations aiming at “specifying explicitly a conceptualization” (Gruber, 1993). More specifically, formal ontologies use formal semantics to specify this conceptualization and make it understandable by machines. The obstacles to a generalization of ontologies lie mainly in their cost of design and maintenance. Web 2.0 is a successful evolution of the Web supported by some principles and technologies. Social tagging and the resulting folksonomies are examples of technologies that have emerged and met a growing success within Web 2.0 applications. The simplicity of tagging combined with the culture of exchange allows the mass of users to share their annotations on the mass of resources. However, the exploitation of folksonomies raises several issues highlighted by Mathes (2004) and by Passant (2009):
Ce papier décrit WikiNEXT, un moteur de wiki créé pour la rédaction des applications web qui expl... more Ce papier décrit WikiNEXT, un moteur de wiki créé pour la rédaction des applications web qui exploitent le web de données directement dans le navigateur web. WikiNEXT est un wiki à la croisée des wikis et des outils de développement en ligne (« web based IDEs 1 »), ce qui fait son originalité. WikiNEXT propose aujourd'hui des fonctionnalités et une interface plutôt orientée vers les développeurs web voulant manipuler des données sémantiques à l'aide des technologies « front end » (JavaScript/HTML5), et offre des moyens pour bénéficier de services proposés par le wiki pour la persistance côté serveur, en fournissant notamment une base de données de graphe compatible RDF/SPARQL 1.1, et une base de données objet.
2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, 2011
Building on top of our results on semantic social network analysis, we present a community detect... more Building on top of our results on semantic social network analysis, we present a community detection algorithm, SemTagP, that takes benefits of the semantic data that were captured while structuring the RDF graphs of social networks. SemTagP not only offers to detect but also to label communities by exploiting (in addition to the structure of the social graph) the tags used by people during the social tagging process as well as the semantic relations inferred between tags. Doing so, we are able to refine the partitioning of the social graph with semantic processing and to label the activity of detected communities. We tested and evaluated this algorithm on the social network built from Ph.D. theses funded by ADEME, the French Environment and Energy Management Agency. We showed how this approach allows us to detect and label communities of interest and control the precision of the labels.
Handbook of Research on Methods and Techniques for Studying Virtual Communities
In this chapter we present our approach to analyzing such semantic social networks and capturing ... more In this chapter we present our approach to analyzing such semantic social networks and capturing collective intelligence from collaborative interactions to challenge requirements of Enterprise 2.0. Our tools and models have been tested on an anonymized dataset from Ipernity.com, one of the biggest French social web sites centered on multimedia sharing. This dataset contains over 60,000 users, around half a million declared relationships of three types, and millions of interactions (messages, comments on resources, etc.). We show that the enriched semantic web framework is particularly well-suited for representing online social networks, for identifying their key features and for predicting their evolution. Organizing huge quantity of socially produced information is necessary for a future acceptance of social applications in corporate contexts.
Uploads
Papers by M. Buffa