CCV, Touchlib, Reactivision, Tuio

Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

6/9/10

TUIO Touchlib | reacTIVision | CCV


TableMAT Software

TUIO
An open framework that de nes a common protocol and API for tangible multitouch surfaces. e TUIO protocol allows the transmission of an abstract description of interactive surfaces, including touch events and tangible object states. is protocol encodes control data from a tracker application (e.g. based on computer vision) and sends it to any client application that is capable of decoding the protocol.

6/9/10

Technically TUIO is based on Open Sound Control an emerging standard for interactive environments not only limited to musical instrument control - and can be therefore easily implemented on any platform that supports OSC.

Software Implementing TUIO


TUIO Application Frameworks: Java(MT4j), Python(PyMT), Pure Data( b_abs), Cocoa (Coconuit), QT(qtuio), Max/MSP(MMF), etc. TUIO Client Reference Implementations: C++, Java, C#, Processing, Pure data, Max/MSP, etc. TUIO Tracker Implementations: reacTIVision, Community Core Vision, Touchlib, etc.

6/9/10

Touchlib
A library for creating multi-touch interaction surfaces. It handles tracking blobs of infrared light, and sends your programs these multi-touch events, such as nger down, nger moved, and nger released. Does not provide you with any graphical or front end abilities - it simply passes you touch events. Can broadcast events in the TUIO. is makes Touchlib compatible with several other applications that support this protocol, such as Flash, VVVV, Processing, PureData, etc.

Why not Touchlib


Works only under Windows. For Mac OS X: Install Apple Developer Tools. Install Darwinports and required packages using Darwinports. Install OpenCV Install OSCPack Install SVN Install Touchlib

6/9/10

reacTIVision
An open source, cross-platform computer vision framework for the fast and robust tracking of ducial markers attached onto physical objects, as well as for multi-touch nger tracking. Mainly designed as a toolkit for the rapid development of table-based tangible user interfaces (TUI) and multi-touch interactive surfaces. Also able to send MIDI messages for the direct use with MIDI sequencers.

Available for the following operating systems: Windows, MacOS X and Linux. Windows: any camera with a proper WDM driver, such as USB, USB2, FireWire and DV cameras. MacOS X: all FireWire cameras and any camera supported by QuickTime will work in reacTIVision. Linux: FireWire cameras are best supported, as well as most Video4Linux2 USB cameras.

6/9/10

ow it works
1. Converted to a black&white image with an adaptive algorithm. 2. Searched for unique left heavy depth sequences, which have been encoded into the ducial symbol. 3. Match symbol to a dictionary to retrieve an unique ID number. OSC messages implementing the TUIO protocol encode the ducials' presence, location, orientation and identity and transmit this data to the client applications.

reacTIVision TUIO clients


C++ C# Java Processing Pure data Max/MSP

6/9/10

Why not reacTIVision


Initially designed for ducial tracking, thresholder and segmentation modules are optimized for this task. Finger tracking was added at a later stage, seem dicult to set up reacTIVision in order to achieve good tracking performance for both the ducial symbols and the nger tips. generally the reactivision code for nger tracking has been much less robust than other trackers.

Community Core Vision


A open source/cross-platform solution for computer vision and machine sensing. Takes an video input stream and outputs tracking data (e.g. coordinates and blob size) and events (e.g. nger down, moved and released) that are used in building multi-touch applications. CCV can interface with various web cameras and video devices as well as connect to various TUIO/ OSC/XML enabled applications and supports many multi-touch lighting techniques.

6/9/10

Why CCV
Cross-platform: works on Windows, Mac, and Linux. Filters (dynamic background subtraction, high-pass, amplify/scaler, threshold): it works with all optical setups (FTIR, DI, LLP, DSI). More lters can be added as modules. Input Switcher: test video is really useful for testing apps.

Screen Shot

6/9/10

Calculating

References:
CCV Group: http://ccv.nuigroup.com/ NUI Group Community: http://wiki.nuigroup.com/Main_Page TUIO: http://www.tuio.org/ OSC: http://opensoundcontrol.org/introduction-osc reacTIVision: http://reactivision.sourceforge.net/ Touchlib: http://nuigroup.com/touchlib/ Install Touchlib on Mac OS: http://wiki.nuigroup.com/ Installing_Touchlib_on_Mac_OS_X

Papers:
reacTIVision and TUIO: A Tangible Tabletop Toolkit e Design and Evolution of Fiducials for the reacTIVision System

You might also like