CCV, Touchlib, Reactivision, Tuio
CCV, Touchlib, Reactivision, Tuio
CCV, Touchlib, Reactivision, Tuio
TUIO
An open framework that de nes a common protocol and API for tangible multitouch surfaces. e TUIO protocol allows the transmission of an abstract description of interactive surfaces, including touch events and tangible object states. is protocol encodes control data from a tracker application (e.g. based on computer vision) and sends it to any client application that is capable of decoding the protocol.
6/9/10
Technically TUIO is based on Open Sound Control an emerging standard for interactive environments not only limited to musical instrument control - and can be therefore easily implemented on any platform that supports OSC.
6/9/10
Touchlib
A library for creating multi-touch interaction surfaces. It handles tracking blobs of infrared light, and sends your programs these multi-touch events, such as nger down, nger moved, and nger released. Does not provide you with any graphical or front end abilities - it simply passes you touch events. Can broadcast events in the TUIO. is makes Touchlib compatible with several other applications that support this protocol, such as Flash, VVVV, Processing, PureData, etc.
6/9/10
reacTIVision
An open source, cross-platform computer vision framework for the fast and robust tracking of ducial markers attached onto physical objects, as well as for multi-touch nger tracking. Mainly designed as a toolkit for the rapid development of table-based tangible user interfaces (TUI) and multi-touch interactive surfaces. Also able to send MIDI messages for the direct use with MIDI sequencers.
Available for the following operating systems: Windows, MacOS X and Linux. Windows: any camera with a proper WDM driver, such as USB, USB2, FireWire and DV cameras. MacOS X: all FireWire cameras and any camera supported by QuickTime will work in reacTIVision. Linux: FireWire cameras are best supported, as well as most Video4Linux2 USB cameras.
6/9/10
ow it works
1. Converted to a black&white image with an adaptive algorithm. 2. Searched for unique left heavy depth sequences, which have been encoded into the ducial symbol. 3. Match symbol to a dictionary to retrieve an unique ID number. OSC messages implementing the TUIO protocol encode the ducials' presence, location, orientation and identity and transmit this data to the client applications.
6/9/10
6/9/10
Why CCV
Cross-platform: works on Windows, Mac, and Linux. Filters (dynamic background subtraction, high-pass, amplify/scaler, threshold): it works with all optical setups (FTIR, DI, LLP, DSI). More lters can be added as modules. Input Switcher: test video is really useful for testing apps.
Screen Shot
6/9/10
Calculating
References:
CCV Group: http://ccv.nuigroup.com/ NUI Group Community: http://wiki.nuigroup.com/Main_Page TUIO: http://www.tuio.org/ OSC: http://opensoundcontrol.org/introduction-osc reacTIVision: http://reactivision.sourceforge.net/ Touchlib: http://nuigroup.com/touchlib/ Install Touchlib on Mac OS: http://wiki.nuigroup.com/ Installing_Touchlib_on_Mac_OS_X
Papers:
reacTIVision and TUIO: A Tangible Tabletop Toolkit e Design and Evolution of Fiducials for the reacTIVision System