Abstract :
We humans, interact with the world
using our five senses.
But as the name
suggests this technology brings forward an
additional sixth sense. A sixth sense is an ESP(Extra Sensory Perception) that aims at
a more developed future with both the physical and digital world connected without the help of hardware devices.
We come a step nearer to this goal of the sixth sense by the introduction of sixth
sense technology.
The sixth sense
technology employs a sixth sense which is in reality a wearable pendent like device.
This device is actually a mini projector coupled with a camera and a cell phone,
designed for obeying hand gestures. Using simple hand gestures, touch screens can
be obtained from any surface for various applications.
The origin of
sixth sense technology can be traced back
to Steve Mann who implemented a wearable computer in the form of neck-projector
coupled with a camera system in 1990.In later years, following his footsteps, Pranav
Mistry ,a young research scientist at MIT came up with new applications of this
technology. Thus, the sixth sense technology was developed at Media labs in MIT
and was coined as Wear Ur World (WUW).
The device has
various applications such as the drawing application in which movement of the index
finger is recognized and the user can draw on any surface. The other applications
include mapping, reading newspaper, checking time by drawing a wrist watch etc.
Other than being portable, this device also serves as a computer and saves time
spent on searching information.
This sixth sense
technology provides us with the freedom of interacting with the digital world using
hand gestures. This technology has a wide application in the field of artificial
intelligence. This methodology can aid in synthesis of bots that will be able to
interact with humans.
This technology
enables people to interact in the digital world as if they are interacting in the
real world. The Sixth Sense prototype implements several applications that demonstrate
the usefulness, viability and flexibility of the system.
COMPONENTS
The hardware
components are coupled in a pendant like mobile wearable device.
Camera
Projector
Mirror
Mobile
Component
Color
Markers
Camera: If there
is any object in view, then the object is recognized by the webcam and using computer-vision
based techniques the user’s gestures are tracked and it sends the data to the Smartphone.
Projector: The
projector projects the visual information on any surface, including the object itself
or your hand. The project itself contains a battery inside, with 3 hours of battery
life. The projector showcases the information enabling surfaces, walls and physical
objects around us to be used as interfaces.
Mirror: The
downward-facing projector projects the output image on to the mirror
And the mirror
reflects this image on to the desired surface.
Mobile Component:
The mobile devices like the Smartphone are used to handle connection to the internet.
Using mobile internet data and voice can be communicated across the world either
by transmitting or by receiving it. Similarly
video data can
also be processed by a web enabled Smartphone.
WORKING
The object in
view in captured by the camera and sends it to webcam for processing. With the help
of the markers, the gestures are identified. The software program analyses the video
data caught by the camera and also tracks down
The locations
of the colored markers by utilizing single computer vision techniques. The software
recognizes 3 kinds of gestures:
Multitouch
gestures
Freehand
gestures
Iconic
gestures
Then the processed information is projected by the projector onto
the mirror which in turn reflects it on the
desired surface.
Download :
Download :