Framework for Accelerometer Based Gesture Recognition and Integration with Desktop Applications
This research paper has been published by International Journal of Scientific and Research
Publications in
its "IJSRP Volume 3 Issue 1 January 2013" edition.
Web link : http://www.ijsrp.org/research-paper-1301.php?rp=P13638
Web link : http://www.ijsrp.org/research-paper-1301.php?rp=P13638
ijsrp-p1366.pdf | |
File Size: | 340 kb |
File Type: |
Abstract:
Accelerometer is one of the prominent sensors which are commonly embedded in new age handheld devices. This embedded accelerometer can be used interact with wide range of applications running on the device and can also be integrated with desktop applications.
The goal of project is to build a generic and economic,gesture recognition framework based on accelerometer and provide seamless integration with desktop applications with require inputs through mouse and keyboard. With the integration of gesture recognition framework with desktop applications user can remotely play games, create drawings, control key and mouse event based applications. And since this is a generic framework, it can be integrated with any of the existing desktop applications irrespective of whether the application exposes APIs or not, whether it is a legacy or a newly programmed application.
Outline:
The project aims at building a comprehensive generic framework which enables a naive user to control any of the desktop computer based applications using simple and intuitive gestures with the help of a smartphone.
This is achieved by combining and processing data from three major systems. Firstly the data from accelerometer sensor embedded in the handheld device is obtained, which is then transmitted from smartphone to desktop computer through the Bluetooth communication protocol and finally this raw data is converted into useful control information which controls various applications.
The goal of project is to build a generic and economic,gesture recognition framework based on accelerometer and provide seamless integration with desktop applications with require inputs through mouse and keyboard. With the integration of gesture recognition framework with desktop applications user can remotely play games, create drawings, control key and mouse event based applications. And since this is a generic framework, it can be integrated with any of the existing desktop applications irrespective of whether the application exposes APIs or not, whether it is a legacy or a newly programmed application.
Outline:
The project aims at building a comprehensive generic framework which enables a naive user to control any of the desktop computer based applications using simple and intuitive gestures with the help of a smartphone.
This is achieved by combining and processing data from three major systems. Firstly the data from accelerometer sensor embedded in the handheld device is obtained, which is then transmitted from smartphone to desktop computer through the Bluetooth communication protocol and finally this raw data is converted into useful control information which controls various applications.
Gesture generator
Gesture generator module is responsible for transferring the gesture information from user’s handheld device to desktop computer which hosts the application. Gesture generator further comprises of two independent modules.
- Accelerometer initiator
- Bluetooth client
Gesture Recognizer
Gesture recognizer is responsible for receiving raw accelerometer data, filtering out redundant information, and running an intelligent algorithm to convert raw accelerometer data into useful gesture information. Once the raw data from accelerometer is processed into gesture information, this is fed further on to target applications to achieve necessary functionality. Gesture recognizer comprises of three independent modules.
- Bluetooth server
- Gesture processor
- Application controller
Future Enhancements
The generic nature of framework enables its integration with applications and games from multiple domains and across different platforms. Below are the feasible enhancements.
- Gesture to voice conversion,
- Gesture based multiplayer games,
- Economic smart class solutions,
- NFC integration, Photo viewer, controlling power point presentation.
Leverage the power of Qt for Embedded Linux by integrating it with LabVIEW RT on Zynq.
Overview :
Qt for Embedded Linux is a C++ framework of GUI and utility modules(non GUI), specifically built considering the resource constrained environment of embedded devices.
Hence applications built on this framework ensures maximum performance by making optimum use of available resources. Also, rich library of various modules enable quick application development.
Qt for Embedded Linux provides the standard Qt API for embedded devices with a lightweight window system. Qt Embedded Linux applications write directly to frame-buffer, eliminating the need for X Window System and hence saving memory. The Linux frame-buffer is enabled by default on all modern Linux distributions.
Qt for Embedded Linux is a C++ framework of GUI and utility modules(non GUI), specifically built considering the resource constrained environment of embedded devices.
Hence applications built on this framework ensures maximum performance by making optimum use of available resources. Also, rich library of various modules enable quick application development.
Qt for Embedded Linux provides the standard Qt API for embedded devices with a lightweight window system. Qt Embedded Linux applications write directly to frame-buffer, eliminating the need for X Window System and hence saving memory. The Linux frame-buffer is enabled by default on all modern Linux distributions.
Architecture
Integration with LabVIEW RT.
All the GUI and non GUI applications for embedded devices built on Qt framework can be exported as ActiveX controls to Labview with the help of ActiveQt Framework.
These modules can then be instantiated within Labview's ActiveX framework.
Advantages
All the GUI and non GUI applications for embedded devices built on Qt framework can be exported as ActiveX controls to Labview with the help of ActiveQt Framework.
These modules can then be instantiated within Labview's ActiveX framework.
Advantages
- 2D grpahics canvas and 3D graphics support with OpenGL integration.
- With little effort port most of the mobile apps to LabVIEW.
- Save memory on embedded targets by using Virtual Frame-buffer.
- Integration with Phonon multimedia framework.
- API library to work with GPU.
- QtWebkit based browser apps for LabVIEW.
- Efficient use of Accelerated Graphics APIs.
Vision Assisted Driving Solutions for Narrow and Congested roads.
Overview :
We often find it extremely difficult to drive through congested and narrow roads, also vehicles parked on both sides of the narrow roads add more to the pain. In such situations, drivers often take assistance of co-passenger to assist in driving through such congested and narrow roads. These kind of roads are very common in developing nations. Automated driving assistance is the need of hour considering the safety and driving comforts of the commuter.
We have a solution !!
The project aims at building economic, driving assistance solutions to drive though congested roads.
The system can inform the driver, whether he can drive his vehicle passing through narrow and congested roads without colliding with any obstacles.
We often find it extremely difficult to drive through congested and narrow roads, also vehicles parked on both sides of the narrow roads add more to the pain. In such situations, drivers often take assistance of co-passenger to assist in driving through such congested and narrow roads. These kind of roads are very common in developing nations. Automated driving assistance is the need of hour considering the safety and driving comforts of the commuter.
We have a solution !!
The project aims at building economic, driving assistance solutions to drive though congested roads.
The system can inform the driver, whether he can drive his vehicle passing through narrow and congested roads without colliding with any obstacles.
Framework for location based notifiers and their applications.
Introduction
The invention idea proposed here provides a well-defined, fine-tuned framework for location based services, positioning techniques and context based event handling. And also provides algorithms to resolve reliability, performance and usability issues with location based services.
All of the location based services work on the framework provided by positioning techniques using GPS and other means. The way that the location based services work is, a device capable of determining its geographical position provides information about the position of the device in terms of latitude, longitude and altitude, and based on this data appropriate notifications or services will be triggered while the device is at the target location. Mobiles devices, PDAs, Tablet PCs, and other hand held devices use various methods of determining the exact position most appropriately by using different positioning techniques.
The well-known position techniques are:
Since the invention of positioning techniques there have been numerous numbers of location based services are available on hand held devices like, GPS navigation, ATM Locator, Restaurant finder, etc. Out of all these location based services one of the most significant, handy and useful service is “Location based notifiers”, based on this technology over the period of time developers have developed host of applications. For e.g. location based alarms.
All of the location based services work on the framework provided by positioning techniques using GPS and other means. The way that the location based services work is, a device capable of determining its geographical position provides information about the position of the device in terms of latitude, longitude and altitude, and based on this data appropriate notifications or services will be triggered while the device is at the target location. Mobiles devices, PDAs, Tablet PCs, and other hand held devices use various methods of determining the exact position most appropriately by using different positioning techniques.
The well-known position techniques are:
- Integrated GPS
- Assisted GPS
- Bluetooth GPS
- Network based GPS
Since the invention of positioning techniques there have been numerous numbers of location based services are available on hand held devices like, GPS navigation, ATM Locator, Restaurant finder, etc. Out of all these location based services one of the most significant, handy and useful service is “Location based notifiers”, based on this technology over the period of time developers have developed host of applications. For e.g. location based alarms.
Problem Description
The currently existing location based notifiers and services though very much useful are not reliable and doesn’t cater to all the user requirements as they lack many features and absence of ways to handle limitations with GPS and limited battery supply of handheld devices. These major issues are making most of the location based services unusable.
Here is the list of shortcomings with existing location based notifiers.
Reliability: The existing applications based on location based notifiers are unreliable, this is due to
Performance:
Location based notifiers are soft real time systems which are expected to perform computations and location resolutions in a real quick time. But since most of these applications just use Integrated GPS based location resolution mechanisms they are slow and response time is very high which again makes these applications unreliable.
Input Criteria/Parameters:
The input parameters for location based notifier applications can be divided into two groups, primary and secondary. “Location information” is always a primary input and it is must for application to be functional. The secondary inputs are optional. Most of the location based applications use “Location info” as primary input to perform the computations, and only a few of these applications use “Time” as secondary input.
But just location and time don’t suffice all the user expectations from these applications and hence there is a need of third input data which is “Atmospheric Condition” which includes “temperature, humidity, pressure” ect. Combinations of all these primary and secondary parameters will result in a host of new services which can cater to variant user expectations and enrich feature set of these location based applications to a great extent.
Features set:
Currently existing location based notifier applications provide only a limited number of features like alarms and other notifications. But by enhancing these applications to depend on both primary and secondary input criteria as described in above the functionalities provided can be extended by a great number.
Battery Life:
Currently existing location based notifier applications tend to use high battery power as they will be connected to GPS while the application is running and this will drain out battery quickly, and hence there is need for techniques to optimum battery usage and to ensure that these applications doesn’t impact battery life much.
Here is the list of shortcomings with existing location based notifiers.
Reliability: The existing applications based on location based notifiers are unreliable, this is due to
- Inefficient methods of determining position of the device.
- Lack of well-established logics to overcome the limitations with GPS positioning technique.
- Absence of mechanisms to handle with the failure of limited battery supply in handheld devices.
Performance:
Location based notifiers are soft real time systems which are expected to perform computations and location resolutions in a real quick time. But since most of these applications just use Integrated GPS based location resolution mechanisms they are slow and response time is very high which again makes these applications unreliable.
Input Criteria/Parameters:
The input parameters for location based notifier applications can be divided into two groups, primary and secondary. “Location information” is always a primary input and it is must for application to be functional. The secondary inputs are optional. Most of the location based applications use “Location info” as primary input to perform the computations, and only a few of these applications use “Time” as secondary input.
But just location and time don’t suffice all the user expectations from these applications and hence there is a need of third input data which is “Atmospheric Condition” which includes “temperature, humidity, pressure” ect. Combinations of all these primary and secondary parameters will result in a host of new services which can cater to variant user expectations and enrich feature set of these location based applications to a great extent.
Features set:
Currently existing location based notifier applications provide only a limited number of features like alarms and other notifications. But by enhancing these applications to depend on both primary and secondary input criteria as described in above the functionalities provided can be extended by a great number.
Battery Life:
Currently existing location based notifier applications tend to use high battery power as they will be connected to GPS while the application is running and this will drain out battery quickly, and hence there is need for techniques to optimum battery usage and to ensure that these applications doesn’t impact battery life much.
Solution
The invention idea ensures a well-defined framework for “Location based notifiers, services and their wide range of applications” based on solid algorithms and methodologies which resolve all of the above mentioned limitations by providing innovative solutions as described below.
- The invention ensures high reliability and maximized performance of location based notifiers by making use of various location positioning mechanisms and better logics and algorithms to handle situations in a better way if the application fails to retrieve geographical co-ordinates of the device under certain unfavorable conditions.
- The invention adds up new location based services and features by making use of both primary and secondary input criteria and their combinations.
- Lastly the invention idea helps in making optimum use of battery with the help of smart techniques and algorithms and thereby extending battery life.
Advantages
- The current framework idea resolves all of the shortcomings existing with applications based on location based notifiers.
- The idea ensures good performance, high reliability, and optimum battery usage
- The idea provides a framework for large number of innovative location based services and applications.
Configure, Control and Read, NI Vision - Smart Camera over a Web-service on an Android device.
Overview :
NI Smart Cameras have Ethernet connection between the remote target and a development computer which allows,
However, currently there is no way to configure or read these devices wirelessly.
The project aims at enabling, controlling of smart cameras wirelessly on a hand held device over a web-service.
NI Smart Cameras have Ethernet connection between the remote target and a development computer which allows,
- Display of measurement results
- Configuring the remote target
- Status information, etc.
However, currently there is no way to configure or read these devices wirelessly.
The project aims at enabling, controlling of smart cameras wirelessly on a hand held device over a web-service.
Architecture
How ?
The project consists of two modules,
Web Service
The development computer, which is connected to Smart Camera, implements a Web-service which is published over a web server.
Through this web service, user can interact with the system remotely.
Client Application on Android device
A GUI client application running on Android or any other handheld device, will enable the user to configure, control, and read the remote target through published web service.
The project consists of two modules,
Web Service
The development computer, which is connected to Smart Camera, implements a Web-service which is published over a web server.
Through this web service, user can interact with the system remotely.
Client Application on Android device
A GUI client application running on Android or any other handheld device, will enable the user to configure, control, and read the remote target through published web service.