KINECT BASED AUTONOMOUS AND GESTURE

CONTROLLED ROBO SOCCER

Project Advisor: Dr.Mujtaba Hussain Jaffery


Group Members:

IMROZE ASLAM FA10-BCE-019
YASIR JAMIL RATHORE FA10-BCE-051
FAROOQ HASSAN FA10-BCE-045
ADIL ILYAS SP09-BCE-002
INTRODUCTION

KINECT & 3D Computer Vision


Robo Soccer & Robo-Cup

RoboSprint

Test Bed
OBJECTIVES AND APPLICATIONS
Developing Testbeds for researchers


Making perfect Autonomous Robots and algorithms, based on the
testing done on our test beds and representing our university in
RoboSprint 2014 and maybe even in International Robo-Cup 2014


Making a Robo-Soccer Game Entertainment system with multiple
Human Computer Interaction modes for personal and commercial
use.
Modules
Kinect & Matlab/Simulink based TestBed

SSL Vision & Robo-Cup rules based Testbed

Robo Soccer Entertainment System Human
Computer Interaction Modules
Modules

Kinect based gesture control
PS2 Game Controller based control
iOS/Android App based control
Kinect based Speech control
Computer App based Control
EEG based Mind control
Theoretical Background

Robotics

Computer Vision/Image Processing

Control Systems

Human Computer Interaction

Methodology
For Testbeds

Construction of Robots and Field
Development of Image Processing Algorithms
Development of Artificial Intelligence and Control Algorithms
Development of Communication Link
Testing and modification


For Entertainment System

Interfacing of Module
Development of Communication Link
Testing and modification
TOOLS & COMPONENTS
SOFTWARE HARDWARE

Processing 2 Kinect for Windows
Matlab Arduino Uno
Simulink XBee s2
SSL Vision L293D H-Bridge ICs
Arduino IDE Brushless DC Motors
OpenNI Servo Motors
XCode Rubber Wheels and Ball Casters
XCTU Lithium Polymer Batteries
MS Visual Studio BlueSmirf Bluetooth Modules
Weka IP Camera
Eclipse Omni Wheels
Neurosky Mindwave
PlayStation2 Controllers
Roles of Team Members
Imroze Aslam

Leading the team and project design
3D Computer Vison
Kinect Interfacing
Artificial Intelligence and Programming
Mindwave Interfacing
Literature Review

Yasir Jamil Rathore

SSL Vision
Linux Server
Simulink Control System
Literature Review


Roles of Team Members

Adil Ilyas

XBee Wireless Communication
Game Controller based Control
Computer App based Control

Syed Farooq Hassan

Mobile App based Control
Bluetooth Interfacing
Electronics and Robot Construction
Timeline
Tasks done so far

Familiarizing with Software Environments and tools
Construction and testing of 1 Robot
Wireless communication between Robots and Computer
Kinect Interfacing
3D Localization of Objects
Basic Gesture Recognition
Timeline
October: Gesture based control of Robots + Game Controller and Computer App based
control of Robots

November: Depth based Localization of Robots + Studying and Implementing Artificial
Intelligence Algorithms. Implementation of Simulink based Controllers


December: Testing and Comparison of techniques/algorithms. Familiarizing with and
configuring SSL Visions. Implementing Image Processing and Artificial Intelligence
algorithms in SSL Vision. Making Omni Drive based Robots

January: Testing, Comparisons and Modifications for efficiency

February: Development of Mobile Apps for control of robots. Speech based control of robots.
Mindwave(EEG) based control of robots. Implementing Machine Learning by taking human
controlled game play as training examples.

March: Finalizing the Project. Writing Project Report

May: Research papers and side-projects based on learnt skills. Submission of project Report
Q & A