You are on page 1of 4

International Conference on Trends in Electronics and Informatics

ICEI 2017

Implementation of a Real Time


Communication System for Deaf People Using
Internet Of Things
Piyush Patil1, Jayesh Prajapat2
Department of Computer Engineering
Pune University
Maharashtra,India
piyushpatil666@gmail.com1, jayeshprajapat81@gmail.com2

Abstract person. Our system compromises of Raspberry Pi,


GSM Module ,and Cloud server. The usage of
People having hearing disability face challenges every raspberry pi increases a portability of our system.
day. The biggest challenge faced by them is
communication. The main objective of this paper is the 2. Related Work
development of an advanced communication system for
deaf people. To solve this problem of communication we Author has proposed a new system prototype called
are using internet of things. The IoT is implemented the SHAROJAN BRIDGE in order to bridge the gap
with the help Embedded Linux board named
in the process of communication between the Blind,
Raspberry Pi. Our system consists of two ends, at one
end there is a normal person and at another end, there Deaf and Dumb people. The SHAROJAN BRIDGE
is a deaf person. The normal person will speak into uses the Wearable Technology, Texas
raspberry pi through speech to text module, a deaf Instrumentation Circuitry and Arduino Circuit Boards
person will get the text via Wi-Fi, Bluetooth or Cloud for implantation of the communication system[3].
Server according to the situation. Author has proposed a study that introduces the
initial step of an automatic translation system able to
Keywords: Raspberry PI , IOT, API ,Speech to Text translate visual speech used by deaf individuals to
,Text to Speech ,GSM Module, Cloud text, or auditory speech[4]. Author in his paper
addresses the problem of protecting distributed IoT
1. Introduction units from network based attacks while still having a
The Internet of Things is the internetworking of high level of availability[5]. Author proposed a
physical devices, buildings, vehicles and other items simple low cost feasible system to help the deaf and
embedded with electronics, sensors , software, the dumb to respond effectively to the person
actuators and network connectivity that enable each knocking at the door[6]. Author presented an
objects to collect and exchange data[1]. approach to the development of Smart Home
Communication between normal person and deaf applications by integrating Internet of Things (IoT)
person is possible if they are near each other but it with Web services and Cloud computing that focuses
gets difficult if distance between them increases.Over on: (a) embedding intelligence into sensors and
5% of the world’s population – 360 million people – actuators using Arduino platform (b) networking
has disabling hearing loss (328 million adults and 32 smart things using Zigbee technology; (c)facilitating
million children). Disabling hearing loss refers to interactions with smart things using Cloud services
hearing loss greater than 40 decibels (dB) in the (d)improving data exchange efficiency using JSON
better hearing ear in adults and a hearing loss greater data format[7]. Author investigated the combined
than 30 dB in the better hearing ear in problem of uploading IoT data from a set of sensor
children[2].Deaf people could communicate using gateways and efficient replication of data on
sign language but this method is inefficient as it is distributed cloud storage[8].
not necessary that the normal person will have proper
3. Components of System
knowledge of sign language. Another drawback of
using sign language is that the communicating person 3.1 Raspberry Pi 3
must be visible to each other. Our proposed system
tries to eliminate the drawback of inefficient The Raspberry Pi is a series of small single-board
communication between deaf person and normal computers developed in the United Kingdom by the

978-1-5090-4257-9/17/$31.00 ©2017 IEEE 313


International Conference on Trends in Electronics and Informatics
ICEI 2017

Raspberry Pi Foundation to promote the teaching of similar capabilities and functionality to a typical
basic computer science in schools and in developing server but are accessed remotely from a cloud service
countries[9]. In our proposed system will speak into provider[11].
raspberry pi then raspberry pi will perform speech to
text conversion and send that data to deaf person’s
mobile device.

Fig. 3.Cloud Storage

4. Configuration of System & Working

The Fig.4. describes the configuration of our


proposed system. The main processing unit of our
Fig. 1.Raspberry Pi system is raspberry pi. We have chosen raspberry pi
3 because of its features and benefits. Raspberry pi 3
3.2 SIM900A Dual band GSM /GPRS MODULE provides inbuilt support for Wi-Fi and Bluetooth
which is used for exchange of information between a
SIM900A Dual band GSM /GPRS MODULE is
normal person and a deaf person.
built with Dual Band GSM/GPRS engine- SIM900A,
works on frequencies 900/ 1800 MHz The Modem is
coming with RS232 interface, which allows you
connect PC as well as microcontroller with RS232
Chip(MAX232). The baud rate is configurable from
9600-115200 through AT command. The
GSM/GPRS Modem is having internal TCP/IP stack
to enable you to connect with internet via GPRS. It is
suitable for SMS, Voice as well as DATA transfer
application in M2M interface[10]. Raspberry pi uses
GSM module to send data to cloud server.

Fig. 4.Configuration of the System

GSM Sim900A module is interfaced with Pi 3 as


follows:

a) RXD on GSM to TXD0 on pi


Fig. 2.GSM Module
b) TXD on GSM to RXD0 on pi
3.3 Cloud Server
c) GND on GSM to GND on pi
A cloud server is a logical server that is built, hosted
and delivered through a cloud computing platform Raspbian Jessie version is used in this project. It is
over the Internet. Cloud servers possess and exhibit based on Debian Linux and different Versions of Os

978-1-5090-4257-9/17/$31.00 ©2017 IEEE 314


International Conference on Trends in Electronics and Informatics
ICEI 2017

are named from toy story film characters. This Os is


fully revised for the raspberry Pi’s hardware.
Modifications were made to enhance system
processes performance[12]. It runs (Lightweight X11
Desktop Environment) as the desktop environment.
Upgrading to raspbian jessie from raspbian wheezy
will add a considerable amount of changes and
improvements to desktop user interface. To send the
message from normal person to deaf person we have
written a Python GUI application using Tkinter
library. To receive the message at the deaf person’s
end we have made an android application. In android
application we have used BLUETOOTHGATT API.
It is used in Android Application for establishing
communication via Bluetooth. Android introduces a
built-in platform support for Bluetooth Low Energy
(BLE) in the central role and also provides APIs that
can be used by apps to discover devices, query for
services, and transmit information. Our system Fig. 5.Real time Communication
supports 80+ Languages and dialects .The normal
person will input his/her voice signal into the The Fig.5. describes the real time communication. In
raspberry pi through its audio jack. This voice signal this diagram, the part of the sentence “Text is” has
will be converted into text by using speech to text already been received, and the word “Coming” is
API by using python programming language. The being retrieved from the cloud. The words “at Real
text is then transmitted to the deaf person’s mobile Time” has just been spoken by the normal person.
application in real time by using Wi-Fi or Bluetooth
or Cloud according to the situation as shown in table.
1.

Distance(in meters) Transmission Medium

>32 Wi-Fi or Bluetooth

<32 Cloud(GSM)

Table. 1.Selection of Medium

Similarly the deaf person will type the message on


the mobile application which will be transferred to
the raspberry pi .With the help of text to speech API
the output will be generated in the form of voice
signal. Fig. 6.Experimental Analysis

5. Experimental Analysis The message sent by normal person is successfully


displayed on android application. The message sent
Real-time communications (RTC) is a term used to from deaf person’s mobile application is successfully
refer to any live telecommunications that occur received at Normal person’s end in the form of voice
without transmission delays. RTC is nearly instant signal.
with minimal latency. RTC data and messages are not
stored between transmission and reception. RTC is
generally a peer-to-peer, rather than broadcasting or
multicasting, transmission[13].

978-1-5090-4257-9/17/$31.00 ©2017 IEEE 315


International Conference on Trends in Electronics and Informatics
ICEI 2017

[5] Cristian Gehrmann, Mohamed Ahmed Abdelraheem, ” IoT


Protection through Device to Cloud Synchronization“, Cloud
Computing Technology and Science (CloudCom) 12-15 Dec.
2016

[6] Girija Sankar Dash, Swetalima Rout, Omprakash


Singh,"WiBeD2: A communication aid for deaf and
dumb",Information Communication and Embedded Systems
(ICICES), 2016 International Conference,25-26 Feb. 2016

[7] Moataz Soliman1, Tobi Abiodun1, Tarek Hamouda, Jiehan


Zhou1, Chung-Horng Lung, “Smart Home: Integrating Internet of
Things with Web
Services and Cloud Computing” ,Cloud Computing Technology
and Science (CloudCom), 2013 IEEE 5th International
Conference,2-5 Dec. 2013

[8] Akshay Kumar,Nanjangud C. Narendra,Umesh


Bellur,"Uploading and Replicating Internet of Things (IoT) Data
on Distributed Cloud
Storage",Cloud Computing (CLOUD), 2016 IEEE 9th
International Conference, 27 June-2 July 2016

[9] https://en.wikipedia.org/wiki/Raspberry_Pi

[10] GSM / GPR S RS232 M ODEM -SIM 900 A


http://www.rhydolabz.com/wiki/?p=880

[11]Cloud Server
https://www.techopedia.com/definition/29019/cloud-server
Fig. 7.Mobile Application

The Fig.7 shows the mobile application view of how [12] Raspbian ‘Jessie’ Operating System for the
the communication would like. RaspberryPi,https://blog.adafruit.com/2015/09/29/raspbian-jessie-
operating-system-for-the-raspberry-pi/
6. Conclusion
[13] Real Time Communications
The main advantage of our system is that it supports https://www.techopedia.com/definition/24426/real-time-
real time communication which provides minimal communications-rtc
delay. our system can be implemented for both short [14] Yanbo Zhao and Zhaohui Ye, “A Low Cost
as well as long range distances. Thus our model GSM/GPRS Based Wireless Home Security
tries to reduce the difficulties in communication System”, IEEE Transactions on Consumer
faced by deaf people. Electronics, Vol. 54, No. 2, MAY 2008.

[15] Gopinath Shanmuga Sundaram,


7. References Bhanuprasad Patibandala, Harish
Santhanam, Sindhura Gaddam, Vamsi
[1] Brown, Eric (13 September 2016). "Who Needs the Internet of Krishna Alla, Gautham Ravi Prakash, Shiva
Things?" Linux.com. Retrieved 23 October 2016. Chaitanya Vishwakarma Chandracha,
Sindhu Boppana and James M.Conrad.
“Bluetooth Communication using a Touch
[2] Deafness and hearing loss Fact sheet
screen Interface with the Raspberry Pi”,
http://www.who.int/mediacentre/factsheets/fs300/en/ 978-1-4799-0053-4/13, 2013 IEEE.

[3] Rohit Rastogi,Shashank Mittal,Sajan Agarwal,"A novel


approach for communication among Blind, Deaf and Dumb
people", Computing for
Sustainable Global Development (INDIACom), 2015 2nd
International Conference,11-13 March 2015

[4] Panikos Heracleous,Hiroshi Ishiguro, Norihiro Hagita,"Visual-


speech to text conversion applicable to
telephone communication for deaf individuals",
Telecommunications (ICT), 2011 18th International Conference, 8-
11 May 2011

978-1-5090-4257-9/17/$31.00 ©2017 IEEE 316

You might also like