See discussions, stats, and author profiles for this publication at: [Link]

net/publication/338392485

An Application to Control for Computer and Environmental Devices Via Voice

Commands

Conference Paper · June 2019

CITATIONS READS

0 71

3 authors:

Emre Avuçlu Ayhan Ozcifci

Aksaray University Aksaray University
38 PUBLICATIONS 333 CITATIONS 82 PUBLICATIONS 837 CITATIONS

SEE PROFILE SEE PROFILE

Abdullah Elen
Bandırma Onyedi Eylül University
66 PUBLICATIONS 477 CITATIONS

SEE PROFILE

All content following this page was uploaded by Abdullah Elen on 05 January 2020.

The user has requested enhancement of the downloaded file.

 k, 27-30 Haziran 2019,
III. International Scientific and Vocational Studies Congress - Engineering, 27-

AN APPLICATION TO CONTROL FOR COMPUTER AND ENVIRONMENTAL

DEVICES VIA VOICE COMMANDS
1 2
, Abdullah Elen3

emreavuclu@[Link]

ayhanozcifci@[Link]

3
University, Department of Computer Technology,

aelen@[Link]

Abstract
Technology is everywhere in our lives. It is no longer possible to live without technology or to perform certain operations. In this study,
an application was developed to facilitate our daily life. With this application, it is possible to control the operations of mouse and
keyboard on the computer with voice commands. Voice commands can be given from anywhere with the wireless headset. This
application was developed for people who cannot use the computer for any reason, or who do not see enough to use it. In this way,
people will be able to perform their computer-related operations without the need for another person. As a result, people will be able
to carry out some activities in their lives more comfortably.
Keywords: Easy life, computer control, voice recognition, disabled person.
1. Introduction
Thanks to technology, the use of computers in our lives has gradually increased. Mankind has developed technology in a way that is
in his own interest in some cases. Today, the computer has become available in every field and at any age. It is not possible to do great
studies without computer and to check some situations. Therefore, computerized control systems have become an integral part of our
lives. This has led to various searches of people to control different things through the computer. The basis of some of these searches
has been to make people's daily life easier and more comfortable. Today, some regulations are made with technology so that people
can live more comfortably. Studies on voice, speech and speaker recognition are:
Different voi
n
algorithms [2]. The sound layout was tried by installing different algorithms on a phone simulation. As a result, the results obtained
were found to vary according to the way the voice was spoken [3]. In another study, a voice recognition based security system using
different algorithms was developed [4]. In addition, a different system designed in Matlab Simulink was installed on the voice
recognition card.
algorithms related to voice recognition were performed on male and female users and multiple hidden markov model voice recognition
system was used [6, 7]. In our country; using artificial intelligence techniques, a voice recognition system was developed on the Turkish
language, independent of the text and the speaker [8]. For this purpose, a syllable-based Turkish word recognition system was
developed using voice recognition algorithms [9].
In the studies conducted in this field in the literature; In order to facilitate the social life of people, the recognition rate for 10 people in
the simulation environment on Matlab was found to be 99% and they tried it as the application of music, speech and different voice
recognition algorithms [10,11,12]. Similar studies; Hidden markov model 2007 voice recognition card using artificial hand made;
Successful results were obtained in the study which performed 40 command. However, in the developed system, the numbers spoken
between 0-9 are detected first by voice detection system and then sound processing techniques are used [13,14, 15]. A voice recognition
system was designed by using Mel-frequency cepstral coefficients, dynamic time warping, and Chirp Z transform algorithms. For this,
the Hidden markov model algorithm and the ActiveX program were used on Matlab [16,17,18]. In a study on the voice recognition
system, 5 different emotions of 30 people were tried to be detected in the calls made to the call center and 70% success was achieved
[19]. In another study, the success rate was 67.5% in the system, which was able to compare simultaneously without registration [20].
In some tests related to voice recognition, 10% of the tests performed by 10 users have achieved an average of 97.5% success and the
speech taken by the voice input device was translated into text [21, 22].
In this study; general operations using the keyboard and mouse on the computer were made with the voice commands given by the
wireless headset. Thus, people who find themselves inadequate in the use of computers, they can easily do what they want. The
developed application is designed to facilitate the daily life of people in general.

BILMES EN 2019 152

 k, 27-30 Haziran 2019,
III. International Scientific and Vocational Studies Congress - Engineering, 27-

2. Materials and Methods

The application in this study was programmed with C # programming language. It is possible to control different parameters of the
computer with voice commands. In the application, there are many units that control the computer with voice commands. In the
developed application, the desired e-mail addresses can be opened with voice commands and operations can be performed. Some of
these operations are shown with the interface view in Figure 1.

Figure 1. Mail address management

With the developed application, office tools can be opened with voice commands. All kinds of operations such as writing, printing can
be done. When voice recognition occurs, the following code block is executed and the program is opened.

Algorithm 1. Execute file

Begin function
-1, true);
2: if ([Link] = "world") then
3: filePath "C:\\......\[Link]";
4: [Link](filePath);
5: end if
End function

Some of these operations are shown with the interface view in Figure 2.

Figure 2. Office tools management

With the developed application, media tools can be opened with voice commands. Some of these operations are shown with the
interface view in Figure 3.

BILMES EN 2019 153

 k, 27-30 Haziran 2019,
III. International Scientific and Vocational Studies Congress - Engineering, 27-

Figure 3. Media tools management

With the developed application, desktop tools can be controlled with voice commands. Some of these operations are shown with the
interface view in Figure 4.

Figure 4. Desktop tools management

With the developed application, mouse movements can be controlled with voice commands. Some of these operations are shown with
the interface view in Figure 5.

Figure 5. Mouse movement management

With the developed application, commands that can be made with mouse and keyboard on the text can be controlled with voice
commands. Some of these operations are shown with the interface view in Figure 6.

BILMES EN 2019 154

 k, 27-30 Haziran 2019,
III. International Scientific and Vocational Studies Congress - Engineering, 27-

Figure 6. Management of transactions on text

With the developed application, mouse click events can be controlled with voice commands. Some of these operations are shown with
the interface view in Figure 7.

Figure 7. Mouse click event management

With the developed application, text reading operations can be controlled with voice commands. For these operations, the reading
engine of the [Link] library works as shown in the following algorithm. This function has different sub-functions. This is shown
briefly with the algorithm.

Algorithm 2. Read command

Begin function
-1, true);
2: if ([Link] = "read") then {

6: [Link](try, [Link]); }
7: end if
End function

The interface required for reading is shown in Figure 8.

BILMES EN 2019 155

 k, 27-30 Haziran 2019,
III. International Scientific and Vocational Studies Congress - Engineering, 27-

Figure 8. Text reading operation management

With the application developed, it is possible to open a newly installed application to the computer with paired voice commands. The
interface that performs this operation is shown in Figure 9.

Figure 9. Introduction of newly setup application

3. Conclusions
Thanks to the software made in this study, the computer and its applications were managed by voice commands. Voice commands can
be given at any point via a wireless or wired headset. This study was developed to facilitate the use of the computer in our daily life. It
is very useful for those who want to use the computer more actively and more fun. Besides all this, social life will be more fun.
Especially useful for people who cannot use computers for any reason. Thus, people who cannot use computers due to impossibilities
will easily use computers. With this study, people with disabilities, elderly or bedridden patients can live in their daily lives without
depending on someone.
Acknowledgements

This work was supported by the Aksaray University Scientific Research Projects Coordinatorship /Aksaray, Turkey. Project Number:
2018-061.
4. References
[1].
[2]. Muda, L., Begam, M., Elamvazuthi, I., "Voice Recognition Using Mel Frequency Cepstral Coefficient and Dynamic Time
WarpingTechniques", Journal of Computing, Cilt 2, 2010.
[3].

[4]. Bala, A., Kumar, A., Birla, N., "Voice Command Recognition System Based on MFCC and DTW", International Journal of
Engineering Science and Technology, vol: 2, pp.7335-7342, 2010.

BILMES EN 2019 156

View publication stats

k, 27-30 Haziran 2019,

III. International Scientific and Vocational Studies Congress - Engineering, 27-

[5].
Electrical / Electronics Engineering, 2007.
[6].
Technology, 2005.
[7]. Phoophuangpairoj, R., "Using Multiple HMM Recognizers and the Maximum Accuracy Method to Improve Voice Controlled
Robots", International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), December 2011.
[8]. Recognition Platform TREN.
[9].
Onsekiz Mart University, Academic Information, 2008.
[10].

[11].
Smart Systems Symposium, 2004.
[12].
Institute of Science and Technology, 2008.
[13]. nd Implementation of a Voice

[14].
978-1-46731318-6, 2012.
[15]. Abush
Conference on Computer and Communication Engineering (ICCCE 2010), 2010.
[16]. omparsion of MFCC and CZT based Cepstrum for Speech

[17]. International
Symposium on Intelligent Multimedia, Video and Speech Processing, 2001.
[18].
and Applied Sciences, 2006.
[19]. Petrushin, V.A., "Emotion in Speech Recognition and Application to Call Centers", Andersen Consulting, 2000.
[20]. -1-4244-6904-8/10, 2010.
[21]. Lipeika, A., Lipeikien, J., Telksnys, L., "Development of Isolated Word Speech Recognition System", Informatica Vol.13, No.1,
37-4637 Institute of Mathmatics and Informatics, 2002.
[22]. Master Thesis, Trakya University, Institute of Science and
Technology,2005.

BILMES EN 2019 157