Stress Analysis for Online Workers
Stress Analysis for Online Workers
net/publication/357754986
CITATIONS READS
2 2,040
6 authors, including:
All content following this page was uploaded by Pradeep Kumara Wijesekara Abeygunawardhana on 30 January 2022.
329
Authorized licensed use limited to: SLIIT - Sri Lanka Institute of Information Technology. Downloaded on January 30,2022 at 00:51:45 UTC from IEEE Xplore. Restrictions apply.
not predicted the user’s stress level, using that identified their research, and they were able to obtain subject
behaviors and they provided the stress releasing tips independent classification accuracy of up to 74 percent and
according to the identified stress level. Most of them subject dependent classification accuracy of up to 91 %.
considered about bellow variables.
Stress is effect for the person in cognitively while fatigue
Stressed based diseases affect for person physically. If person suffers both of this
Stressed behaviors condition in same time that cause of cognitive stress of
person, that is called stress related fatigue condition. There
In this proposed system, contain above functions, is high probability of doing unintentional mistakes [1] by
Identify stressed behaviors (1) people who suffered these conditions. Therefore, prior
Predict stress level (2) detection of stress, fatigue or stress related fatigue
Display stress level in dashboard (3) condition is imported as well as important to make the
Validate stress level using PSS (4) method of detection unobtrusive. Therefore, detection of
changes of key typing pattern (keystroke dynamics) and
Suggest the tips for recover from stress (5)
Pattern changes in Mouse movements is another ideal way
TABLE I. RESEARCH GAP to detect above conditions of a person.
Research (1) (2) (3) (4) (5)
Research 01 [4] ✔ ✖ ✖ ✖ ✖ Many Researches use different techniques to detect
Research 02 [6] ✔ ✖ ✖ ✖ ✖ individual cognitive stress level using their typing patterns.
Javier H et el [11] tries to detect individual stress condition
Stress Analysis and Care ✔ ✔ ✔ ✔ ✔ by using pressure sensitive keyboard and mouse in
Prediction System
experimental room and giving transcript to do some tasks.
While doing that task they collected data using background
For many years, researchers have been researching app. They detect 79% of people’s typing pressure increased
automatic stress detection by collecting images of facial and 75% of people get more contact with mouse while they
expressions. From intrusive methods, such as saliva or are in stressful conditions. Suranga et el[12] calculate
blood testing, to less intrusive methods, such as picture individual stress while using in specific application
collecting of the people. (Microsoft word). keypress duration in selected key pairs
(diagraphs[12]) and keypress duration of selected three key
One of these studies [7] used a web camera installed
pairs (triagraph[12]) and rate of backspace and delete press
within a car's dashboard to capture and gather pictures of
As well as stress many researches interested in fatigue
the driver's face to detect stress. As per that research, the
detection using keystroke dynamic data, Robertas et al [13]
gathered pictures categorized into six facial expressions
detect fatigue by feeding 5 features generated by keypress
using Support Vector Machines (SVMs) trained on
and release times to the k-nearest neighbors (KNN). They
publicly gathered facial expression dataset. Following that,
used dataset provided which consist of data fifty-three
an algorithm counts the classifications within a certain time
people type specific text in fifteen times of a day. James D.
gap. The driver considered stressed if the number of anger
Hayes used custom modified keyboard and mouse to
and disgust facial expression count reaches a certain pre-
calculate fatigue on keypress pressure and mouse
assigned level. Not only were photos from public datasets
movements
used to train the best classifier, but also images of the
people posing for the stress categorization. As a result, the In the study [14] built a system to forecast stress using
models will be able to adapt to the way the individuals sensor data and personal data, by continuously tracking and
display their facial emotions. They were able to classify measuring data in a realistic context The platform is
stress with a 90.5 percent accuracy. primarily comprised of an Empatica E3 wristband, a stress
tracker iPhone agent (to store and transmit signals from the
In a study [8] created a method for stress detection that
wristband), mobile motion sensors, and a daily
gathers Remote Photo plethysmography (rPPG) signals
questionnaire. They visualized real-time and periodic
using the web camera of computers. After that, the rPPG
displays of rPPG signals with annotations using a web
data converted into a sinusoidal n wave, which represented
application. They used five healthy volunteers for the trial,
the heart rate. With 94.40 percent accuracy, an SVM
who worked 8–10 hours each week. They predicted stress
classifier produced the results.
using machine learning. With a f1-score of 0.91, the
A research team [9] created a system that uses video- random forest classifier outperformed the others.
recorded face signals to detect stress/anxiety emotional
states of the people. They retrieved the most significant III. METHODOLOGY
characteristics for stress categorization using a variety of
approaches such as Active Appearance Models, Optical Stress analysis system is designed for online workers.
Flow, and rPPG. A K-NN classifier achieved the greatest During their day today works system identifies behaviors,
classification accuracy of 87.72 percent. facial expressions, keystroke and heart rate of the user.
In the study [10], a method for identifying stress
indicators using Facial Action Units (FAUs) derived from
movies was proposed. They have used multiple basic
classifiers to conduct binary classification on FAUs
extracted from each video frames, which they gathered in
330
Authorized licensed use limited to: SLIIT - Sri Lanka Institute of Information Technology. Downloaded on January 30,2022 at 00:51:45 UTC from IEEE Xplore. Restrictions apply.
b) Training the Dataset
The architecture used to train the model is called a
Convolutional Neural Network (CNN). 256 layers were
employed to enhance the model's accuracy. Increased the
epochs to their maximum for the optimum accuracy. Then
develop the algorithm to split images to testing and training.
The model is trained using images from the training
category. Then saved the model for testing phase.
331
Authorized licensed use limited to: SLIIT - Sri Lanka Institute of Information Technology. Downloaded on January 30,2022 at 00:51:45 UTC from IEEE Xplore. Restrictions apply.
values, one for each facial emotion, using a trained to the output of the fatigue and Stress model, System
classification model. Then system will record each detail of predict user is in Normal Stress or the user is in Stress
the records with the generated time and emotion type. Data Related Fatigue Condition.
will be stored in the database real-time. Then it will separate
stressed facial expressions from all the other the other facial
expressions. According to the latest results, it will calculate
the stressed facial expression rate per selected period.
Stress Rate = (Stressed Facial Expressions Count /All Facial
Count)/Time Period
332
Authorized licensed use limited to: SLIIT - Sri Lanka Institute of Information Technology. Downloaded on January 30,2022 at 00:51:45 UTC from IEEE Xplore. Restrictions apply.
stress occurrences might progressively place the person in
a stressed state. In a classifiers model, this might lead to the
incorrect conclusion that just the most recent incident
produced stress, while all earlier occurrences are ignored
Fig. 6. ESP8266 Wi-Fi module and MAX30102 Pulse sensor and stay concealed.
Sensor Source: Adapted from [16][17] Fig. 8. Stress prediction flow
One more technique we employed was a stress detection
Proposed device embedded with computer mouse that approach based on adaptive analysis. Multiple dynamical
monitor can monitor heart rate and blood oxygen level. features are used in this algorithm: Variational plot SD1,
Vibrational plot SD2, and Approximate Entropy (En).
Stress is detected using this approach if,
333
Authorized licensed use limited to: SLIIT - Sri Lanka Institute of Information Technology. Downloaded on January 30,2022 at 00:51:45 UTC from IEEE Xplore. Restrictions apply.
gradually decreased when more data is used therefore 3- REFERENCES
day period is ideal. [1] C. S. Dewa and J. S. Hoch, “Barriers to mental health service use
among workers with depression and work productivity,” J. Occup.
Environ. Med., vol. 57, no. 7, pp. 726–731, 2015.
[2] Chan, Sherilynn & La Greca, Annette. (2013). Perceived Stress
Scale (PSS).10.1007/978-1-4419-1005-9_773.
[3] M. Chauhan, S. V. Vora, and D. Dabhi, “Effective stress detection
using physiological parameters,” in 2017 International Conference
on Innovations in Information, Embedded and Communication
Systems (ICIIECS), 2017, pp. 1–6.
[4] B. Kim et al., “Interpretability beyond feature attribution:
Quantitative testing with Concept Activation Vectors (TCAV),”
arXiv [[Link]], pp. 2668–2677, 2017.
[5] John P. Pollak, Phil Adams, and Geri Gay. 2011. PAM: a
photographic affect meter for frequent, in situ measurement of
affect. Proceedings of the SIGCHI Conference on Human Factors in
Computing Systems. Association for Computing Machinery, New
Fig. 12. Result in Stress Detection using SVM
York, NY, USA, 725–734.
[6] Schneiderman, Neil & Ironson, Gail & Siegel, Scott. (2005). Stress
In Fatigue detection three model’s Accuracy given as and Health:Psychological, Behavioral, and Biological Determinants.
Morning-98.02percentage, Afternoon-96.76percentage, Annual review of clinical psychology. 1. 607-28.
and Evening-99.56percentage. After the model building, 10.1146/[Link].1.102803.144141.
our application starts to predict using those models. Input [7] “Gao D, et al. (2014),” [Link]. [Online].
Available:[Link]
forwarded to the stress and relevant fatigue model. ccessed: 13-Sep-2021].
According to the output of both models, we conclude user’s [8] M. A. El Maaoui, D. Feurer, O. Planchon, M. R. Boussema, and
stress condition. M.H. Snane, “Assessment of kite born DEM accuracy for gullies
measuring,”[Link].[Online].Available:
We obtained strongly correlated data segments once the [Link] [Accessed: 13-
synchronization operation was completed. The distribution Sep-2021].
of signal segment lengths shown in the graph below. Most [9] A. Pampouchidou et al., “Depression assessment by fusing high and
parts are between 3 and 18 minutes long, as may be seen. low level features from audio, video, and text,”in Proceedings of the
6th International Workshop on Audio/Visual Emotion
110 minutes (about 2 hours) is the longest section that is Challenge,2016.
highly linked with the gold standard data. The default [10] B. Kim et al., “Interpretability beyond feature
parameter choices are designed to reduce the number of attribution:Quantitative testing with Concept ActivationVectors
segments that are too short (less than five minutes). Most (TCAV),” arXiv [[Link]], pp. 2668–2677, 2017.
of the poor portions are under one minute in length, with [11] Hernandez, P. Paredes, A. Roseway and M. Czerwinski, Under
pressure: sensing stress of computer users. New York, NY, USA: In
only one exceeding 60 minutes. Proceedings of the SIGCHI Conference on Human Factors in
Computing Systems (CHI '14), 2014.
TABLE 2. CLASSIFICATION ACCURACY LEVELS
[12] S. D. W. Gunawardhane, P. M. De Silva, D. S. B. Kulathunga and
Classifier Accuracy S.M. K. D. Arunatileka, "Non invasive human stress detection using
key stroke dynamics and pattern variations," 2013
Gaussian Naïve Bayes 89.98% InternationalConference on Advances in ICT for Emerging Regions
K Nearest Neighbor 93.22% (ICTer), 2013, pp. 240-247, doi: 10.1109/ICTer.2013.6761185.
Decision Tree 88.12% [13] M. Ulinskas, R. Damaševičius, R. Maskeliūnas, and M. Woźniak,
Support Vector Machine (SVM) 87.96% “Recognition of human daytime fatigue using keystroke data,”
Neural Network (1 hidden layer) 96.67% Procedia Comput. Sci., vol. 130, pp. 947–952, 2018
[14] A. Ghosh, M. Danieli, and G. Riccardi, “Annotation and prediction
With the combination of each result above system, of stress and workload from physiological and inertial signals,” in
graphical statistics shown in the UI (User Interface). If the 2015 37th Annual International Conference of the IEEE Engineering
in Medicine and Biology Society (EMBC), 2015, pp. 1621–1624.
stress level of the user is high than the pre-defined [15] J. Hektner, M. Csikszentmihalyi and J. Schmidt, Experience
benchmark, system will show pop-up alert to the user with sampling method. Thousand Oaks [Calif.]: SAGE, 2007
tips which can be extremely useful to prevent the health [16] “NodeMCU ESP8266,” [Link]. [Online]. Available:
problems. [Link]
esp8266-pinout-features-and-datasheet. [Accessed: 19-Sep-2021]
V. CONCLUSION [17] “MAX30102 Sensor Module 1.8V-5V Pulse Oximeter Heart Rate
Detection,” [Link].[Online].Available:
The rise of online workers has been gradually [Link]
increasing due to covid-19 pandemic. It is important to [Link].[Accessed: 19-
have healthy lifestyle while working from home. As Sep-2021]
we discussed throughout the paper our application [18] Melillo P., Bracale M., Pecchia L. Nonlinear Heart Rate Variability
features for real-life stress detection. Case study: students
help to users to prevent stress. The accuracy levels and understress due to university examination. BioMedical Engineering.
outputs shown in Results and discussion section shows
efficiency of the system and how it will assist to provide
a great service.
334
Authorized licensed use limited to: SLIIT - Sri Lanka Institute of Information Technology. Downloaded on January 30,2022 at 00:51:45 UTC from IEEE Xplore. Restrictions apply.
View publication stats