A Technical Seminar On
SMART NOTE TAKER
Jawaharlal Nehru Technological University, Hyderabad
In partial fulfilment of requirements for the award of the degree of
BACHELOR OF TECHNOLOGY
IN
COMPUTER SCIENCE AND ENGINEERING
Submitted By
RITURAJ UPADHYAY 19E41A05L0
Under the Esteemed guidance of
Dr.M. Varaprasad Rao
Professor, Department of CSE
DEPARTMENT
OF
COMPUTER SCIENCE AND ENGINEERING
SREE DATTHA INSTITUTE OF ENGINEERING AND SCIENCE
(Approved by AICTE, Accredited by NAAC and Affiliated to JNTUH)
Sheriguda (V), Ibrahimpatnam (M),
R. R. District, Greater Hyderabad,
Telangana-501510.
2019 – 2023
1
SREE DATTHA INSTITUTE OF ENGINEERING AND SCIENCE
(Approved by AICTE, Accredited by NAAC and Affiliated to JNTUH)
Sheriguda (V), Ibrahimpatnam (M),
R. R. District, Greater Hyderabad,
Telangana-501510.
Department of Computer Science and Engineering
CERTIFICATE
This is to certify that the Technical Seminar report entitled “ SMART NOKE TAKER ” is
being submitted by
RITURAJ UPADHYAY 19E41A05L0
In partial fulfilment of the requirement for the award of the degree of
Bachelor of Technology in computer Science and Engineering to the Sree Dattha
Institute Of Engineering And Science, Hyderabad is a record of Bonafide work carried
out by him/her under my/our guidance.
Dr.M. Varaprasad Rao Dr.M. Varaprasad Rao
Internal Guide Head of Department (CSE)
SREE DATTHA INSTITUTE OF ENGINEERING AND SCIENCE
(Approved by AICTE, Accredited by NAAC and Affiliated to JNTUH)
Sheriguda (V), Ibrahimpatnam (M),
R. R. District, Greater Hyderabad,
Telangana-501510.
2
Department of Computer Science and Engineering
DECLARATION BY THE CANDIDATE
I am here by declaring that the technical seminar report titled “SMART NOTE TAKER”
is submitted in partial fulfilment of the requirement for the award of the degree of
Bachelor of Technology in Computer Science & Engineering at Sree Dattha Institute of
Engineering And Science, affiliated to Jawaharlal Nehru Technological University,
Hyderabad is a record of Bonafide work carried out by me and the results embodied
in this technical seminar have not been reproduced or copied from any source .
Submitted By,
RITURAJ UPADHYAY
19E41A05L0
ACKNOWLEDGEMENT
3
I am extremely grateful to Sri. G. PanduRanga Reddy - Chairman and Dr. S. Venkata Achuta
Rao - Dean of academics and Dr. M. Varaprasad Rao - Head of the department (CSE)
Sree Dattha Institute of Engineering and Science for providing all the facilities to
complete my technical seminar with in time.
I am extremely thankful to Dr. M. Varaprasad Rao - Internal guide Department of CSE,
for his constant guidance, encouragement and moral support throughout the
seminar.
I will be failing in duty if I don’t acknowledge with grateful thanks to the authors of
the references and other literatures referred in this technical seminar.
I am thankful to all staff members and friends for all the help and co-ordination
extended in bringing out this technical seminar successfully in time.
Finally, I am very much thankful to my parents who guided me in every step.
INDEX
4
1 INTRODUCTION
2 QWERTY KEYBOARDS
2.1 Introduction
2.2 Working
2.3 Difficulties
3 VIRTUAL KEYBOARD
3.1 Introduction
3.2 Virtual Keyboard Technology
3.3 Working of Virtus Keyboard
3.4 Different Types
4 ADVANTAGES
5 DRAWBACKS
6 APPLICATIONS
7 CONCLUSION
8 REFERENCES
ABSTRACT
5
The virtual keyboard will discuss a new technology in human machine.
Instead of using the mechanical keyboard having moving parts and buttons,
this gadget projects an image of a keyboard for the user’s reference. Using
a camera and digital image processing algorithms the user’s input is
detected. Input to small devices is becoming an increasingly crucial factor
in development for the ever-more powerful embedded market. Speech
input promises to become a feasible alternative to tiny keypads, yet Its
limited reliability, robustness, and flexibility render it unsuitable for certain
tasks and/or environments. This paper surveys technology for
alphanumeric input devices using virtual keyboard projection with a strong
focus on touch-typing.
Keywords :- sensors, QWERTY keyboard, pattern projector.
[Link]
Virtual Keyboard is just another example of today's computer trend of
'smaller and faster'. Computing is now not limited to desktops and laptops,
it has found its way into mobile devices like palm tops and even cell
6
phones. But what has not changed for the last 50 or so odd years is the
input device, the good old QWERTY [Link] virtual keyboard
technology is the latest development. The virtual keyboard technology
uses sensor technology and artificial intelligence to let users work on any
flat surface as if it were a keyboard. Virtual Keyboards lets you easily
create multilingual text content on almost any existing platform and
output it directly to PDAs or even web pages. Virtual Keyboard, being a
small, handy, well-designed and easy to use application, turns into a
perfect solution for cross platform text [Link] main features are:
platform-independent multilingual support for keyboard text input, built-in
language layouts and settings, copy/paste etc. Operations support just as
in a regular text editor, no change in already existing system language
settings, easy and user-friendly interface and design, and small file [Link]
report first gives an overview of the QWERTY keyboards and the difficulties
arising from using them. It then gives a description about the virtual
keyboard technology and the various types of virtual keyboards in use.
Finally drawbacks and the applications are discussed.
2. 'QWERTY' KEYBOARDS
2.1 Introduction
7
'QWERTY' is the most common keyboard layout on English-language
computer and typewriter keyboards. It takes its name from the first six
characters seen in the far left of the keyboard's top first row of letters.
2.2 Working
The working of a typical QWERTY keyboard is as follows:
1. When a key is pressed, it pushes down on a rubber dome sitting
beneath the key. A conductive contact on the underside of the dome
touches (and hence connects) a pair of conductive lines on the circuit
below.
2. This bridges the gap between them and allows electric current to
flow (the open circuit is closed).
3. A scanning signal is emitted by the chip along the pairs of lines to all
the keys. When the signal in one pair becomes different, the chip generates
a "make code" corresponding to the key connected to that pair of lines.
4. The code generated is sent to the computer either via a keyboard
cable (using on-off electrical pulses to represent bits) or over a wireless
connection. It may be repeated.
8
5. A chip inside the computer receives the signal bits and decodes them
into the appropriate key press. The computer then decides what to do on
the basis of the key pressed
6. When the key is released, a break code (different than the make
code) is sent to indicate the key is no longer pressed. If the break code is
missed (eg, due to a keyboard switch) it is possible for the keyboard
controller to believe the key is pressed down when it is not, which is why
pressing then releasing the key again will release the key (since another
break code is sent).
2.3 Difficulties
It is now recognized that it is important to be correctly seated while using
a computer. A comfortable working position will help with concentration,
quality of work, and reduce the risk of long-term problems. This is
important for all who use computers, and especially so for those with
disabilities.
The increased repetitive motions and awkward postures attributed to the
use of computer keyboards have resulted in a rise in cumulative trauma
disorders (CTDs) that are generally considered to be the most costly and
severe disorders occurring in the office. Lawsuits for arm, wrist, and hand
injuries have been filed against keyboard manufacturers allege that
keyboarding equipment is defectively designed and manufacturers fail to
provide adequate wamings about proper use to avoid injury.
9
As early as1926, Klockenberg described how the keyboard layout
required the typist to assume body postures that were unnatural,
uncomfortable and fatiguing. For example, standard keyboard design
forces operators to place their hands in a flat, palm down position called
forearm pronation.
The compact, linear key arrangement also causes some typists to place
their wrist in a position that is skewed towards the little fingers, called
ulnar deviation. These awkward postures result in static muscle loading,
increased muscular energy expenditure, reduced muscular waste
removal, and eventual discomfort or injury.
Researchers also noted that typing on the QWERTY keyboard is poorly
distributed between the hands and fingers, causing the weaker ring and
little fingers to be overwork.
3. VIRTUAL KEYBOARD
3.1 Introduction Virtual Keyboard is just another example of today's
computer trend of "smaller and faster". Computing is now not limited to
desktops and laptops, it has found its way into mobile devices like palm
tops and even cell phones. But what has not changed for the last 50 or so
odd years is the input device, the good old QWERTY keyboard
10
Alternatives came in the form of handwriting recognition, speech
recognition, abed input (for SMS in cell phones) etc. But they all lack the
accuracy and convenience of a full blown keyboard. Speech input has an
added issue of privacy.
Even folded keyboards for PDAs are yet to catch on Thus a new
generation of virtual input devices is now being paraded, which could
drastically change the way we type.
Virtual Keyboard uses sensor technology and artificial intelligence to let
users work on any surface as if it were a keyboard. Virtual Devices have
developed a flashlight-size gadget that projects an image of a keyboard
on any surface and lets people input data by typing on the image.
The device detects movement when fingers are pressed [Link]
movements are measured and the device accurately determines the
intended keystrokes and translates them into text.
The Virtual Keyboard uses light to project a full-sized computer keyboard
onto almost any surface, and disappears when not in use. The translation
process also uses artificial intelligence. Once the keystroke has been
decoded, it is sent to the portable device either by cable or via wireless.
11
The Virtual Keyboard uses light to project a full-sized computer keyboard
onto almost any surface, and disappears when not in use. Used with
Smart Phones and PDAs, it provides a practical way to do email, word
processing and spreadsheet tasks, allowing the user to leave the laptop
computer at home.
The technology has many applications in various high-tech and industrial
Sectors. These include data entry and control panel applications in
hazardous and harsh environments and medical markets.
Projection key boards or virtual key boards claim to provide the
convenience of compactness with the advantages of a full-blown QWERTY
keyboard. An interesting use of such keyboards would be in sterile
environments where silence or low noise is essential like operation
theatres.
The advantage of such a system is that you do not need a surface for
typing, you can even type in plain air. The company's Virtual Keyboard is
designed for anyone who's become frustrated with trying to put
information into
a handheld but doesn't want to carry a notebook computer around.
There is also the provision for a pause function to avoid translating
extraneous [Link] function, so that users can stop to eat,
drink etc.
It is also a superior desktop computer keyboard featuring dramatically
casier to learn touch-typing and leaving one hand free for mouse or
12
phone. Combination key presses ("chords") of five main and two extra
control keys allow users to type at 25-60 words per minute, with possibly
greater speeds achieved through the use of abbreviation expansion
software. Most users, however, will find memorizing the chords easy and
fun, with the included typing tutorial.
The scanner can keep up with the fastest typist, scanning the projected
area over 50 times a second. The keyboard doesn't demand a lot of
force, casing strain on wrists and digits.
Virtual keyboards solve the problem of sore thumbs that can be caused
by typing on the tiny keyboards of various gadgets like PDAs and cell
phones. They are meant to meet the needs of mobile computer users
struggling with cumbersome, tiny, or nonexistent keyboards. It might
help to prevent RSI injuries.
The Virtual Keyboard uses an extremely durable material which is
extremely easy to [Link] Virtual Keyboard is not restricted to the
QWERTY touch-typing paradigm; adjustments can be done to the
software to fit other touch-typing paradigms as well, such as the
DVORAK keyboard.
It will work with all types of Bluetooth enabled devices such as PDAs and
smart phones, as well as wearable computers. Applications include
computer/PDA input, gaming control, TV remote control, and musical
applications. Thus virtual keyboards will make typing easier, faster, and
almost a pleasure.
3.2 Virtual Keyboard Technology
13
1. The sensor module
2. IR-light source and
3. The pattern projector
[Link] module:
The Sensor Module serves as the eyes of the Keyboard Perception
technology. The Sensor Module operates by locating the user's fingers in
3-D space and tracking the intended keystrokes, or mouse movements.
Mouse tracking and keystroke information is processed and can then be
output to the host device via a USB or other interface.
[Link]-light source:
14
The Infrared Light Source emits a beam of infrared light. This light beam is
designed to overlap the area on which the keyboard pattern projector or
printed image resides. This is done so as to illuminate the user's fingers by
the infra-red light beam. This helps in recognizing the hand movements
and the pressing of keys. The light beam facilitates in scanning the image.
Accordingly the information is passed on to the sensor module which
decodes the information.
An invisible infra-red beam is projected
above the virtual keyboard. Finger makes keystroke on virtual keyboard.
This breaks infrared beam and infrared light is reflected back to
projector. Reflected infrared beam passes through infrared filter to
camera.
The camera photographs angle of incoming infrared light. The Sensor
chip in the sensor module determines where the infrared beam was
broken. Detected co-ordinates determine actions or characters to be
generated.
15
The Pattern Projector:
The Pattern Projector or optional printed image presents the image of
the keyboard or mouse zone of the system. This image can be projected
on any flat surface. The projected image is that of a standard QWERTY
keyboard, with all the keys and control functions as in the keyboard
The Projector features a wide-angle lens so
that a large pattern can be projected from relatively low elevations. A
printed image, with replaceable templates allows system flexibility,
permitting most any kind of keyboard configuration for greater
functionality.
In some types of virtual keyboards, a
second infra-red beam is not necessary. Here the projector itself takes
the inputs, providing dual functionality. A sensor or camera in the
projector picks up the finger movements, and passes the information on
to the sensor modules.
3.3 Working of Virtual Keyboard:
Step 1: Template creation (Projection Module)
16
A template of the desired interface is projected onto the adjacent
interface surface. The template is produced by illuminating a specially
designed, highly efficient holographic optical element with a red diode
laser Note: the template serves only as a reference for the user and is
not involved in the detection process. In a fixed environment, the
template can just as easily be printed onto the interface surface.
Step 2: Reference plane illumination (Micro-illumination ModuleTM)
An infra-red plane of light is generated just above, and parallel to the
interface surface. This light is invisible to the user and hovers a few
millimeters above the surface. When the user touches a key position on
the interface surface light is reflected from this plane in the vicinity of
the key and directed towards the semor module
Step 3: Map reflection coordinates (Sensor Module)
Reflected light from user interactions with the interface surface is
passed through an infra-red filter and imaged onto a CMOS image
sensor in the sensor module.
Custom hardware embedded in the sensor chip (the Virtual Interface
Processing CoreTM) then makes a real-time determination of the
location of the reflected light.
The processing core can track multiple reflection events simultaneously
and can thus support both multiple keystrokes and overlapping cursor
control inputs
3.4 Different Types
17
There are different types of virtual keyboards, manufactured by various
companies which provide different levels of functionalities. The different
types of virtual keyboards are:
3.4.1 Developer VKB
Its full-size keyboard also can be projected onto any surface and uses
laser technology to translate finger movements into letters. Working
with Siemens Procurement Logistics Services Rechargeable batteries
similar to those in cell phones power the compact unit. The keyboard is
full size and the letters are in a standard format. As a Class 1 laser, the
output power is below the level at which eye injury can occur.
3.4.2 Canesta
The Canasta Keyboard, which is a laser projected keyboard with which
the same laser is also used to scan the projection field and extract 3D
data. Hence, the user sees the projected keyboard, and the device
"sees" the position of the fingers over the projected keys. They also
have a chip set, Electronic Perception Technology, which they supply for
3rd parties to develop products using the projection/scanning
technology. Canesta appears to be the most advanced in this class of
technology and the only one who is shipping product. They have a
number of patents pending on their technology.
3.4.3 Sense board Technologies
The Sense board SB 04 technology is an extreme case of a hybrid
approach. The sensing transducer is neither a laser scanner nor a
18
camera. Rather, it is a bracelet like transducer that is worn on the hands
which captures hand and finger motion. In fact, as demonstrated, the
technology does not incorporate a projection component at all; rather,
it relies on the user's ability to touch type, and then infers the virtual
row and key being typed by sensing relative hand and finger movement.
The system obviously could be augmented to aid non-touch typists, for
example, by the inclusion of a graphic representation of the virtual
keyboard under the hands/fingers. In this case, the keyboard graphically
represented would not be restricted to a conventional QWERTY
keyboard, and the graphical representation could be projected or even
on a piece of paper. I include it here, as it is a relevant rela tod input
transducer that could be used with a projection system. The technology
has patents pending, and is currently in preproduction proof of Concept
form.
Semors made of a combination of rubber and plastic are attached to the
user's palms in such a way that they do not interfere with finger
motions. Through the use of Bluetooth technology, the "typed"
information is transferred wirelessly to the computer, where a word
processing program analyzes and interprets the signals into readable
text. The device is currently usable via existing ports on personal digital
assistants (PDA) from Palm and other manufacturers. Sense board
officials say it eventually will be compatible with most brands of pocket
PCs, mobile phones and laptop computers
19
3.4.4 KITTY
KITTY, an acronym for Keyboard-Independent Touch-Typing, is a Finger
mounted keyboard that uses touch typing as a method of data entry.
The device targets the portable computing market and in particular its
wearable computing system which are in need of a silent invisible data
entry system based on touch typing the new device combines the idea
of a finger mounted coding device with the advantages of a system that
uses touch typing
3.4.5 InFocus
InFocus is one of the leading companies in providing video and data
projectors. Their projectors are conventional, in that they do not use
laser technology. This has that advantage of delivering high quality
colour images with a mature technology, However, it has the
disadvantage of larger size, lower contrast, and higher power
requirements, compared to laser projection systems In 2000, InFocus
merged with Proxima, which had been one of its competitors. I include
InFocus Proxima in this survey not only because they make projectors In
their early days, Proxima developed one of the first commercially
available projection/vision systems. It was called Cyclops, and they still
hold a patent on the technology, Cyclops augmented the projector by
adding a video came…
20
The system, therefore, enabled the user to interact with the projected
image, using a provided laser pointer as the input device. The camera
detected the presence of the laser pointer on the surface, and
calculated its coordinates relative to the currently projected image.
Furthermore, the laser pointer had two intensity levels which enabled
the user to not only point, but to have the equivalent of a mouse button,
by the vision system interpreting the two levels as distinguishing button
up and down events.
4. ADVANTAGES
1. It can be projected on any surface or you can type in the plain air.
2. It can be useful in places like operation theatres where low noise is
essential
3. The typing does not require a lot of force. So using the strain on wrists
and hands
4. The Virtual Keyboard is not restricted to the QWERTY touch-typing
paradigm, adjustments can be done to the software to fit other touch-
typing paradigms as well.
5. No driver software necessary, it can be used as a plug and play device.
6. High battery life. The standard coin-sized lithium battery lasts about
eight months before needing to be replaced.
21
5. DRAWBACKS
1. Virtual keyboard is hard to get used to. Since it involves typing in thin
air, it requires a little practice. Only people who are good at typing can
use a virtual keyboard efficiently.
2. It is very costly ranging from 150 to 200 dollars.
3. The room in which the projected keyboard is used should not be very
bright so that the keyboard is properly visible
6. APPLICATIONS
1. High-tech and industrial Sectors
2. Used with Smart phones, PDAs, email, wordprocessing and spreadsheet
tasks
3. Operation Theatres.
4. As computer/PDA input.
5. Gaming control.
22
6. TV remote control.
7. CONCLUSION
Virtual Keyboard uses sensor technology and artificial intelligence to let
users work on any surface as if it were a keyboard Projection key boards
or virtual key boards claim to provide the convenience of compactness
with the advantages of a full-blown QWERTY keyboard. The company's
Virtual Keyboard is designed for anyone who's become frustrated with
trying to put information into a handheld but doesn't want to carry a
notebook computer around. Cancit appears to be the most advanced in
this class of technology Different types of virtual keyboards suit different
typing styles. Thus virtual keyboards will make typing easier, faster, and
almost a pleasure.
8. REFERENCES
[Link]://[Link]/cgi-bin/proh
2. [Link]
3. [Link]
[Link]/[Link]
5. [Link]
6 [Link]/us/office/meeting/product_catalog/[Link]
[Link]://[Link]/[Link]
23
24