0% found this document useful (0 votes)
134 views1 page

Overview of Encoding Schemes

Encoding schemes are used to convert data into an equivalent cipher by assigning a unique code to each character. Some common encoding schemes are ASCII, ISCII, and Unicode. ASCII encodes English characters using 7-bit codes for 128 characters. ISCII was developed for Indian languages and uses 8-bit codes to represent 256 characters, retaining ASCII codes and adding codes for Indian languages. Unicode was created to allow encoding of all languages and assigns a unique number to every character, addressing issues with different encoding schemes not being compatible.

Uploaded by

dksingh369
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
134 views1 page

Overview of Encoding Schemes

Encoding schemes are used to convert data into an equivalent cipher by assigning a unique code to each character. Some common encoding schemes are ASCII, ISCII, and Unicode. ASCII encodes English characters using 7-bit codes for 128 characters. ISCII was developed for Indian languages and uses 8-bit codes to represent 256 characters, retaining ASCII codes and adding codes for Indian languages. Unicode was created to allow encoding of all languages and assigns a unique number to every character, addressing issues with different encoding schemes not being compatible.

Uploaded by

dksingh369
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

2.

Encoding Schemes
The mechanism of converting data into an
equivalent cipher using specific code is called encoding. it
is same for all the keyboards. This has been possible
because of standard encoding schemes where each letter,
numeral and symbol is encoded or assigned a unique code.
Eg. When the key ‘A’ is pressed, it is internally mapped to
a decimal value 65 (code value), which is then converted to
its equivalent binary value for the computer to
understand. Similarly, when we press alphabet ‘अ’ on Hindi keyboard, internally it is
mapped to a hexadecimal value 0905, whose binary equivalent is 0000100100000101.
Some of the well-known encoding schemes are described in the following sections.
2.1 American Standard Code for Information Interchange (ASCII) encoding scheme
ASCII was developed for Character Decimal Character Decimal Character Decimal
standardising the character Value Value Value
representation. ASCII is still the
most commonly used coding Space 32 @ 64 ` 96
scheme. Initially ASCII used 7 ! 33 A 65 a 97
bits to represent characters. total
” 34 B 66 b 98
number of different characters
on the English keyboard that can # 35 C 67 c 99
be encoded by 7-bit ASCII code is $ 36 D 68 d 100
27 = 128. Table shows some
printable characters for ASCII code. But ASCII is able to encode character set of English
language only.
2.2 Indian Script Code for Information Interchange (ISCII) In order to facilitate the
use of Indian languages on computers, a common standard for coding Indian scripts
called ISCII was developed in India during mid 1980s. It is an 8-bit code representation
for Indian languages which means it can represent 28=256 characters. It retains all 128
ASCII codes and uses rest of the codes (128) for additional Indian language character set.
Additional codes have been assigned in the upper region (160– 255) for the ‘aksharas’ of
the language.
2.3 Unicode There were many
अ आ इ ई उ ऊ ऋ ऌ ऍ ऎ ए
encoding schemes, for
0905 0906 0907 0908 0909 090A 090B 090C 090D 090E 090F
character sets of different
languages. But they were not क ख ग घ ङ च छ ज झ ञ ट
able to communicate with each 0915 0916 0917 0918 0919 091A 091B 091C 091D 091E 091F
other, as each of them थ द ध न ऩ प फ ब भ म य
represented characters in their 0925 0926 0927 0928 0929 092A 092B 092C 092D 092E 092F
own ways. Hence, text created
using one encoding scheme was व श ष स ह ◌ऺ ◌ऻ ◌़ ऽ ◌ा ि◌
not recognised by another 0935 0936 0937 0938 0939 093A 093B 093C 093D 093E 093F
machine using different ◌ॅ ◌ॆ ◌े ◌ै ◌ॉ ◌ॊ ◌ो ◌ौ ◌् ॎ◌ ◌ॏ
encoding scheme. Therefore, a 0945 0946 0947 0948 0949 094A 094B 094C 094D 094E 094F
standard called UNICODE has
◌ॕ ◌ॖ ◌ॗ क़ ख़ ग़ ज़ ड़ ढ़ फ़ य़
been developed to incorporate 0955
0956 0957 0958 0959 095A 095B 095C 095D 095E 095F
all the characters of every written
language of the world. UNICODE ॥ ० १ २ ३ ४ ५ ६ ७ ८ ९
provides a unique number for every 0965 0966 0967 0968 0969 096A 096B 096C 096D 096E 096F
character, irrespective of device
(server, desktop, mobile), operating ॵ ॶ ॷ ॸ ॹ ॺ ऄ ऄ ऄ ऄ ऄ
system (Linux, Windows, iOS) or 0975 0976 0977 0978 0979 097A 097B 097C 097D 097E 097F
software application (different
browsers, text editors, etc.).
Commonly used UNICODE encodings are UTF-8, UTF-16 and UTF-32. It is a superset of ASCII, and the
values 0–128 have the same character as in ASCII. Unicode characters for Devanagari script is shown in
Table. Each cell of the table contains a character along
with its equivalent hexadecimal value.

Common questions

Powered by AI

Universal character encoding with Unicode enhances the interchange of information in a technologically diverse global environment by providing a single encoding standard that assigns unique code points to every character across all writing systems . This unified approach eradicates the compatibility issues arising from disparate encoding schemes like ASCII (limited to English characters) or ISO 8859 (regional-limited encodings), which were previously unable to communicate effectively . By adopting Unicode, information systems can accurately render and interpret text regardless of the platform, software, or language, thus facilitating efficient data exchange and preserving text integrity across global networks . The inclusivity of Unicode ensures that virtually every character, symbol, and script is digitally representable, thus supporting the seamless integration of diverse linguistic data across different technological infrastructures .

ASCII, being a 7-bit encoding scheme, is inadequate for accommodating non-English scripts as it supports only 128 characters, limiting its applicability to the English language and basic control characters . This restriction makes it unsuitable for applications requiring multilingual text processing. Conversely, ISCII is an 8-bit encoding scheme developed specifically to support Indian scripts alongside ASCII, providing a total of 256 characters where 128 codes are retained for ASCII and the rest for Indian language characters . This design makes ISCII more adaptable for applications within multilingual contexts, particularly involving Indian scripts. Although ISCII is suitable for specific regional applications, both schemes fall short in comparison to Unicode, which provides a comprehensive solution for global language representation by supporting diverse scripts universally .

ISCII supports both the ASCII character set and Indian language scripts by adopting an 8-bit representation, which allows it to accommodate 256 characters in total . It retains all 128 ASCII codes, thereby supporting the existing English character set, and assigns the remaining 128 codes to Indian language characters . The additional codes for Indian scripts are specifically allocated in the upper region (160–255), making ISCII versatile for applications requiring both English and Indian language text processing .

Unicode addresses the challenges posed by multiple encoding schemes such as ASCII and ISCII by providing a universal character encoding system, which assigns a unique code point to every character from all written languages, ensuring consistency and interoperability . Previously, using different encoding schemes like ASCII (limited to English) and ISCII (focusing on Indian scripts) resulted in text created in one scheme being unreadable in another due to lack of standardization . Unicode solves this by using encodings like UTF-8, UTF-16, and UTF-32 that accommodate not just English or Indian characters but any global text, enabling seamless interchangeability across devices and operating systems without compatibility issues . This universality supports global communication by standardizing text representation irrespective of linguistic or technical boundaries .

The design consideration for adding additional character codes in the ISCII encoding scheme was to ensure it could accommodate the diverse scripts used in Indian languages while still retaining compatibility with the ASCII character set . ISCII achieves this through an 8-bit encoding structure, which expands the character limit to 256 . Within this framework, ISCII reserves the lower 128 codes for ASCII characters and utilizes the upper range (160-255) for Indian language characters, creating a flexible encoding capable of supporting complex scripts alongside standard English text . This design enhances its applicability in multilingual text processing, allowing for seamless integration of Indian language text within systems that also require English character support. However, while effective for Indian contexts, this scheme lacks the universality and broad applicability that Unicode provides in supporting global text interchange .

Before Unicode, the diversity of independent encoding schemes like ASCII and ISCII posed significant challenges, primarily related to compatibility and interoperability. Each encoding scheme represented characters differently, meaning text encoded in one scheme might not be correctly displayed or understood in another, leading to communication barriers . These limitations restricted text representation to specific languages and were problematic in a globalized world where multilingual interaction is common. Unicode resolved these challenges by establishing a universal standard that encompasses all scripts, providing a unique code point for every character globally . This standardization ensures that any text can be correctly interpreted by any Unicode-compliant system, facilitating consistent data representation and eliminating the incompatibility issues that previously hindered effective data interchange across different platforms and languages .

The fundamental mechanism of encoding data involves converting data into a cipher using a specific code where each letter, numeral, and symbol is given a unique code . This mechanism is applied equally across different keyboards, allowing for standardization . For example, when the key ‘A’ is pressed, it maps internally to a decimal value 65, which is then expressed in binary for computer processing . A similar process occurs for different languages, such as Hindi, where characters like ‘अ’ are mapped to hexadecimal values like 0905 and converted to their binary equivalent (0000100100000101). This encoding approach is adapted to support various languages through different encoding schemes like ASCII for English and ISCII for Indian languages .

UTF-8, UTF-16, and UTF-32 are significant in the implementation of Unicode as they support diverse technological needs and constraints. UTF-8 is popular for network protocols and HTML as it’s a variable-length encoding compatible with ASCII, which makes it efficient in terms of space for documents mainly containing characters from the Latin alphabet . UTF-16, being a variable-length encoding too, is optimized for languages with large numbers of characters, offering a balance between size efficiency and processing speed for East Asian scripts . UTF-32, using a fixed-length for encoding, ensures consistent character representation, simplifying text processing and presenting fewer programming issues, but at the cost of increased storage consumption . Together, these encodings enable Unicode to be versatile across different applications, environments, and languages, ensuring universal access and seamless integration in various technologies .

Different encoding schemes handle the representation of the Devanagari script with varying degrees of effectiveness. ISCII, specifically developed for Indian scripts, uses an 8-bit code that allows it to retain ASCII and assign additional codes for Indian scripts, including Devanagari, making it well-suited for multilingual environments involving Indian languages . In contrast, Unicode surpasses ISCII in terms of multilingual support, including not just Devanagari but characters from all world languages, through versatile encoding forms like UTF-8, UTF-16, and UTF-32 . This universal approach makes Unicode more suitable for comprehensive multilingual environments, facilitating seamless text interchange across disparate systems and accommodating a broader array of languages beyond Indian scripts, thereby enhancing interoperability in global communication contexts .

The ASCII encoding scheme is limited to a 7-bit character representation, allowing for only 128 characters which are sufficient for the English language but inadequate for multilingual text representation . This limitation means characters from other languages cannot be encoded, creating challenges in global text processing. In contrast, Unicode provides a solution by offering a unique number for every character across all written languages, overcoming the incompatibility issues between different encoding schemes due to its vast repertoire that covers multiple character sets . As a superset of ASCII, Unicode includes all ASCII characters and extends beyond by encompassing different languages, ensuring consistent and universal encoding across platforms and applications .

You might also like