Scribd
Upload
16 views7 pages

Overview of Character Encoding Standards

Uploaded by

romatotti9
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
16 views7 pages

Overview of Character Encoding Standards

Uploaded by

romatotti9
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

ASCII

ASCII abbreviated from American Standard Code for Information Interchange, is a character
encoding standard (the Internet Assigned Numbers Authority (IANA) prefers the name US-
ASCII). ASCII codes represent text in computers, telecommunications equipment, and other
devices. Most modern character-encoding schemes are based on ASCII, although they support
many additional characters.
Unicode (UTF-8, UTF-16, UTF-32)
Unicode is a computing industry standard for the consistent encoding, representation, and
handling of text expressed in most of the world's writing systems. Developed in conjunction with
the Universal Coded Character Set (UCS) standard and published as The Unicode Standard, the
latest version of Unicode contains a repertoire of more than 128,000 characters covering 135
modern and historic scripts, as well as multiple symbol sets. The standard consists of a set of
code charts for visual reference, an encoding method and set of standard character encodings, a
set of reference data files, and a number of related items, such as character properties, rules for
normalization, decomposition, collation, rendering, and bidirectional display order (for the
correct display of text containing both right-to-left scripts, such as Arabic and Hebrew, and left-
to-right scripts). As of June 2016, the most recent version is Unicode 9.0. The standard is
maintained by the Unicode Consortium.
UTF-8 is a character encoding capable of encoding all possible characters, or code points. UTF-8
is the dominant character encoding for the World Wide Web, accounting for 87.9% of all Web
pages in November 2016. The Internet Mail Consortium (IMC) recommends that all e-mail
programs be able to display and create mail using UTF-8, and the W3C recommends UTF-8 as
the default encoding in XML and HTML.
UTF-16 (16-bit Unicode Transformation Format) is a character encoding capable of encoding all
1,112,064 possible characters in Unicode. The encoding is variable-length, as code points are
encoded with one or two 16-bit code units. (also see Comparison of Unicode encodings for a
comparison of UTF-8, -16 & -32)
UTF-32 stands for Unicode Transformation Format in 32 bits. It is a protocol to encode Unicode
code points that uses exactly 32 bits per Unicode code point (but a number of leading bits must
be zero as there is much less than 232 Unicode code points). UTF-32 is a fixed-length encoding,
in contrast to all other Unicode transformation formats, which are variable-length encodings.
Each 32-bit value in UTF-32 represents one Unicode code point and is exactly equal to that code
point's numerical value.
CSV (Comma Separated Values)
The CSV file is a simple text file that usually contains records separated by a carriage return
(ASCII 13) and a line feed (ASCII 10) combination of characters, often represented in
programming languages as \r\n. The properties of each record are separated by the comma (,)
(ASCII 44) character. Traditionally the first row of a CSV file is the header (property names),
and all rows thereafter are data or records.
For more information on CSV format, go here.
JSON (JavaScript Object Notation)
JSON is a language-independent data format. It derives from JavaScript, but as of 2016, code to
generate and parse JSON-format data is available in many programming languages. The official
Internet media type (MIME) for JSON is application/json. The JSON filename extension is .json.
For more information on JSON format, go here.
XML (Extensible Markup Language)
In computing, Extensible Markup Language (XML) is a markup language that defines a set of
rules for encoding documents in a format that is both human-readable and machine-readable. The
W3C's XML 1.0 Specification and several other related specifications,—all of the free open
standards—define XML.
For more information on the XML format, go here.

Concise documentation for all Microsoft file formats can be found here.
DOC, DOCX
This file type is traditionally used by Microsoft Word. It follows the Office Open XML -
Anatomy of an OOXML WordProcessingML File Format. It represents a compressed (ZIP)
file that contains several XML files and folders for images and other attached files.
CSV, XLS, XLSX
The XLSX file type is used in Microsoft Excel. It follows the Office Open XML - Anatomy of
an OOXML SpreadsheetML File Format.
The XLS file type is the original file format prior to the change to Office Open XML
Spreadsheet ML format. More information about the XLS format can be found at [MS-XLS]:
Excel Binary File Format (.xls) Structure | Microsoft Docs.
The CSV format was originally used to stored tabular data in a single file.

ZIP
ZIP is an archive file format that supports lossless data compression. A .ZIP file may contain one
or more files or directories that may have been compressed. The .ZIP file format permits a
number of compression algorithms, though DEFLATE is the most common. This format was
originally created in 1989 by Phil Katz and was first implemented in PKWARE, Inc.'s PKZIP
utility, as a replacement for the previous ARC compression format by Thom Henderson.
The .ZIP format is now supported by many software utilities other than PKZIP. Microsoft has
included built-in .ZIP support (under the name "compressed folders") in versions of Microsoft
Windows since 1998. Apple has included built-in .ZIP support in Mac OS X 10.3 (via
BOMArchiveHelper, now Archive Utility) and later. Most free operating systems have built-in
support for .ZIP in similar manners to Windows and Mac OS X.
RAR
RAR is a proprietary archive file format that supports data compression, error recovery and file
spanning. It was developed by Russian software engineer Eugene Roshal (the name RAR stands
for Roshal Archive) and the RAR software is licensed by [Link] GmbH.
ISO 9660
ISO 9660 has given rise to the popular use of the term ISO-image, where it is used to refer to an
exact snapshot of a disc. Today, the use of ISO images goes beyond their use on actual CDs. For
example software, including open-source operating systems such as Linux, are often downloaded
and transferred to a storage medium such as a USB key using an ISO image. This enables the
creation and preservation of a perfectly intact file structure.
ISO is an archive file containing the content from (or destined for) an optical disk, originally
limited to data formatted to comply with the ISO 9660 standard (1988), hence the format name
and the iso file extension. Beginning in the 1990s, the term ISO Disk Image File Format (or
simply ISO image) has also been applied to data structured in terms of the Universal Disk
Format (UDF) specification developed and maintained by the Optical Storage Technology
Association (OSTA), standardized as ISO/IEC 13346 (1995 and 1999) and ECMA-167 (1997).
UDF is used for computer data storage for a broad range of media, including DVDs and Blu-Ray
disks, supplanting ISO 9660.

There are many different image types and image file extensions that can be used when creating and
saving images on the computer. Below is a list of the most common image file extensions.

 .ai - Adobe Illustrator file


 .bmp - Bitmap image
 .gif - GIF image
 .ico - Icon file
 .jpeg or .jpg - JPEG image
 .png - PNG image
 .ps - PostScript file
 .psd - PSD image
 .svg - Scalable Vector Graphics file
 .tif or .tiff - TIFF image
Raster Graphics
In computer graphics, a raster graphics image is a dot matrix data structure, representing a generally
rectangular grid of pixels, or points of color, viewable via a monitor, paper, or another display medium.
Raster images are stored in image files with varying formats.
Vector Graphics
Vector graphics is the use of polygons to represent images in computer graphics. Vector graphics are
based on vectors, which lead through locations called control points or nodes. Each of these points has a
definite position on the x- and y-axes of the work plane and determines the direction of the path;
further, each path may be assigned various attributes, including such values as stroke color, shape,
curve, thickness, and fill.

Unlike pixel-based raster images, vector graphics are based on mathematical formulas that define
geometric primitives such as polygons, lines, curves, circles and rectangles. Because vector graphics are
composed of true geometric primitives, they are best used to represent more structured images, like
line art graphics with flat, uniform colors. Most created images (as opposed to natural images) meet
these specifications, including logos, letterheads, and fonts.

SVG
Scalable Vector Graphics (SVG) is an XML-based vector image format for two-dimensional graphics with
support for interactivity and animation. The SVG specification is an open standard developed by the
World Wide Web Consortium (W3C) since 1999. Programs like Adobe Illustrator will allow Save and
Editing of the SVG file type in addition to text-based alterations with a simple text editor like Notepad.

The Georgian College logo is an SVG. It can therefore be scaled infinitely without pixelization.

BMP
The BMP file format, also known as a bitmap image file or device-independent bitmap (DIB) file format
or simply a bitmap, is a raster graphics image file format used to store bitmap digital images,
independently of the display device (such as a graphics adapter), especially on Microsoft Windows and
OS/2 operating systems. A simple editor like Microsoft Paint which comes with Windows will allow you
to edit this type of file.

Data that describes these types of images files can be found in a block of data at the beginning of the file
called the Header.

Image File Formats

AVI
Audio-Video Interleaved (also Audio Video Interleave), known by its initials AVI, is a
multimedia container format introduced by Microsoft in November 1992 as part of its Video for
Windows software. AVI files can contain both audio and video data in a file container that
allows synchronous audio-with-video playback. Like the DVD video format, AVI files support
multiple streaming audio and video, although these features are seldom used. Most AVI files also
use the file format extensions developed by the Matrox OpenDML group in February 1996.
These files are supported by Microsoft, and are unofficially called "AVI 2.0".
MP4
MPEG-4 Part 14 or MP4 is a digital multimedia container format most commonly used to store
video and audio, but can also be used to store other data such as subtitles and still images. Like
most modern container formats, it allows streaming over the Internet. The only official filename
extension for MPEG-4 Part 14 files is .mp4, but many have other extensions, most
commonly .m4a and .m4p. M4A (audio only) is often compressed using AAC encoding (lossy),
but can also be in Apple Lossless format. M4P is a protected format that employs DRM
technology to restrict copying. MPEG-4 Part 14 (formally ISO/IEC 14496-14:2003) is a standard
specified as a part of MPEG-4.
MOV and QT
QuickTime File Format (QTFF) is a computer file format used natively by the QuickTime
framework. Originally developed by Apple Computers.
WMV
Windows Media Video (WMV) is the name of a series of video codecs and their corresponding
video coding formats developed by Microsoft. It is part of the Windows Media framework.
WMV consists of three distinct codecs: The original video compression technology known as
WMV was originally designed for Internet streaming applications, as a competitor to RealVideo.
The other compression technologies, WMV Screen and WMV Image cater to specialized
content. After standardization by the Society of Motion Picture and Television Engineers
(SMPTE), WMV version 9 was adopted for physical-delivery formats such as HD DVD and
Blu-ray Disc and became known as VC-1. Microsoft also developed a digital container format
called Advanced Systems Format to store video encoded by Windows Media Video.
MPEG-1, MPEG-2
A video file format is a type of file format for storing digital video data on a computer system.
Video is almost always stored in compressed form to reduce the file size.

Codecs
A codec is a device or computer program for encoding or decoding a digital data stream or
signal. A codec encodes a data stream or a signal for transmission and storage, possibly in
encrypted form, and the decoder function reverses the encoding for playback or editing. Codecs
are used in videoconferencing, streaming media, and video editing applications.
Lossless
Lossless data compression algorithms usually exploit statistical redundancy to represent data
without losing any information, so that the process is reversible. Lossless compression is
possible because most real-world data exhibits statistical redundancy. For example, an image
may have areas of colour that do not change over several pixels; instead of coding "red pixel, red
pixel, ..." the data may be encoded as "279 red pixels". This is a basic example of run-length
encoding; there are many schemes to reduce the file size by eliminating redundancy.
Lossy
Lossy data compression is the converse of lossless data compression. In these schemes, some
loss of information is acceptable. Dropping nonessential detail from the data source can save
storage space. Lossy data compression schemes are designed by research on how people perceive
the data in question. For example, the human eye is more sensitive to subtle variations in
luminance than it is to variations in colour. JPEG image compression works in part by rounding
off nonessential bits of information.[9] There is a corresponding trade-off between preserving
information and reducing size. A number of popular compression formats exploit these
perceptual differences, including those used in music files, images, and video.

 .3g2 - 3GPP2 multimedia file


 .3gp - 3GPP multimedia file
 .avi - AVI file
 .flv - Adobe Flash file
 .h264 - H.264 video file
 .m4v - Apple MP4 video file
 .mkv - Matroska Multimedia Container
 .mov - Apple QuickTime movie file
 .mp4 - MPEG4 video file
 .mpg or .mpeg - MPEG video file
 .rm - RealMedia file
 .swf - Shockwave flash file
 .vob - DVD Video Object
 .wmv - Windows Media Video file
There are several audio file formats, standards, and file extensions used today. Below is a list of
the most common audio file extensions.
 .aif - AIF audio file
 .cda - CD audio track file
 .mid or .midi - MIDI audio file.
 .mp3 - MP3 audio file
 .mpa - MPEG-2 audio file
 .ogg - Ogg Vorbis audio file
 .wav - WAV file
 .wma - WMA audio file
 .wpl - Windows Media Player playlist

Common questions

Powered by AI

DOCX and XLSX file formats, used for word processing and spreadsheets, respectively, rely on the XML-based Office Open XML format, allowing for structured, flexible, and easily parsable document structures. DOCX uses this structure for text documents, supported by separate XML files for document content, styles, and properties, thus enhancing collaboration and formatting capabilities. XLSX similarly employs XML to define cells, formulas, and data for spreadsheets, facilitating data analysis and visualization with improved accuracy and detail management. This XML dependency allows both formats to offer detailed content representation while supporting interoperability across diverse software platforms, making them indispensable in professional settings .

Codecs, which compress and decompress digital video streams, play a crucial role in managing the quality and size of videos. By encoding data for storage and decoding it for playback, codecs allow videos to be distributed efficiently. They employ algorithms that balance video quality and file size, crucial for streaming services and storage. For example, lossy codecs might discard more data to reduce file size at the expense of quality, whereas lossless codecs maintain higher quality with larger files. The choice of codec affects compatibility with devices and applications, influencing user experience in video playback and editing .

Since its creation in 1989 by Phil Katz, ZIP has revolutionized data compression and archival by providing a simple, flexible, and widely adopted format that supports multiple compression algorithms, with DEFLATE being the most common. By reducing data size, ZIP facilitates easier and faster data transfer, including backups and distributions across varying systems. Its wide support across different operating systems has made ZIP almost a universal standard for file archiving. This ease of use and compatibility allows users to preserve and transport files efficiently, which has fundamentally shaped modern data storage, sharing, and retrieval practices .

JSON and XML serve similar purposes for data interchange but differ significantly in structure and ease of use. JSON, derived from JavaScript, provides a more lightweight, human-readable format ideal for web data exchange and APIs because of its straightforward object representation. It is favored for its simplicity, ease of parsing, and integration within JavaScript environments. XML, with its more verbose structure using custom tags, excels in complexity handling, schema validation, and extensibility. While XML provides more features like namespaces, its complexity can hinder system interoperability compared to the simplicity of JSON in web and mobile applications .

The primary difference between CSV and XML formats is their structure: CSV is a simple text format for tabular data that uses commas and new lines to separate fields and records, respectively. It is highly human-readable and suitable for simple data storage and transfer. XML, on the other hand, is a hierarchical and more complex markup language that encodes documents in a format that is both human-readable and machine-readable, using custom tags to define objects and object attributes. While CSV is ideal for structured data without complex relationships, XML is more flexible and better suited for representing structured information with nested structures and metadata .

UTF-8 has become the dominant character encoding for web pages due to its backward compatibility with ASCII, variable length that efficiently represents both common and rare characters, and its ability to encode all Unicode code points. This makes it flexible and space-efficient. Compared to UTF-16 and UTF-32, UTF-8 uses fewer bytes for ASCII and other commonly used characters, which effectively reduces file sizes and increases transmission speeds. UTF-16 and UTF-32, being fixed-length encodings, can result in larger file sizes, especially for text-heavy applications; thus, they are less efficient for many web applications that primarily use languages within the ASCII range .

Vector formats like SVG provide significant benefits in graphic design, including scalability without quality loss, ease of modification, and smaller file sizes for images consisting of clear lines and shapes. These features make vector graphics ideal for logos, typography, and scalable web graphics. However, their mathematical nature limits them in representing complex images with rich details, such as photographs, which are better served by raster formats like BMP. BMP maintains exact pixel data without compression, allowing for high-detail imagery, but results in larger file sizes and lacks scalability, making it less flexible for varied design needs .

ISO 9660 has established a standardized format for optical disc media, which facilitates the creation of ISO images – exact digital replicas of discs. This standardization enables software and operating systems to be distributed electronically while ensuring that transferred data remains identical to its physical counterpart. It has significantly influenced software distribution by simplifying the installation and replication processes across different platforms, allowing users to download exact versions of software without needing physical media. This method of distribution is especially crucial for operating systems and large software packages .

Lossy compression formats like JPEG provide significant file size reductions by discarding non-essential information, which is particularly useful in web and streaming contexts where bandwidth or storage might be limited. This makes them ideal for scenarios where perfect fidelity is not required, such as online image sharing, video streaming, and web page loading. While lossy formats do reduce quality, the perceptual differences are often minimal, and the efficiency gains in speed and storage can outweigh the drawbacks, especially in environments where speed and capacity are prioritized over perfect accuracy .

SVG combines vector graphics with XML to offer scalable, high-quality graphics suitable for web uses. As an XML-based language, SVG images are easily created, modified, and animated, integrating seamlessly with HTML and CSS. Unlike raster images, vector-based SVG images can be scaled to any size without loss of quality, which is crucial for responsive web design and high-resolution displays. Additionally, SVG supports interactivity and animation, enhancing user experience. Its text-based nature allows for easy compression and indexation by search engines, contributing to faster loading times and SEO .

You might also like