The Taste of Python

Study Material

Ensino Research and Development Pvt. Ltd.

[Link]
Let’s Start…………

For Python version 3

This book will teach you to use Python version 3. There will also be guidance for you to
adapt to the older and more common Python version 2 in the book.

Preface
Python is probably one of the few programming languages which is both sim ple and
powerful. This is good for beginners as well as for experts, and more importantly, is fun to
program with. This book aims to help you learn this wonderful language and show how to get
things done quickly and painlessly - in effect 'The Anti-venom to your programming
problems'.

About Python
Python is one of those rare languages which can claim to be both simple and powerful. You
will find yourself pleasantly surprised to see how easy it is to concentrate on the solution to
the problem rather than the syntax and structure of the language you are programming in.

The official introduction to Python is:

Python is an easy to learn, powerful programming language. It has efficient high-level

data structures and a sim ple but effective approach to object-oriented programming.
Python's elegant syntax and dynam ic typing, together with its interpreted nature, m ake
it an ideal language for scripting and rapid application development in many areas on
most platforms.

Story behind the name

Guido van Rossum, the creator of the Python language, named the language after the BBC
show "Monty Python's Flying Circus". He doesn't particularly like snakes that kill animals for
food by winding their long bodies around them and crushing them.

Features of Python
Simple
Python is a simple and minim alistic language. Reading a good Python program feels almost
like reading English, although very strict English! This pseudo -code nature of Python is one
of its greatest strengths. It allows you to concentrate on the solution to the problem rather
than the language itself.

Easy to Learn
As you will see, Python is extremely easy to get started with. Python has an extraordinarily
simple syntax, as already m entioned.

Free and Open Source

Python is an example of a FLOSS (Free/Library and Open Source Software). In simple

terms, you can freely distribute copies of this software, read its source code, make changes
to it, and use pieces of it in new free programs. FLOSS is based on the concept of a
community which shares knowledge. This is one of the reasons why Python is so good - it
has been created and is constantly im proved by a community who just want to see a better
Python.

High-level Language
When you write programs in Python, you never need to bother about the low-level details
such as managing the m emory used by your program , etc.

Portable
Due to its open-source nature, Python has been ported to (i.e. changed to make it work on)
many platforms. All your Python programs can work on any of these platforms without
requiring any changes at all if you are careful enough to avoid any system -dependent
features.

You can use Python on GNU/Linux, Windows, FreeBSD, Macintosh, Solaris, OS/2, Am iga,
AROS, AS/400, BeOS, OS/390, z/OS, Palm OS, QNX, VMS, Psion, Acorn RISC OS,
VxWorks, PlayStation, Sharp Zaurus, Windows CE and PocketPC!

Interpreted
This requires a bit of explanation.

A program written in a compiled language like C or C++ is converted from the source
language i.e. C or C++ into a language that is spoken by your computer (binary code i.e. 0s
and 1s) using a compiler with various flags and options. When you run the program, the
linker/loader software copies the program from hard disk to mem ory and starts running it.

Python, on the other hand, does not need compilation to binary. You just run the program
directly from the source code. Internally, Python converts the source code into an
intermediate form called bytecodes and then translates this into the native language of your
computer and then runs it. All this, actually, makes using Python much easier since you don't
have to worry about compiling the program , making sure that the proper libraries are linked
and loaded, etc. This also makes your Python programs much more portable, since you can
just copy your Python program onto another computer and it just works!

Object Oriented
Python supports procedure-oriented programming as well as object-oriented programming.
In procedure-oriented languages, the program is built around procedures or functions which
are nothing but reusable pieces of programs. In object-oriented languages, the program is
built around objects which combine data and functionality. Python has a very powerful but
simplistic way of doing OOP, especially when com pared to big languages like C++ or Java.

Extensible
If you need a critical piece of code to run very fast or want to have some piece of algorithm
not to be open, you can code that part of your program in C or C++ and then use it from your
Python program.

Embeddable
You can em bed Python within your C/C++ programs to give scripting capabilities for your
program's users.

Extensive Libraries
The Python Standard Library is huge indeed. It can help you do various things involving
regular expressions,documentation generation, unit testing, threading, databases, web
browsers, CGI, FTP, email, XML, XML-RPC, HTML, W AV files, cryptography, GUI (graphical
user interfaces), and other system-dependent stuff. Rem ember, all this is always available
wherever Python is installed. This is called the Batteries Included philosophy of Python.

Besides the standard library, there are various other high-quality libraries which you can find
at the Python Package Index.

Summary
Python is indeed an exciting and powerful language. It has the right combination of
performance and features that make writing programs in Python both fun and easy.
 Python 3 versus 2
You can ignore this section if you're not interested in the difference between "Python version
2" and "Python version 3". But please do be aware of which version you are using. This
book is written for Python version 3.

Remember that once you have properly understood and learn to use one version, you can
easily learn the differences and use the other one. The hard part is learning programming
and understanding the basics of Python language itself. That is our goal in this book, and
once you have achieved that goal, you can easily use Python 2 or Python 3 depending on
your situation.

Installation
When we refer to "Python 3" in this book, we will be referring to any version of Python equal
to or greater than version Python 3.6.0.

Installation on Windows
Visit [Link] and download the latest version. At the time of this
writing, it was Python 3.5.1 The installation is just like any other Windows -based software.

Note that if your Windows version is pre-Vista, you should download Python 3.4 only as later
versions require newer versions of Windows.

CAUTION: Make sure you check option Add Python 3.5 to PATH .

To change install location, click on Customize installation , then Next and enter
C:\python35 (or another appropriate location) as the install location.

If you didnot check the Add Python 3.5 PATH option earlier, check Add Python to

environment variables . This does the same thing as Add Python 3.5 to PATH on the first
install screen.

You can choose to install Launcher for all users or not, it does not m atter much. Launcher is
used to switch between different versions of Python installed.

If your path was not set correctly (by checking the Add Python 3.5 Path or Add Python to

environment variables options), then follow the steps in the next section ( DOS Prompt ) to fix
it. Otherwise, go to the Running Python prompt on Windows section in this document.

For Windows 7 and 8:

 Right click on Com puter from your desktop and select Properties or click Start and
choose Control Panel -> System and Security -> System . Click on Advanced system

settings on the left and then click on the Advanced tab. At the bottom click on
Environment Variables and under System variables , look for the PATH variable, select
and then press Edit .
Go to the end of the line under Variable value and append ;C:\Python35 (please verify
that this folder exists, it will be different for newer versions of Python) to the end of what
is already there. Of course, use the appropriate folder name.
If the value was %SystemRoot%\system32; It will now becom e
%SystemRoot%\system32;C:\Python36
Click OK and you are done. No restart is required, however you may have to close and
reopen the command line.

For Windows 10:

Windows Start Menu > Settings > About > System Info (this is all the way over to the
right) > Advanced System Settings > Environment Variables (this is towards the bottom) >
(then highlight Path variable and click Edit ) > New > (type in whatever your python
location is. For example, C:\Python35\ )

Running Python prompt on Windows

For Windows users, you can run the interpreter in the command line if you have set the
PATH variable appropriately.

To open the terminal in Windows, click the start button and click Run . In the dialog box, type
cmd and press [enter] key.

Then, type python and ensure there are no errors.

Installation on Mac OS X
For Mac OS X users, use Homebrew: brew install python3 .

To verify, open the terminal by pressing [Command + Space] keys (to open Spotlight search),
type Terminal and press [enter] key. Now, run python3 and ensure there are no errors.

Installation on GNU/Linux
For GNU/Linux users, use your distribution's package m anager to install Python 3, e.g. on
Debian & Ubuntu: sudo apt-get update && sudo apt-get install python3 .

To verify, open the terminal by opening the Terminal application or by pressing Alt + F2

and entering gnome-terminal . If that doesn't work, please refer the documentation of your
particular GNU/Linux distribution. Now, run python3 and ensure there are no errors.

You can see the version of Python on the screen by running:

$ python3 -V
Python 3.6.0

NOTE: $ is the prom pt of the shell. It will be different for you depending on the settings of
the operating system on your computer, hence I will indicate the prompt by just the $

symbol.

CAUTION: Output may be different on your computer, depending on the version of Python
software installed on your com puter.

Summary
From now on, we will assume that you have Python installed on your system.

Next, we will write our first Python program.

First Steps
We will now see how to run a traditional 'Hello World' program in Python. This will teach you
how to write, save and run Python programs.

There are two ways of using Python to run your program - using the interactive interpreter
prompt or using a source file. We will now see how to use both of these methods.

Using The Interpreter Prompt

Open the terminal in your operating system (as discussed previously in the Installation
chapter) and then open the Python prompt by typing python3 and pressing [enter] key.

Once you have started Python, you should see >>> where you can start typing stuff. This is
called the Python interpreter prom pt.

At the Python interpreter prompt, type:

print("Hello World")

followed by the [enter] key. You should see the words Hello World printed to the screen.

Here is an exam ple of what you should be seeing, when using a Mac OS X computer. The
details about the Python software will differ based on your computer, but the part from the
prompt (i.e. from >>> onwards) should be the same regardless of the operating system.

$ python3
Python 3.6.0 (default, Jan 12 2017, 11:26:36)
[GCC 4.2.1 Compatible Apple LLVM 8.0.0 (clang-800.0.38)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> print("Hello World")
Hello World

Notice that Python gives you the output of the line immediately! What you just entered is a
single Python statement. We use print to (unsurprisingly) print any value that you supply
to it. Here, we are supplying the text Hello World and this is promptly printed to the screen.

How to Quit the Interpreter Prompt

If you are using a GNU/Linux or OS X shell, you can exit the interpreter prom pt by pressing
[ctrl + d] or entering exit() (note: remem ber to include the parentheses, () ) followed
by the [enter] key.

If you are using the Windows comm and prompt, press [ctrl + z] followed by the [enter]
key.

Choosing An Editor
We cannot type out our program at the interpreter prom pt every tim e we want to run
something, so we have to save them in files and can run our programs any number of times.

To create our Python source files, we need an editor software where you c an type and save.
A good programmer's editor will m ake your life easier in writing the source files. Hence, the
choice of an editor is crucial indeed. You have to choose an editor as you would choose a
car you would buy. A good editor will help you write P ython programs easily, m aking your
journey m ore comfortable and helps you reach your destination (achieve your goal) in a
much faster and safer way.

One of the very basic requirem ents is syntax highlighting where all the different parts of your
Python program are colorized so that you can see your program and visualize its running.

If you are using Windows, do not use Notepad - it is a bad choice because it does not do
syntax highlighting and also importantly it does not support indentation of the text whic h is
very important in our case as we will see later. Good editors will automatically do this.

To reiterate, please choose a proper editor - it can make writing Python programs more fun
and easy.
Using a Source File
Now let's get back to programming. There is a tradition that whenever you learn a new
programming language, the first program that you write and run is the 'Hello World' program
- all it does is just say 'Hello World' when you run it. As Sim on Cozens says, it is the
"traditional incantation to the programming gods to help you learn the language better."

Start your choice of editor, enter the following program and save it as [Link] .

Where should you save the file? To any folder for which you know the location of the folder.
If you don't understand what that means, create a new folder and use that location to save
and run all your Python programs:

/tmp/py on Mac OS X
/tmp/py on GNU/Linux
C:\py on Windows

To create the above folder (for the operating system you are using), use the mkdir

command in the terminal, for exam ple, mkdir /tmp/py .

IMPORTANT: Always ensure that you give it the file extension of .py , for example,
[Link] .

To run your Python program:

1. Open a term inal window (see the previous Installation chapter on how to do that)
2. Change directory to where you saved the file, for example, cd /tmp/py

3. Run the program by entering the command python [Link] . The output is as shown
below.

$ python [Link]
hello world
If you got the output as shown above, congratulations! - you have successfully run your first
Python program. You have successfully crossed the hardest part of learning programming,
which is, getting started with your first program!

In case you got an error, please type the above program exactly as shown above and run
the program again. Note that Python is case-sensitive i.e. print is not the same as Print

- note the lowercase p in the former and the uppercase P in the latter. Also, ensure there
are no spaces or tabs before the first character in each line.

How It Works

A Python program is composed of statements. In our first program, we have only one
statem ent. In this statem ent, we call the print statem ent to which we supply the text "hello
world".

Getting Help
If you need quick inform ation about any function or statem ent in Python, then you can use
the built-in help functionality. This is very useful especially when using the interpreter
prompt. For example, run help('len') - this displays the help for the len function which is
used to count num ber of items.

TIP: Press q to exit the help.

Similarly, you can obtain information about almost anything in Python. Use help() to learn
more about using help itself!

In case you need to get help for operators like return , then you need to put those inside
quotes such as help('return') so that Python doesn't get confused on what we're trying to
do.

Summary
You should now be able to write, save and run Python programs at ease.

Now that you are a Python user, let's learn some more Python concepts.

Basics
Just printing hello world is not enough, is it? You want to do more than that - you want to
take some input, manipulate it and get something out of it. We can achieve this in Python
using constants and variables, and we'll learn some other concepts as well in this chapter.
Comments
Comments are any text to the right of the # symbol and is mainly useful as notes for the
reader of the program.

For example:

print('hello world') # Note that print is a function

or:

# Note that print is a function

print('hello world')

Use as many useful comments as you can in your program to:

explain assumptions
explain important decisions
explain im portant details
explain problems you're trying to solve
explain problems you're trying to overcome in your program, etc.

Code tells you how, comments should tell you why.

This is useful for readers of your program so that they can easily understand what the
program is doing. Rem ember, that person can be yourself after six m onths!

Literal Constants
An exam ple of a literal constant is a number like 5 , 1.23 , or a string like 'This is a

string' or "It's a string!" .

It is called a literal because it is literal - you use its value literally. The num ber 2 always
represents itself and nothing else - it is a constant because its value cannot be changed.
Hence, all these are referred to as literal constants.

Numbers
Numbers are mainly of two types - integers and floats.

An example of an integer is 2 which is just a whole number.

Exam ples of floating point numbers (or floats for short) are 3.23 and 52.3E-4 . The E
notation indicates powers of 10. In this case, 52.3E-4 means 52.3 * 10^-4^ .

Strings
A string is a sequence of characters. Strings are basically just a bunch of words.

You will be using strings in almost every Python program that you write, so pay attention to
the following part.

Single Quote
You can specify strings using single quotes such as 'Quote me on this' .

All white space i.e. spaces and tabs, within the quotes, are preserved as-is.

Double Quotes
Strings in double quotes work exactly the same way as strings in single quotes. An example
is "What's your name?" .

Triple Quotes
You can specify multi-line strings using triple quotes - ( """ or ''' ). You can use single
quotes and double quotes freely within the triple quotes. An example is:

'''This is a multi-line string. This is the first line.

This is the second line.
"What's your name?," I asked.
He said "Bond, James Bond."
'''

Strings Are Immutable

This m eans that once you have created a string, you cannot change it. Although this might
seem like a bad thing, it really isn't. We will see why this is not a limitation in the various
programs that we see later on.

Note for C/C++ Programmers

There is no separate char data type in Python. There is no real need for it and I am
sure you won't miss it.

Note for Perl/PHP Programmers

Remember that single-quoted strings and double-quoted strings are the same - they do
 not differ in any way.

The format method

Sometimes we may want to construct strings from other information. This is where the
format() method is useful.

Save the following lines as a file str_format.py :

age = 20
name = 'Swaroop'

print('{0} was {1} years old when he wrote this book'.format(name, age))
print('Why is {0} playing with that python?'.format(name))

Output:

$ python str_format.py
Swaroop was 20 years old when he wrote this book
Why is Swaroop playing with that python?

How It Works

A string can use certain specifications and subsequently, the format method can be called
to substitute those specifications with corresponding arguments to the format method.

Observe the first usage where we use {0} and this corresponds to the variable name

which is the first argum ent to the format method. Similarly, the second specification is {1}

corresponding to age which is the second argument to the format method. Note that
Python starts counting from 0 which m eans that first position is at index 0, second position is
at index 1, and so on.

Notice that we could have achieved the sam e using string concatenation:

name + ' is ' + str(age) + ' years old'

but that is much uglier and error-prone. Second, the conversion to string would be done
automatically by the format method instead of the explicit conversion to strings needed in
this case. Third, when using the format method, we can change the message without
having to deal with the variables used and vice-versa.

Also note that the numbers are optional, so you could have also written as:

age = 20
name = 'Swaroop'

print('{} was {} years old when he wrote this book'.format(name, age))

print('Why is {} playing with that python?'.format(name))
which will give the same exact output as the previous program.

We can also name the parameters:

age = 20
name = 'Swaroop'

print('{name} was {age} years old when he wrote this book'.format(name=name, age=age))
print('Why is {name} playing with that pyt hon?'.format(name=name))

which will give the sam e exact output as the previous program.

Python 3.6 introduced a shorter way to do nam ed parameters, called "f-strings":

age = 20
name = 'Swaroop'

print(f'{name} was {age} years old when he wrote this book') # notice the 'f' before
the string
print(f'Why is {name} playing with that python?') # notice the 'f' before the string

which will give the sam e exact output as the previous program.

What Python does in the format method is that it substitutes each argum ent value into the
place of the specification. There can be more detailed specifications such as:

# decimal (.) precision of 3 for float '0.333'

print('{0:.3f}'.format(1.0/3))
# fill with underscores (_) with the text centered
# (^) to 11 width ' hello '
print('{0:_^11}'.format('hello'))
# keyword-based 'Swaroop wrote A Byte of Python'
print('{name} wrote {book}'.format(name='Swaroop', book='A Byte of Python'))

Output:

0.333
hello
Swaroop wrote A Byte of Python

Since we are discussing formatting, note that print always ends with an invisible "new
line" character ( \n ) so that repeated calls to print will all print on a separate line each. To
prevent this newline character from being printed, you can specify that it should end with a
blank:

print('a', end='')
print('b', end='')
Output is:

ab

Or you can end with a space:

print('a', end=' ')

print('b', end=' ')
print('c')

Output is:

a b c

Escape Sequences

Suppose, you want to have a string which contains a single quote ( ' ), how will you specify
this string? For example, the string is "What's your name?" . You cannot specify 'What's

your name?' because Python will be confused as to where the string starts and ends. So,
you will have to specify that this single quote does not indicate the end of the string. This can
be done with the help of what is called an escape sequence. You specify the single quote as
\' : notice the backslash. Now, you can specify the string as 'What\'s your name?' .

Another way of specifying this specific string would be "What's your name?" i.e. using
double quotes. Similarly, you have to use an escape sequence for using a double quote
itself in a double quoted string. Also, you have to indicate the backslash itself using the
escape sequence \\ .

What if you wanted to specify a two-line string? One way is to use a triple-quoted string as
shown previously or you can use an escape sequence for the newline character - \n to
indicate the start of a new line. An exam ple is:

'This is the first line\nThis is the second line'

Another useful escape sequence to know is the tab: \t . There are many more escape
sequences but I have mentioned only the most useful ones here.

One thing to note is that in a string, a single backslash at the end of the line indicates that
the string is continued in the next line, but no newline is added. For example:

"This is the first sentence. \

This is the second sentence."
is equivalent to

"This is the first sentence. This is the second sentence."

Raw String
If you need to specify some strings where no special processing such as escape sequences
are handled, then what you need is to specify a raw string by prefixing r or R to the
string. An example is:

r"Newlines are indicated by \n"

Note for Regular Expression Users

Always use raw strings when dealing with regular expressions. Otherwise, a lot of
backwhacking may be required. For example, backreferences can be referred to as
'\\1' or r'\1' .

Variable
Using just literal constants can soon becom e boring - we need some way of storing any
information and manipulate them as well. This is where variables come into the picture.
Variables are exactly what the name implies - their value can vary, i.e., you can store
anything using a variable. Variables are just parts of your computer's memory where you
store some inform ation. Unlike literal constants, you need some method of accessing these
variables and hence you give them nam es.

Identifier Naming
Variables are exam ples of identifiers. Identifiers are names given to identify something.
There are some rules you have to follow for nam ing identifiers:

The first character of the identifier m ust be a letter of the alphabet (uppercase ASCII or
lowercase ASCII or Unicode character) or an underscore ( _ ).
The rest of the identifier name can consist of letters (uppercase ASCII or lowercase
ASCII or Unicode character), underscores ( _ ) or digits (0-9).
Identifier nam es are case-sensitive. For example, myname and myName are not the
same. Note the lowercase n in the former and the uppercase N in the latter.
Exam ples of valid identifier names are i , name_2_3 . Examples of invalid identifier
names are 2things , this is spaced out , my-name and >a1b2_c3 .
Data Types
Variables can hold values of different types called data types. The basic types are num bers
and strings, which we have already discussed. In later chapters, we will see how to create
our own types using classes.

Object
Remember, Python refers to anything used in a program as an object. This is meant in the
generic sense. Instead of saying "the something"', we say "the object".

Note for Object Oriented Programming users:

Python is strongly object-oriented in the sense that everything is an object including

numbers, strings and functions.

We will now see how to use variables along with literal constants. Save the following
example and run the program .

How to write Python programs

Henceforth, the standard procedure to save and run a Python program is as follows:

1. Open your editor of choice.

2. Type the program code given in the example.
3. Save it as a file with the filename mentioned.
4. Run the interpreter with the command python [Link] to run the program.

Example: Using Variables And Literal Constants

Type and run the following program:

# Filename : [Link]
i = 5
print(i)
i = i + 1
print(i)

s = '''This is a multi-line string.

This is the second line.'''
print(s)

Output:
 5
6
This is a multi-line string.
This is the second line.

How It Works

Here's how this program works. First, we assign the literal constant value 5 to the variable
i using the assignment operator ( = ). This line is called a statement because it states that
something should be done and in this case, we connect the variable name i to the value
5 . Next, we print the value of i using the print statem ent which, unsurprisingly, just
prints the value of the variable to the screen.

Then we add 1 to the value stored in i and store it back. We then print it and expectedly,
we get the value 6 .

Similarly, we assign the literal string to the variable s and then print it.

Note for static language programmers

Variables are used by just assigning them a value. No declaration or data type definition
is needed/used.

Logical And Physical Line

A physical line is what you see when you write the program. A logical line is what Python
sees as a single statement. Python im plicitly assumes that each physical line corresponds to
a logical line.

An exam ple of a logical line is a statement like print('hello world') - if this was on a line
by itself (as you see it in an editor), then this also corr esponds to a physical line.

Im plicitly, Python encourages the use of a single statement per line which m akes code more
readable.

If you want to specify more than one logical line on a single physical line, then you have to
explicitly specify this using a s emicolon ( ; ) which indicates the end of a logical
line/statem ent. For example:

i = 5
print(i)

is effectively same as

i = 5;
print(i);
which is also sam e as

i = 5; print(i);

and same as

i = 5; print(i)

However, I strongly recommend that you stick to writing a m aximum of a single logical line
on each single physical line. The idea is that you should never use the semicolon. In fact, I
have never used or even seen a semicolon in a Python program.

There is one kind of situation where this concept is really useful: if you have a long line of
code, you can break it into multiple physical lines by using the backslash. This is referred to
as explicit line joining:

s = 'This is a string. \
This continues the string.'
print(s)

Output:

This is a string. This continues the string.

Similarly,

i = \
5

is the same as

i = 5

Sometimes, there is an implicit assumption where you don't need to use a backslash. This is
the case where the logical line has a starting parentheses, starting square brackets or a
starting curly braces but not an ending one. This is called implicit line joining. You can see
this in action when we write programs using list in later c hapters.

Indentation
Whitespace is important in Python. Actually, whitespace at the beginning of the line is
important. This is called indentation. Leading whitespace (spaces and tabs) at the beginning
of the logical line is used to determine the indentation level of the logical line, which in turn is
used to determine the grouping of statements.

This m eans that statements which go together must have the same indentation. Each such
set of statem ents is called a block. We will see examples of how blocks are im portant in later
chapters.

One thing you should rem ember is that wrong indentation can give rise to errors. For
example:

i = 5
# Error below! Notice a single space at the start of the line
print('Value is', i)
print('I repeat, the value is', i)

When you run this, you get the following error:

File "[Link]", line 3

print('Value is', i)
^
IndentationError: unexpected indent

Notice that there is a single space at the beginning of the second line. The error indicated by
Python tells us that the syntax of the program is invalid i.e. the program was not properly
written. What this means to you is that you cannot arbitrarily start new blocks of statements
(except for the default main block which you have be en using all along, of course). Cases
where you can use new blocks will be detailed in later chapters such as the control flow.

How to indent

Use four spaces for indentation. This is the official Python language recommendation.
Good editors will automatically do this for you. Make sure you use a consistent number
of spaces for indentation, otherwise your program will not run or will have unexpected
behavior.

Note to static language programmers

Python will always use indentation for blocks and will never use braces. Run from
future import braces to learn more.

Summary
Now that we have gone through m any nitty-gritty details, we can move on to more
interesting stuff such as control flow statements. Be sure to becom e comfortable with what
you have read in this chapter.
Operators and Expressions
Most statements (logical lines) that you write will contain expressions. A sim ple example of
an expression is 2 + 3 . An expression can be broken down into operators and operands.

Operators are functionality that do som ething and can be represented by symbols such as
+ or by special keywords. Operators require som e data to operate on and such data is
called operands. In this case, 2 and 3 are the operands.

Operators
We will briefly take a look at the operators and their usage.

Note that you can evaluate the expressions given in the examples using the interpreter
interactively. For example, to test the expression 2 + 3 , use the interactive Python
interpreter prom pt:

>>> 2 + 3
5
>>> 3 * 5
15
>>>

Here is a quick overview of the available operators:

+ (plus)

Adds two objects

3 + 5 gives 8 . 'a' + 'b' gives 'ab' .
- (minus)

Gives the subtraction of one number from the other; if the first operand is absent it
is assumed to be zero.
-5.2 gives a negative number and 50 - 24 gives 26 .
* (multiply)

Gives the m ultiplication of the two num bers or returns the string repeated that many
times.
2 * 3 gives 6 . 'la' * 3 gives 'lalala' .
** (power)

Returns x to the power of y

 3 ** 4 gives 81 (i.e. 3 * 3 * 3 * 3 )
/ (divide)

Divide x by y
13 / 3 gives 4.333333333333333

// (divide and floor)

Divide x by y and round the answer down to the nearest integer value. Note that if
one of the values is a float, you'll get back a float.
13 // 3 gives 4

-13 // 3 gives -5

9//1.81 gives 4.0

% (modulo)

Returns the rem ainder of the division

13 % 3 gives 1 . -25.5 % 2.25 gives 1.5 .
<< (left shift)

Shifts the bits of the number to the left by the number of bits specified. (Each
number is represented in mem ory by bits or binary digits i.e. 0 and 1)
2 << 2 gives 8 . 2 is represented by 10 in bits.
Left shifting by 2 bits gives 1000 which represents the decimal 8 .
>> (right shift)

Shifts the bits of the number to the right by the number of bits specified.
11 >> 1 gives 5 .
11 is represented in bits by 1011 which when right shifted by 1 bit gives
101 which is the decim al 5 .
& (bit-wise AND)

Bit-wise AND of the num bers

5 & 3 gives 1 .
| (bit-wise OR)

Bitwise OR of the numbers

5 | 3 gives 7

^ (bit-wise XOR)

Bitwise XOR of the numbers

5 ^ 3 gives 6

~ (bit-wise invert)

The bit-wise inversion of x is -(x+1)

~5 gives -6 .
< (less than)

Returns whether x is less than y. All comparison operators return True or False .
Note the capitalization of these names.
5 < 3 gives False and 3 < 5 gives True .
Comparisons can be chained arbitrarily: 3 < 5 < 7 gives True .
> (greater than)

Returns whether x is greater than y

5 > 3 returns True . If both operands are numbers, they are first converted to a
common type. Otherwise, it always returns False .
<= (less than or equal to)

Returns whether x is less than or equal to y

x = 3; y = 6; x <= y returns True

>= (greater than or equal to)

Returns whether x is greater than or equal to y

x = 4; y = 3; x >= 3 returns True

== (equal to)

Compares if the objects are equal

x = 2; y = 2; x == y returns True

x = 'str'; y = 'stR'; x == y returns False

x = 'str'; y = 'str'; x == y returns True

!= (not equal to)

Compares if the objects are not equal

x = 2; y = 3; x != y returns True

not (boolean NOT)

If x is True , it returns False . If x is False , it returns True .

x = True; not x returns False .
and (boolean AND)

x and y returns False if x is False , else it returns evaluation of y

x = False; y = True; x and y returns False since x is False. In this case, Python
will not evaluate y since it knows that the left hand side of the 'and' expression is
False which implies that the whole expression will be False irrespective of the
other values. This is called short-circuit evaluation.
or (boolean OR)

If x is True , it returns True, else it returns evaluation of y

x = True; y = False; x or y returns True . Short-circuit evaluation applies here
 as well.

Shortcut for math operation and assignment

It is comm on to run a math operation on a variable and then assign the result of the
operation back to the variable, hence there is a shortcut for such expressions:

a = 2
a = a * 3

can be written as:

a = 2
a *= 3

Notice that var = var operation expression becomes var operation= expression .

Evaluation Order
If you had an expression such as 2 + 3 * 4 , is the addition done first or the multiplication?
Our high school maths tells us that the multiplication should be done first. This means that
the multiplication operator has higher precedence than the addition operator.

The following table gives the precedence table for Python, from the lowest precedence (least
binding) to the highest precedence (m ost binding). This means that in a given expression,
Python will first evaluate the operators and expressions lower in the table before the ones
listed higher in the table.

The following table, taken from the Python reference manual, is provided for the sake of
completeness. It is far better to use parentheses to group operators and operands
appropriately in order to explicitly specify the precedence. This makes the program more
readable. See Changing the Order of Evaluation below for details.

lambda : Lambda Expression

if - else : Conditional expression
or : Boolean OR
and : Boolean AND
not x : Boolean NOT
in, not in, is, is not, <, <=, >, >=, !=, == : Comparisons, including m embership
tests and identity tests
 | : Bitwise OR
^ : Bitwise XOR
& : Bitwise AND
<<, >> : Shifts
+, - : Addition and subtraction
*, /, //, % : Multiplication, Division, Floor Division and Remainder
+x, -x, ~x : Positive, Negative, bitwise NOT
** : Exponentiation
x[index], x[index:index], x(arguments...), [Link] : Subscription, slicing, call,
attribute reference
(expressions...), [expressions...], {key: value...}, {expressions...} : Binding or
tuple display, list display, dictionary display, set display

The operators which we have not already come across will be explained in later chapters.

Operators with the same precedence are listed in the same row in the above table. For
example, + and - have the same precedence.

Changing the Order Of Evaluation

To make the expressions more readable, we can use parentheses. For example, 2 + (3 *

4) is definitely easier to understand than 2 + 3 * 4 which requires knowledge of the

operator precedences. As with everything else, the parentheses should be used reasonably
(do not overdo it) and should not be redundant, as in (2 + (3 * 4)) .

There is an additional advantage to using parentheses - it helps us to change the order of

evaluation. For example, if you want addition to be evaluated before multiplication in an
expression, then you can write something like (2 + 3) * 4 .

Associativity
Operators are usually associated from left to right. This m eans that operators with the same
precedence are evaluated in a left to right manner. For example, 2 + 3 + 4 is evaluated as
(2 + 3) + 4 .

Expressions
Exam ple (save as [Link] ):
 length = 5
breadth = 2

area = length * breadth

print('Area is', area)
print('Perimeter is', 2 * (length + breadth))

Output:

$ python [Link]
Area is 10
Perimeter is 14

How It Works

The length and breadth of the rectangle are stored in variables by the same name. We use
these to calculate the area and perim eter of the rectangle with the help of expressions. We
store the result of the expression length * breadth in the variable area and then print it
using the print function. In the second case, we directly use the value of the expression 2

* (length + breadth) in the print function.

Also, notice how Python pretty-prints the output. Even though we have not specified a space
between 'Area is' and the variable area , Python puts it for us so that we get a clean nice
output and the program is much more readable this way (since we don't need to worry about
spacing in the strings we use for output). This is an example of how Python makes life easy
for the programmer.

Summary
We have seen how to use operators, operands and expressions - these are the basic
building blocks of any program. Next, we will see how to m ake use of these in our programs
using statem ents.

Control Flow
In the programs we have seen till now, there has always been a series of statem ents
faithfully executed by Python in exact top-down order. What if you wanted to change the flow
of how it works? For example, you want the program to take som e decisions and do different
things depending on different situations, such as printing 'Good Morning' or 'Good Evening'
depending on the time of the day?

As you m ight have guessed, this is achieved using control flow statem ents. There are three
control flow statements in Python - if , for and while .
The if statement
The if statement is used to check a condition: if the condition is true, we run a block of
statem ents (called the if-block), else we process another block of statements (called the
else-block). The else clause is optional.

Exam ple (save as [Link] ):

number = 23
guess = int(input('Enter an integer : '))

if guess == number:
# New block starts here
print('Congratulations, you guessed it.' )
print('(but you do not win any prizes!)' )
# New block ends here
elif guess < number:
# Another block
print('No, it is a little higher than that')
# You can do whatever you want in a block ...
else:
print('No, it is a little lower than that' )
# you must have guessed > number to reach here

print('Done')
# This last statement is always executed,
# after the if statement is executed.

Output:

$ python [Link]
Enter an integer : 50
No, it is a little lower than that
Done

$ python [Link]
Enter an integer : 22
No, it is a little higher than that
Done

$ python [Link]
Enter an integer : 23
Congratulations, you guessed it.
(but you do not win any prizes!)
Done

How It Works
In this program, we take guesses from the user and check if it is the number that we have.
We set the variable number to any integer we want, say 23 . Then, we take the user's
guess using the input() function. Functions are just reusable pieces of programs.

We supply a string to the built-in input function which prints it to the screen and waits for
input from the user. Once we enter something and press kbd:[enter] key, the input()

function returns what we entered, as a string. We then convert this string to an integer using
int and then store it in the variable guess . Actually, the int is a class but all you need to
know right now is that you can use it to convert a string to an integer (assuming the string
contains a valid integer in the text).

Next, we com pare the guess of the user with the num ber we have chosen. If they are equal,
we print a success message. Notice that we use indentation levels to tell Python which
statem ents belong to which block. This is why indentation is so important in Python. I hope
you are sticking to the "consistent indentation" rule. Are you?

Notice how the if statement contains a colon at the end - we are indicating to Python that
a block of statements follows.

Then, we check if the guess is less than the number, and if so, we inform the user that they
must guess a little higher than that. What we have used here is the elif clause which
actually combines two related if else-if else statements into one com bined if-elif-

else statement. This makes the program easier and reduces the amount of indentation
required.

The elif and else statements must also have a colon at the en d of the logical line
followed by their corresponding block of statements (with proper indentation, of course)

You can have another if statement inside the if-block of an if statem ent and so on - this
is called a nested if statement.

Remember that the elif and else parts are optional. A minimal valid if statement is:

if True:
print('Yes, it is true')

After Python has finished executing the complete if statement along with the associated
elif and else clauses, it moves on to the next statement in the block containing the if

statem ent. In this case, it is the m ain block (where execution of the program starts), and the
next statement is the print('Done') statement. After this, Python sees the ends of the
program and sim ply finishes up.

Even though this is a very simple program, I have been pointing out a lot of things that you
should notice. All these are pretty straightforward (and surprisingly simple for those of you
from C/C++ backgrounds). You will need to becom e aware of all these things initially, but
after some practice you will become comfortable with them, and it will all feel 'natural' to you.
 Note for C/C++ Programmers

There is no switch statem ent in Python. You can use an if..elif..else statement to
do the same thing (and in some cases, use a dictionary to do it quickly)

The while Statement

The while statem ent allows you to repeatedly execute a block of statements as long as a
condition is true. A while statement is an exam ple of what is called a looping statement. A
while statement can have an optional else clause.

Exam ple (save as [Link] ):

number = 23
running = True

while running:
guess = int(input('Enter an integer : '))

if guess == number:
print('Congratulations, you guessed it.')
# this causes the while loop to stop
running = False
elif guess < number:
print('No, it is a little higher than that.' )
else:
print('No, it is a little lower than that.')
else:
print('The while loop is over.')
# Do anything else you want to do here

print('Done')

Output:

$ python [Link]
Enter an integer : 50
No, it is a little lower than that.
Enter an integer : 22
No, it is a little higher than that.
Enter an integer : 23
Congratulations, you guessed it.
The while loop is over.
Done

How It Works

In this program, we are still playing the guessing gam e, but the advantage is that the user is
allowed to keep guessing until he guesses correctl y - there is no need to repeatedly run the
 program for each guess, as we have done in the previous section. This aptly demonstrates
the use of the while statem ent.

We move the input and if statements to inside the while loop and set the variable
running to True before the while loop. First, we check if the variable running is True

and then proceed to execute the corresponding while-block. After this block is executed, the
condition is again checked which in this case is the running variable. If it is true, we
execute the while-block again, else we continue to execute the optional else-block and then
continue to the next statement.

The else block is executed when the while loop condition becomes False - this may
even be the first tim e that the c ondition is checked. If there is an else clause for a while

loop, it is always executed unless you break out of the loop with a break statement.

The True and False are called Boolean types and you can consider them to be equivalent
to the value 1 and 0 respectively.

Note for C/C++ Programmers

Remember that you can have an else clause for the while loop.

The for loop

The for..in statement is another looping statem ent which iterates over a sequence of
objects i.e. go through each item in a sequence. We will see more about sequences in detail
in later chapters. What you need to know right now is that a sequence is just an ordered
collection of items.

Exam ple (save as [Link] ):

for i in range(1, 5):

print(i)
else:
print('The for loop is over')

Output:

$ python [Link]
1
2
3
4
The for loop is over

How It Works

In this program, we are printing a sequence of num bers. We generate this sequence of
numbers using the built-in range function.

What we do here is supply it two numbers and range returns a sequence of numbers
starting from the first number and up to the second number. For example, range(1,5) gives
the sequence [1, 2, 3, 4] . By default, range takes a step count of 1. If we supply a third

number to range , then that becomes the step count. For example, range(1,5,2) gives
[1,3] . Remember that the range extends up to the second num ber i.e. it does not include
the second num ber.

Note that range() generates only one number at a tim e, if you want the full list of numbers,
call list() on the range() , for example, list(range(5)) will result in [0, 1, 2, 3, 4] .
Lists are explained in the data structures chapter.

The for loop then iterates over this range - for i in range(1,5) is equivalent to for i in

[1, 2, 3, 4] which is like assigning each number (or object) in the sequence to i, one at a
time, and then executing the block of statements for each value of i . In this case, we just
print the value in the block of statem ents.

Remember that the else part is optional. When included, it is always executed once after
the for loop is over unless a break statement is encountered.

Remember that the for..in loop works for any sequence. Here, we have a list of numbers
generated by the built-in range function, but in general we can use any kind of sequence of
any kind of objects! We will explore this idea in detail in later chapters.

Note for C/C++/Java/C# Programmers

The Python for loop is radically different from the C/C++ for loop. C# programm ers
will note that the for loop in Python is similar to the foreach loop in C#. Java
programmers will note that the same is similar to for (int i : IntArray) in Java 1.5.

In C/C++, if you want to write for (int i = 0; i < 5; i++) , then in Python you write
just for i in range(0,5) . As you can see, the for loop is simpler, more expressive
and less error prone in Python.

The break Statement

The break statement is used to break out of a loop statement i.e. stop the execution of a
looping statement, even if the loop condition has not become False or the sequence of
items has not been completely iterated over.

An im portant note is that if you break out of a for or while loop, any corresponding loop
else block is not executed.

Exam ple (save as [Link] ):

 while True:
s = input('Enter something : ')
if s == 'quit':
break
print('Length of the string is', len(s))
print('Done')

Output:

$ python [Link]
Enter something : Programming is fun
Length of the string is 18
Enter something : When the work is done
Length of the string is 21
Enter something : if you wanna make your work also fun:
Length of the string is 37
Enter something : use Python!
Length of the string is 11
Enter something : quit
Done

How It Works

In this program, we repeatedly take the user's input and print the length of each input each
time. We are providing a special condition to stop the program by checking if the user input
is 'quit' . We stop the program by breaking out of the loop and reach the end of the
program.

The length of the input string can be found out using the built-in len function.

Remember that the break statem ent can be used with the for loop as well.

Swaroop's Poetic Python

The input I have used here is a mini poem I have written:

Programming is fun
When the work is done
if you wanna make your work also fun:
use Python!

The continue Statement

The continue statement is used to tell Python to skip the rest of the statements in the
current loop block and to continue to the next iteration of the loop.
Exam ple (save as [Link] ):

while True:
s = input('Enter something : ')
if s == 'quit':
break
if len(s) < 3:
print('Too small')
continue
print('Input is of sufficient length')
# Do other kinds of processing here...

Output:

$ python [Link]
Enter something : a
Too small
Enter something : 12
Too small
Enter something : abc
Input is of sufficient length
Enter something : quit

How It Works

In this program, we accept input from the user, but we process the input string only if it is at
least 3 characters long. So, we use the built-in len function to get the length and if the
length is less than 3, we skip the rest of the statem ents in the block by using the continue

statem ent. Otherwise, the rest of the statem ents in the loop are executed, doing any kind of
processing we want to do here.

Note that the continue statement works with the for loop as well.

Summary
We have seen how to use the three control flow statements - if , while and for along
with their associated break and continue statem ents. These are some of the most
commonly used parts of Python and hence, becoming comfortable with them is essential.

Next, we will see how to create and use functions.

Functions
Functions are reusable pieces of programs. They allow you to give a nam e to a block of
statem ents, allowing you to run that block using the specified name anywhere in your
program and any number of times. This is known as calling the function. We have already
used many built-in functions such as len and range .

The function concept is probably the m ost im portant building block of any non-trivial software
(in any programming language), so we will explore various aspects of functions in this
chapter.

Functions are defined using the def keyword. After this keyword comes an identifier name
for the function, followed by a pair of parentheses which may enclose some nam es of
variables, and by the final colon that ends the line. Next follows the block of statements that
are part of this function. An exam ple will show that this is actually very sim ple:

Exam ple (save as [Link] ):

def say_hello():
# block belonging to the function
print('hello world')
# End of function

say_hello() # call the function

say_hello() # call the function again

Output:

$ python [Link]
hello world
hello world

How It Works

We define a function called say_hello using the syntax as explained above. This function
takes no parameters and hence there are no variables declared in the parentheses.
Param eters to functions are just input to the function so that we can pass in different values
to it and get back corresponding results.

Notice that we can call the same function twice which means we do not have to write the
same code again.

Function Parameters
A function can take parameters, which are values you supply to the function so that the
function can do something utilising those values. These parameters are just like variables
except that the values of these variables are defined when we call the function and are
already assigned values when the function runs.

Param eters are specified within the pair of parentheses in the function definition, separated
by commas. When we call the function, we supply the values in the same way. Note the
terminology used - the names given in the function definition are called param eters whereas
the values you supply in the function call are called argum ents.

Exam ple (save as function_param.py ):

def print_max(a, b):

if a > b:
print(a, 'is maximum')
elif a == b:
print(a, 'is equal to', b)
else:
print(b, 'is maximum')

# directly pass literal values

print_max(3, 4)

x = 5
y = 7

# pass variables as arguments

print_max(x, y)

Output:

$ python function_param.py
4 is maximum
7 is maximum

How It Works

Here, we define a function called print_max that uses two parameters called a and b .
We find out the greater num ber using a simple if..else statement and then print the
bigger number.

The first time we call the function print_max , we directly supply the numbers as argum ents.
In the second case, we call the function with variables as arguments. print_max(x, y)

causes the value of argument x to be assigned to parameter a and the value of argum ent
y to be assigned to parameter b . The print_max function works the same way in both
cases.

Local Variables
When you declare variables inside a function definition, they are not related in any way to
other variables with the sam e names used outside the function - i.e. variable names are
local to the function. This is called the scope of the variable. All variables have the scope of
the block they are declared in starting from the point of definition of the name.

Exam ple (save as function_local.py ):

 x = 50

def func(x):
print('x is', x)
x = 2
print('Changed local x to', x)

func(x)
print('x is still', x)

Output:

$ python function_local.py
x is 50
Changed local x to 2
x is still 50

How It Works

The first time that we print the value of the name x with the first line in the function's body,
Python uses the value of the param eter declared in the main block, above the function
definition.

Next, we assign the value 2 to x . The name x is local to our function. So, when we
change the value of x in the function, the x defined in the m ain block remains unaffected.

With the last print statem ent, we display the value of x as defined in the main block,
thereby confirming that it is actually unaffected by the local assignment within the previously
called function.

The global statement

If you want to assign a value to a name defined at the top level of the program (i.e. not inside
any kind of scope such as functions or classes), then you have to tell Python that the name
is not local, but it is global. We do this using the global statem ent. It is impossible to assign
a value to a variable defined outside a function without the global statem ent.

You can use the values of such variables defined outside the function (assuming there is no
variable with the same name within the function). However, this is not encouraged and
should be avoided since it becom es unclear to the reader of the program as to where that
variable's definition is. Using the global statement m akes it amply clear that the variable is
defined in an outermost block.

Exam ple (save as function_global.py ):

 x = 50

def func():
global x

print('x is', x)
x = 2
print('Changed global x to', x)

func()
print('Value of x is', x)

Output:

$ python function_global.py
x is 50
Changed global x to 2
Value of x is 2

How It Works

The global statement is used to declare that x is a global variable - hence, when we
assign a value to x inside the function, that change is reflected when we use the value of
x in the main block.

You can specify more than one global variable using the same global statement e.g.
global x, y, z .

Default Argument Values

For som e functions, you m ay want to make some parameters optional and use default
values in case the user does not want to provide values for them. This is done with the help
of default argument values. You can specify default argument values for parameters by
appending to the parameter name in the function definition the assignm ent operator ( = )
followed by the default value.

Note that the default argum ent value should be a constant. More precisely, the default
argument value should be immutable - this is explained in detail in later chapters. For now,
just remember this.

Exam ple (save as function_default.py ):

def say(message, times=1):

print(message * times)

say('Hello')
say('World', 5)
Output:

$ python function_default.py
Hello
WorldWorldWorldWorldWorld

How It Works

The function named say is used to print a string as m any times as specified. If we don't
supply a value, then by default, the string is printed just once. We achieve this by specifying
a default argument value of 1 to the parameter times .

In the first usage of say , we supply only the string and it prints the string once. In the
second usage of say , we supply both the string and an argument 5 stating that we want
to say the string message 5 times.

CAUTION

Only those param eters which are at the end of the parameter list can be given default
argument values i.e. you cannot have a parameter with a default argument value
preceding a parameter without a default argum ent value in the function's parameter list.

This is because the values are assigned to the parameters by position. For
example, def func(a, b=5) is valid, but def func(a=5, b) is not valid.

Keyword Arguments
If you have some functions with many parameters and you want to specify only some of
them, then you can give values for such parameters by naming them - this is called keyword
arguments - we use the nam e (keyword) instead of the position (which we have been using
all along) to specify the arguments to the function.

There are two advantages - one, using the function is easier since we do not need to worry
about the order of the arguments. Two, we can give values to only those param eters to
which we want to, provided that the other parameters have default argument values.

Exam ple (save as function_keyword.py ):

def func(a, b=5, c=10):

print('a is', a, 'and b is', b, 'and c is', c)

func(3, 7)
func(25, c=24)
func(c=50, a=100)

Output:
 $ python function_keyword.py
a is 3 and b is 7 and c is 10
a is 25 and b is 5 and c is 24
a is 100 and b is 5 and c is 50

How It Works

The function named func has one parameter without a default argument value, followed by
two parameters with default argument values.

In the first usage, func(3, 7) , the parameter a gets the value 3 , the parameter b gets
the value 7 and c gets the default value of 10 .

In the second usage func(25, c=24) , the variable a gets the value of 25 due to the
position of the argument. Then, the param eter c gets the value of 24 due to nam ing i.e.
keyword arguments. The variable b gets the default value of 5 .

In the third usage func(c=50, a=100) , we use keyword arguments for all specified values.
Notice that we are specifying the value for parameter c before that for a even though a

is defined before c in the function definition.

VarArgs parameters
Sometimes you might want to define a function that can take any num ber of param eters, i.e.
variable number of argum ents, this can be achieved by using the stars (save as
function_varargs.py ):

def total(a=5, *numbers, **phonebook):

print('a', a)

#iterate through all the items in tuple

for single_item in numbers:
print('single_item', single_item)

#iterate through all the items in dictionary

for first_part, second_part in [Link]():
print(first_part,second_part)

total(10,1,2,3,Jack=1123,John=2231,Inge=1560)

Output:
$ python function_varargs.py
a 10
single_item 1
single_item 2
single_item 3
Inge 1560
John 2231
Jack 1123
How It Works

When we declare a starred param eter such as *param , then all the positional arguments
from that point till the end are collected as a tuple called 'param'.

Similarly, when we declare a double-starred parameter such as **param , then all the
keyword arguments from that point till the end are collected as a dictionary called 'param'.

We will explore tuples and dictionaries in a later chapter.

The return statement

The return statement is used to return from a function i.e. break out of the function. We
can optionally return a value from the function as well.

Exam ple (save as function_return.py ):

def maximum(x, y):

if x > y:
return x
elif x == y:
return 'The numbers are equal'
else:
return y

print(maximum(2, 3))

Output:

$ python function_return.py
3

How It Works

The maximum function returns the maxim um of the parameters, in this case the numbers
supplied to the function. It uses a simple if..else statem ent to find the greater value and
then returns that value.

Note that a return statement without a value is equivalent to return None . None is a
special type in Python that represents nothingness. For example, it is used to indicate that a
variable has no value if it has a value of None .

Every function implicitly contains a return None statement at the end unless you have
written your own return statement. You can see this by running print(some_function())

where the function some_function does not use the return statement such as:

def some_function():
pass
The pass statement is used in Python to indicate an em pty block of statem ents.

TIP: There is a built-in function called max that already implem ents the 'find m aximum'
functionality, so use this built-in function whenever possible.

DocStrings
Python has a nifty feature called documentation strings, usually referred to by its shorter
name docstrings. DocStrings are an important tool that you should make use of since it
helps to document the program better and makes it easier to understand. Amazingly, we can
even get the docstring back from, say a function, when the program is actually running!

Exam ple (save as function_docstring.py ):

def print_max(x, y):

'''Prints the maximum of two numbers.

The two values must be integers.'''

# convert to integers, if possible
x = int(x)
y = int(y)

if x > y:
print(x, 'is maximum')
else:
print(y, 'is maximum')

print_max(3, 5)
print(print_max. doc )

Output:

$ python function_docstring.py
5 is maximum
Prints the maximum of two numbers.

The two values must be integers.

How It Works

A string on the first logical line of a function is the docstring for that function. Note that
DocStrings also apply to modules and classes which we will learn about in the respective
chapters.

The convention followed for a docstring is a multi-line string where the first line starts with a
capital letter and ends with a dot. Then the second line is blank followed by any detailed
explanation starting from the third line. You are strongly advised to follow this convention for
all your docstrings for all your non-trivial functions.

We can access the docstring of the print_max function using the doc (notice the
double underscores) attribute (name belonging to) of the function. Just remember that
Python treats everything as an object and this includes functions. We'll learn more about
objects in the chapter on classes.

If you have used help() in Python, then you have already seen the usage of docstrings!
What it does is just fetch the doc attribute of that function and displays it in a neat
manner for you. You can try it out on the function above - just include help(print_max) in
your program. Rem ember to press the q key to exit help.

Automated tools can retrieve the docum entation from your program in this manner.
Therefore, I strongly recommend that you use docstrings for any non-trivial function that you
write. The pydoc command that comes with your Python distribution works similarly to
help() using docstrings.

Summary
We have seen so many aspects of functions but note that we still haven't covered all aspects
of them. However, we have already covered most of what you'll use regarding Python
functions on an everyday basis.

Next, we will see how to use as well as create Python m odules.

Modules
You have seen how you can reuse code in your program by defining functions once. What if
you wanted to reuse a num ber of functions in other programs that you write? As you might
have guessed, the answer is modules.

There are various methods of writing m odules, but the simplest way is to create a file with a
.py extension that contains functions and variables.

Another method is to write the modules in the native language in which the Python
interpreter itself was written. For example, you can write modules in the C programming
language and when com piled, they can be used from your Python code when using the
standard Python interpreter.

A module can be im ported by another program to make use of its functionality. This is how
we can use the Python standard library as well. First, we will see how to use the standard
library modules.

Exam ple (save as module_using_sys.py ):

 import sys

print('The command line arguments are:')

for i in [Link]:
print(i)

print('\n\nThe PYTHONPATH is', [Link], '\n')

Output:

$ python module_using_sys.py we are arguments # each arg is separated by white spac

e
The command line arguments are:
module_using_sys.py
we
are
arguments

The PYTHONPATH is ['/tmp/py',

# many entries here, not shown here
'/Library/Python/2.7/site-packages',
'/usr/local/lib/python2.7/site-packages']
How It Works

First, we import the sys module using the import statement. Basically, this translates to
us telling Python that we want to use this module. The sys module contains functionality
related to the Python interpreter and its environment i.e. the system.

When Python executes the import sys statement, it looks for the sys module. In this
case, it is one of the built-in modules, and hence Python knows where to find it.

If it was not a com piled module i.e. a m odule written in Python, then the Python interpreter
will search for it in the directories listed in its [Link] variable. If the m odule is found, then
the statem ents in the body of that module are run and the module is made available for you
to use. Note that the initialization is done only the first tim e that we import a m odule.

The argv variable in the sys module is accessed using the dotted notation i.e. [Link] .
It clearly indicates that this nam e is part of the sys module. Another advantage of this
approach is that the name does not clash with any argv variable used in your program.

The [Link] variable is a list of strings (lists are explained in detail in a later chapter).
Specifically, the [Link] contains the list of command line arguments i.e. the argum ents
passed to your program using the command line.

If you are using an IDE to write and run these programs, look for a way to specify command
line arguments to the program in the menus.

Here, when we execute python module_using_sys.py we are arguments , we run the m odule
module_using_sys.py with the python command and the other things that follow are
arguments passed to the program . Python stores the command line arguments in the
[Link] variable for us to use.

Remember, the name of the script running is always the first element in the [Link] list.
So, in this case we will have 'module_using_sys.py' as [Link][0] , 'we' as
[Link][1] , 'are' as [Link][2] and 'arguments' as [Link][3] . Notice that
Python starts counting from 0 and not 1.

The [Link] contains the list of directory names where modules are im ported from.
Observe that the first string in [Link] is empty - this em pty string indicates that the
current directory is also part of the [Link] which is same as the PYTHONPATH environm ent
variable. This means that you can directly import m odules located in the current directory.
Otherwise, you will have to place your module in one of the directories listed in [Link] .

Note that the current directory is the directory from which the program is launched. Run
import os; print([Link]()) to find out the current directory of your program.
Byte-compiled .pyc files
Im porting a module is a relatively costly affair, so Python does some tricks to make it faster.
One way is to create byte-compiled files with the extension .pyc which is an intermediate
form that Python transforms the program into (rem ember the introduction section on how
Python works?). This .pyc file is useful when you import the module the next tim e from a
different program - it will be much faster since a portion of the processing required in
importing a module is already done. Also, these byte-compiled files are platform-
independent.

NOTE: These .pyc files are usually created in the sam e directory as the corresponding
.py files. If Python does not have perm ission to write to files in that directory, then the
.pyc files will not be created.

The from..import statement

If you want to directly import the argv variable into your program (to avoid typing the sys.
everytime for it), then you can use the from sys import argv statement.

WARNING: In general, avoid using the from..import statement, use the import

statem ent instead. This is because your program will avoid nam e clashes and will be
more readable.

Exam ple:

from math import sqrt

print("Square root of 16 is", sqrt(16))

A module's name

Every m odule has a name and statements in a m odule can find out the name of their
module. This is handy for the particular purpose of figuring out whether the m odule is being
run standalone or being imported. As mentioned previously, when a module is imported for
the first time, the code it contains gets executed. We can use this to make the module
behave in different ways depending on whether it is being used by itself or being imported
from another m odule. This can be achieved using the name attribute of the module.

Exam ple (save as module_using_name.py ):

 if name == ' main ':
print('This program is being run by itself')
else:
print('I am being imported from another module' )

Output:

$ python module_using_name.py
This program is being run by itself

$ python
>>> import module_using_name
I am being imported from another module
>>>

How It Works

Every Python m odule has its name defined. If this is ' main ' , that implies that the
module is being run standalone by the user and we can take appropriate actions.

Making Your Own Modules

Creating your own modules is easy, you've been doing it all along! This is because every
Python program is also a m odule. You just have to make sure it has a .py extension. The
following example should make it clear.

Exam ple (save as [Link] ):

def say_hi():
print('Hi, this is mymodule speaking.')

version = '0.1'

The above was a sample m odule. As you can see, there is nothing particularly special about
it compared to our usual Python program. We will next see how to use this module in our
other Python programs.

Remember that the module should be placed either in the same directory as the program
from which we import it, or in one of the directories listed in [Link] .

Another module (save as mymodule_demo.py ):

 import mymodule

mymodule.say_hi()
print('Version', mymodule. version )

Output:

$ python mymodule_demo.py
Hi, this is mymodule speaking.
Version 0.1

How It Works

Notice that we use the sam e dotted notation to access members of the module. Python
makes good reuse of the same notation to give the distinctive 'Pythonic' feel to it so that we
don't have to keep learning new ways to do things.

Here is a version utilising the from..import syntax (save as mymodule_demo2.py ):

from mymodule import say_hi, version

say_hi()
print('Version', version )

The output of mymodule_demo2.py is same as the output of mymodule_demo.py .

Notice that if there was already a version name declared in the m odule that imports
mymodule, there would be a clash. This is also likely because it is common practice for each
module to declare it's version number using this nam e. Hence, it is always recommended to
prefer the import statement even though it might make your program a little longer.

You could also use:

from mymodule import *

This will im port all public names such as say_hi but would not import version

because it starts with double underscores.

WARNING: Remember that you should avoid using import-star, i.e. from mymodule

import * .

Zen of Python

One of Python's guiding principles is that "Explicit is better than Implicit". Run import

this in Python to learn m ore.

The dir function
The built-in dir() function returns the list of names defined by an object. If the object is a
module, this list includes functions, classes and variables, defined inside that m odule.

This function can accept arguments. If the argum ent is the name of a module, the function
returns the list of nam es from that specified module. If there is no argum ent, the function
returns the list of names from the current module.

Exam ple:

$ python
>>> import sys

# get names of attributes in sys module

>>> dir(sys)
[' displayhook ', ' doc ',
'argv', 'builtin_module_names',
'version', 'version_info']
# only few entries shown here

# get names of attributes for current module

>>> dir()
[' builtins ', ' doc ',
' name ', ' package ', 'sys']

# create a new variable 'a'

>>> a = 5

>>> dir()
[' builtins ', ' doc ', ' name ', ' package ', 'sys', 'a']

# delete/remove a name
>>> del a

>>> dir()
[' builtins ', ' doc ', ' name ', ' package ', 'sys']

How It Works

First, we see the usage of dir on the im ported sys module. We can see the huge list of
attributes that it contains.
Next, we use the dir function without passing param eters to it. By default, it returns the list
of attributes for the current module. Notice that the list of im ported modu les is also part of
this list.

In order to observe dir in action, we define a new variable a and assign it a value and
then check dir and we observe that there is an additional value in the list of the same
name. We remove the variable/attribute of the current module using the del statement and
the change is reflected again in the output of the dir function.

A note on del : This statem ent is used to delete a variable/name and after the statement
has run, in this case del a , you can no longer access the variable a - it is as if it never
existed before at all.

Note that the dir() function works on any object. For exam ple, run dir(str) for the
attributes of the str (string) class.

There is also a vars() function which can potentially give you the attributes and their
values, but it will not work for all cases.

Packages
By now, you m ust have started observing the hierarchy of organizing your programs.
Variables usually go inside functions. Functions and global variables usually go inside
modules. What if you wanted to organize modules? That's where packages come into the
picture.

Packages are just folders of modules with a special init .py file that indicates to
Python that this folder is special because it contains Python m odules.

Let's say you want to create a package called 'world' with subpackages 'asia', 'africa', etc.
and these subpackages in turn contain modules like 'india', 'm adagascar', etc.

This is how you would structure the folders:

- <some folder present in the [Link]>/

- world/
- init .py
- asia/
- init .py
- india/
- init .py
- [Link]
- africa/
- init .py
- madagascar/
- init .py
- [Link]
Packages are just a convenience to organize modules hierarchically. You will see many
instances of this in the standard library.

Summary
Just like functions are reusable parts of programs, modules are reusable programs.
Packages are another hierarchy to organize modules. The standard library that com es with
Python is an exam ple of such a set of packages and modules.

We have seen how to use these m odules and create our own m odules.

Next, we will learn about some interesting concepts called data structures.

Data Structures
Data structures are basically just that - they are structures which can hold som e data
together. In other words, they are used to store a collection of related data.

There are four built-in data structures in Python - list, tuple, dictionary and set. We will see
how to use each of them and how they make life easier for us.

List
A list is a data structure that holds an ordered collection of items i.e. you can store a
sequence of items in a list. This is easy to im agine if you can think of a shopping list where
you have a list of items to buy, except that you probably have each item on a separate line in
your shopping list whereas in Python you put commas in between them.

The list of items should be enclosed in square brackets so that Python understands that you
are specifying a list. Once you have created a list, you can add, remove or search for items
in the list. Since we can add and remove items, we say that a list is a mutable data type i.e.
this type can be altered.

Quick Introduction To Objects And Classes

Although I've been generally delaying the discussion of objects and classes till now, a little
explanation is needed right now so that you can understand lists better. We will explore this
topic in detail in a later chapter.

A list is an example of usage of objects and classes. When we use a variable i and assign
a value to it, say integer 5 to it, you can think of it as creating an object (i.e. instance) i of
class (i.e. type) int . In fact, you can read help(int) to understand this better.

A class can also have methods i.e. functions defined for use with respect to that class only.
You can use these pieces of functionality only when you have an object of that class. For
example, Python provides an append method for the list class which allows you to add
an item to the end of the list. For example, [Link]('an item') will add that string to
the list mylist . Note the use of dotted notation for accessing m ethods of the objects.

A class can also have fields which are nothing but variables defined for use with respec t to
that class only. You can use these variables/names only when you have an object of that
class. Fields are also accessed by the dotted notation, for example, [Link] .

Exam ple (save as ds_using_list.py ):

# This is my shopping list

shoplist = ['apple', 'mango', 'carrot', 'banana']

print('I have', len(shoplist), 'items to purchase.')

print('These items are:', end=' ')

for item in shoplist:
print(item, end=' ')

print('\nI also have to buy rice.')

[Link]('rice')
print('My shopping list is now', shoplist)

print('I will sort my list now')

[Link]()
print('Sorted shopping list is', shoplist)

print('The first item I will buy is', shoplist[0])

olditem = shoplist[0]
del shoplist[0]
print('I bought the', olditem)
print('My shopping list is now', shoplist)

Output:

$ python ds_using_list.py
I have 4 items to purchase.
These items are: apple mango carrot banana
I also have to buy rice.
My shopping list is now ['apple', 'mango', 'carrot', 'banana', 'rice']
I will sort my list now
Sorted shopping list is ['apple', 'banana', 'carrot', 'mango', 'rice']
The first item I will buy is apple
I bought the apple
My shopping list is now ['banana', 'carrot', 'mango', 'rice']
How It Works

The variable shoplist is a shopping list for someone who is going to the m arket. In
shoplist , we only store strings of the names of the items to buy but you can add any kind
of object to a list including numbers and even other lists.

We have also used the for..in loop to iterate through the items of the list. By now, you
must have realised that a list is also a sequence. The speciality of sequences will be
discussed in a later section.

Notice the use of the end parameter in the call to print function to indicate that we want
to end the output with a space instead of the usual line break.

Next, we add an item to the list using the append method of the list object, as already
discussed before. Then, we check that the item has been indeed added to the list by printing
the contents of the list by simply passing the list to the print function which prints it neatly.

Then, we sort the list by using the sort method of the list. It is important to understand that
this m ethod affects the list itself and does not return a modified list - this is different from the
way strings work. This is what we mean by saying that lists are m utable and that strings are
immutable.

Next, when we finish buying an item in the market, we want to remove it from the list. We
achieve this by using the del statem ent. Here, we mention which item of the list we want to
remove and the del statem ent removes it from the list for us. We specify that we want to
remove the first item from the list and hence we use del shoplist[0] (remember that
Python starts counting from 0).

If you want to know all the methods defined by the list object, see help(list) for details.

Tuple
Tuples are used to hold together multiple objects. Think of them as similar to lists, but
without the extensive functionality that the list class gives you. One major feature of tuples is
that they are immutable like strings i.e. you cannot m odify tuples.

Tuples are defined by specifying items separated by commas within an optional pair of
parentheses.

Tuples are usually used in cases where a statement or a user-defined function can safely
assume that the collection of values (i.e. the tuple of values used) will not change.

Exam ple (save as ds_using_tuple.py ):

 # I would recommend always using parentheses
# to indicate start and end of tuple
# even though parentheses are optional.
# Explicit is better than implicit.
zoo = ('python', 'elephant', 'penguin')
print('Number of animals in the zoo is', len(zoo))

new_zoo = 'monkey', 'camel', zoo # parentheses not required but are a good idea
print('Number of cages in the new zoo is' , len(new_zoo))
print('All animals in new zoo are', new_zoo)
print('Animals brought from old zoo are' , new_zoo[2])
print('Last animal brought from old zoo is', new_zoo[2][2])
print('Number of animals in the new zoo is',
len(new_zoo)-1+len(new_zoo[2]))

Output:

$ python ds_using_tuple.py
Number of animals in the zoo is 3
Number of cages in the new zoo is 3
All animals in new zoo are ('monkey', 'camel', ('python', 'elephant', 'penguin'))
Animals brought from old zoo are (' python', 'elephant', 'penguin')
Last animal brought from old zoo is penguin
Number of animals in the new zoo is 5

How It Works

The variable zoo refers to a tuple of items. We see that the len function can be used to
get the length of the tuple. This also indicates that a tuple is a sequence as well.

We are now shifting these anim als to a new zoo since the old zoo is being closed.
Therefore, the new_zoo tuple contains some anim als which are already there along with the
anim als brought over from the old zoo. Back to reality, note that a tuple within a tuple does
not lose its identity.

We can access the items in the tuple by specifying the item's position within a pair of square
brackets just like we did for lists. This is called the indexing operator. We access the third
item in new_zoo by specifying new_zoo[2] and we access the third item within the third item
in the new_zoo tuple by specifying new_zoo[2][2] . This is pretty sim ple once you've
understood the idiom.

Tuple with 0 or 1 ite ms

An em pty tuple is constructed by an empty pair of parentheses such as myempty = () .

However, a tuple with a single item is not so simple. You have to specify it usi ng a
comma following the first (and only) item so that Python can differentiate between a
tuple and a pair of parentheses surrounding the object in an expression i.e. you have to
 specify singleton = (2 , ) if you m ean you want a tuple containing the item 2 .

Note for Perl programmers

A list within a list does not lose its identity i.e. lists are not flattened as in Perl. The sam e
applies to a tuple within a tuple, or a tuple within a list, or a list within a tuple, etc. As far
as Python is concerned, they are just objects stored using another object, that's all.

Dictionary
A dictionary is like an address-book where you can find the address or contact details of a
person by knowing only his/her name i.e. we associate keys (nam e) with values (details).
Note that the key must be unique just like you cannot find out the correct inform ation if you
have two persons with the exact same nam e.

Note that you can use only immutable objects (like strings) for the keys of a dictionary but
you can use either immutable or mutable objects for the values of the dictionary. This
basically translates to say that you should use only simple objects for keys.

Pairs of keys and values are specified in a dictionary by using the notation d = {key1 :

value1, key2 : value2 } . Notice that the key-value pairs are separated by a colon and the
pairs are separated themselves by commas and all this is enclosed in a pair of curly braces.

Remember that key-value pairs in a dictionary are not ordered in any manner. If you want a
particular order, then you will have to sort them yourself before using it. The dictionaries that
you will be using are instances/objects of the dict class. Example (save as ds_using_dict.py ):

# 'ab' is short for 'a'ddress'b'ook

ab = {
'Swaroop': 'swaroop@[Link]',
'Larry': 'larry@[Link]',
'Matsumoto': 'matz@[Link]',
'Spammer': 'spammer@[Link]'
}

print("Swaroop's address is", ab['Swaroop'])

# Deleting a key-value pair

del ab['Spammer']

print('\nThere are {} contacts in the address -book\n'.format(len(ab)))

for name, address in [Link]():

print('Contact {} at {}'.format(name, address))

# Adding a key-value pair

ab['Guido'] = 'guido@[Link]'

if 'Guido' in ab:
print("\nGuido's address is", ab['Guido'])
Output:

$ python ds_using_dict.py
Swaroop's address is swaroop@[Link]

There are 3 contacts in the address -book

Contact Swaroop at swaroop@[Link]

Contact Matsumoto at matz@[Link]
Contact Larry at larry@[Link]

Guido's address is guido@[Link]

How It Works

We create the dictionary ab using the notation already discussed. We then access key-
value pairs by specifying the key using the indexing operator as discussed in the context of
lists and tuples. Observe the simple syntax.

We can delete key-value pairs using our old friend - the del statement. We simply specify
the dictionary and the indexing operator for the key to be removed and pass it to the del

statem ent. There is no need to know the value corresponding to the key for this operation.

Next, we access each key-value pair of the dictionary using the items method of the
dictionary which returns a list of tuples where each tuple contains a pair of items - the key
followed by the value. We retrieve this pair and assign it to the variables name and address

correspondingly for each pair using the for..in loop and then print these values in the for-
block.

We can add new key-value pairs by simply using the indexing operator to access a key and
assign that value, as we have done for Guido in the above case.

We can check if a key-value pair exists using the in operator.

For the list of methods of the dict class, see help(dict) .

Keyword Arguments and Dictionaries

If you have used keyword arguments in your functions, you have already used
dictionaries! Just think about it - the key-value pair is specified by you in the parameter
list of the function definition and when you access variables within your function, it is
just a key access of a dictionary (which is called the symbol table in compiler design
terminology).

Sequence
Lists, tuples and strings are exam ples of sequences, but what are sequences and what is so
special about them?

The major features are m embership tests, (i.e. the in and not in expressions) and
indexing operations, which allow us to fetch a particular item in the sequence directly. The
three types of sequences mentioned above - lists, tuples and strings, also have a slicing
operation which allows us to retrieve a slice of the sequence i.e. a part of the sequence.

Exam ple (save as ds_seq.py ):

shoplist = ['apple', 'mango', 'carrot', 'banana']

name = 'swaroop'

# Indexing or 'Subscription' operation #

print('Item 0 is', shoplist[0])
print('Item 1 is', shoplist[1])
print('Item 2 is', shoplist[2])
print('Item 3 is', shoplist[3])
print('Item -1 is', shoplist[-1])
print('Item -2 is', shoplist[-2])
print('Character 0 is', name[0])

# Slicing on a list #
print('Item 1 to 3 is', shoplist[1:3])
print('Item 2 to end is', shoplist[2:])
print('Item 1 to -1 is', shoplist[1:-1])
print('Item start to end is', shoplist[:])

# Slicing on a string #
print('characters 1 to 3 is', name[1:3])
print('characters 2 to end is', name[2:])
print('characters 1 to -1 is', name[1:-1])
print('characters start to end is', name[:])

Output:

$ python ds_seq.py
Item 0 is apple
Item 1 is mango
Item 2 is carrot
Item 3 is banana
Item -1 is banana
Item -2 is carrot
Character 0 is s
Item 1 to 3 is ['mango', 'carrot']
Item 2 to end is ['carrot', 'banana']
Item 1 to -1 is ['mango', 'carrot']
Item start to end is ['apple', 'mango', 'carrot', 'banana']
characters 1 to 3 is wa
characters 2 to end is aroop
characters 1 to -1 is waroo
characters start to end is swaroop
How It Works

First, we see how to use indexes to get individual items of a sequence. This is also referred
to as the subscription operation. Whenever you specify a number to a sequence within
square brackets as shown above, Python will fetch you the item corresponding to that

position in the sequence. Remember that Python starts counting numbers from 0. Hence,
shoplist[0] fetches the first item and shoplist[3] fetches the fourth item in the shoplist
sequence.

The index can also be a negative number, in which case, the position is calculated from the
end of the sequence. Therefore, shoplist[-1] refers to the last item in the sequence and
shoplist[-2] fetches the second last item in the sequence.

The slicing operation is used by specifying the nam e of the sequence followed by an
optional pair of num bers separated by a colon within square brackets. Note that this is very
similar to the indexing operation you have been using till now. Remem ber the numbers are
optional but the colon isn't.

The first number (before the colon) in the slicing operation refers to the position from where
the slice starts and the second number (after the colon) indicates where the slice will stop at.
If the first number is not specified, Python will start at the beginning of the sequence. If the
second num ber is left out, Python will stop at the end of the sequence. Note that the slice
returned starts at the start position and will end just before the end position i.e. the start
position is included but the end position is excluded from the sequence slice.

Thus, shoplist[1:3] returns a slice of the sequence starting at position 1, includes position
2 but stops at position 3 and therefore a slice of two items is returned. Similarly,
shoplist[:] returns a copy of the whole sequence.

You can also do slicing with negative positions. Negative numbers are used for positions
from the end of the sequence. For example, shoplist[:-1] will return a slice of the
sequence which excludes the last item of the sequence but cont ains everything else.

You can also provide a third argument for the slice, which is the step for the slicing (by
default, the step size is 1):

>>> shoplist = ['apple', 'mango', 'carrot', 'banana']

>>> shoplist[::1]
['apple', 'mango', 'carrot', 'banana']
>>> shoplist[::2]
['apple', 'carrot']
>>> shoplist[::3]
['apple', 'banana']
>>> shoplist[::-1]
['banana', 'carrot', 'mango', 'apple']

Notice that when the step is 2, we get the items with position 0, 2,... When the step size is 3,
we get the items with position 0, 3, etc.
Try various combinations of such slice specifications using the Python interpreter
interactively i.e. the prom pt so that you can see the results immediately. The great thing
about sequences is that you can access tuples, lists and strings all in the sam e way!

Set
Sets are unordered collections of simple objects. These are used when the existence of an
object in a collection is more im portant than the order or how m any times it occurs.

Using sets, you can test for membership, whether it is a subset of another set, find the
intersection between two sets, and so on.

>>> bri = set(['brazil', 'russia', 'india'])

>>> 'india' in bri
True
>>> 'usa' in bri
False
>>> bric = [Link]()
>>> [Link]('china')
>>> [Link](bri)
True
>>> [Link]('russia')
>>> bri & bric # OR [Link](bric)
{'brazil', 'india'}

How It Works

If you remem ber basic set theory m athematics from school, then this example is fairly self-
explanatory. But if not, you can google "set theory" and "Venn diagram" to better understand
our use of sets in Python.

References
When you create an object and assign it to a variable, the variable only refers to the object
and does not represent the object itself! That is, the variable name points to that part of your
computer's memory where the object is stored. This is called binding the name to the object.

Generally, you don't need to be worried about this, but there is a subtle effect due to
references which you need to be aware of:

Exam ple (save as ds_reference.py ):

 print('Simple Assignment')
shoplist = ['apple', 'mango', 'carrot', 'banana']
# mylist is just another name pointing to the same object!
mylist = shoplist

# I purchased the first item, so I remove it from the list

del shoplist[0]

print('shoplist is', shoplist)

print('mylist is', mylist)
# Notice that both shoplist and mylist both print
# the same list without the 'apple' confirming that
# they point to the same object

print('Copy by making a full slice')

# Make a copy by doing a full slice
mylist = shoplist[:]
# Remove first item
del mylist[0]

print('shoplist is', shoplist)

print('mylist is', mylist)
# Notice that now the two lists are different

Output:

$ python ds_reference.py
Simple Assignment
shoplist is ['mango', 'carrot', 'banana']
mylist is ['mango', 'carrot', 'banana']
Copy by making a full slice
shoplist is ['mango', 'carrot', 'banana']
mylist is ['carrot', 'banana']

How It Works

Most of the explanation is available in the comments.

Remember that if you want to make a copy of a list or such kinds of sequences or complex
objects (not simple objects such as integers), then you have to use the slicing operation to
make a copy. If you just assign the variable name to another name, both of them will ''refer''
to the same object and this could be trouble if you are not careful.

Note for Perl programmers

Remember that an assignment statement for lists does not create a copy. You have to
use slicing operation to make a copy of the sequence.
More About Strings
We have already discussed strings in detail earlier. What more can there be to know? Well,
did you know that strings are also objects and have methods which do everything from
checking part of a string to stripping spaces? In fact, you've already been using a string
method... the format method!

The strings that you use in programs are all objects of the class str . Some useful methods
of this class are demonstrated in the next example. For a complete list of such methods, see
help(str) .

Exam ple (save as ds_str_methods.py ):

# This is a string object

name = 'Swaroop'

if [Link]('Swa'):
print('Yes, the string starts with "Swa"' )

if 'a' in name:
print('Yes, it contains the string "a"')

if [Link]('war') != -1:
print('Yes, it contains the string "war"' )

delimiter = '_*_'
mylist = ['Brazil', 'Russia', 'India', 'China']
print([Link](mylist))

Output:

$ python ds_str_methods.py
Yes, the string starts with "Swa"
Yes, it contains the string "a"
Yes, it contains the string "war"
Brazil_*_Russia_*_India_*_China

How It Works

Here, we see a lot of the string methods in action. The startswith method is used to find
out whether the string starts with the given string. The in operator is used to check if a
given string is a part of the string.

The find method is used to locate the position of the given substring within the string;
find returns -1 if it is unsuccessful in finding the substring. The str class also has a neat
method to join the items of a sequence with the string acting as a delimiter between each
item of the sequence and returns a bigger string generated from this.

Summary
We have explored the various built-in data structures of Python in detail. These data
structures will be essential for writing programs of reasonable size.

Now that we have a lot of the basics of Python in place, we will next see how to design and
write a real-world Python program.
# Problem Solving

We have explored various parts of the Python language and now we will take a look at how
all these parts fit together, by designing and writing a program which does something useful.
The idea is to learn how to write a Python script on your own.

The Problem
The problem we want to solve is:

I want a program which creates a backup of all my important files.

Although, this is a simple problem, there is not enough inform ation for us to get started with
the solution. A little m ore analysis is required. For example, how do we specify which files
are to be backed up? How are they stored? Where are they stored? After analyzing the
problem properly, we design our program. We make a list of things about how our pr ogram
should work. In this case, I have created the following list on how I want it to work. If you do
the design, you may not come up with the sam e kind of analysis since every person has
their own way of doing things, so that is perfectly okay.

The files and directories to be backed up are specified in a list.

The backup m ust be stored in a main backup directory.
The files are backed up into a zip file.
The name of the zip archive is the current date and time.
We use the standard zip command available by default in any standard GNU/Linux or
Unix distribution. Note that you can use any archiving command you want as long as it
has a command line interface.

The Solution
As the design of our program is now reasonably stable, we can write the code which is an
implementation of our solution.

Save as backup_ver1.py :
 import os
import time

# 1. The files and directories to be backed up are

# specified in a list.
# Example on Windows:
# source = ['"C:\\My Documents"']
# Example on Mac OS X and Linux:
source = ['/Users/swa/notes']
# Notice we have to use double quotes inside a string
# for names with spaces in it. We could have also used
# a raw string by writing [r'C:\My Documents'].

# 2. The backup must be stored in a

# main backup directory
# Example on Windows:
# target_dir = 'E:\\Backup'
# Example on Mac OS X and Linux:
target_dir = '/Users/swa/backup'
# Remember to change this to which folder you will be using

# 3. The files are backed up into a zip file.

# 4. The name of the zip archive is the current date and time
target = target_dir + [Link] + \
[Link]('%Y%m%d%H%M%S') + '.zip'

# Create target directory if it is not present

if not [Link](target_dir):
[Link](target_dir) # make directory

# 5. We use the zip command to put the files in a zip archive

zip_command = 'zip -r {0} {1}'.format(target,
' '.join(source))

# Run the backup

print('Zip command is:')
print(zip_command)
print('Running:')
if [Link](zip_command) == 0:
print('Successful backup to', target)
else:
print('Backup FAILED')

Output:
$ python backup_ver1.py
Zip command is:
zip -r /Users/swa/backup/[Link] /Users/swa/notes
Running:
adding: Users/swa/notes/ (stored 0%)
adding: Users/swa/notes/[Link] (stored 0%)
adding: Users/swa/notes/[Link] (stored 0%)
adding: Users/swa/notes/[Link] (stored 0%)
Successful backup to /Users/swa/backup/[Link]
Now, we are in the testing phase where we test that our program works properly. If it doesn't
behave as expected, then we have to debug our program i.e. rem ove the bugs (errors) from
the program.

If the above program does not work for you, copy the line printed after the Zip command is

line in the output, paste it in the shell (on GNU/Linux and Mac OS X) / cmd (on Windows),
see what the error is and try to fix it. Also check the zip command manual on what could be
wrong. If this command succeeds, then the problem might be in the Python program itself,
so check if it exactly matches the program written above.

How It Works

You will notice how we have converted our design into code in a step-by-step manner.

We make us e of the os and time modules by first importing them. Then, we specify the
files and directories to be backed up in the source list. The target directory is where we
store all the backup files and this is specified in the target_dir variable. The name of the
zip archive that we are going to create is the current date and tim e which we generate using
the [Link]() function. It will also have the .zip extension and will be stored in the
target_dir directory.

Notice the use of the [Link] variable - this gives the directory separator according to your
operating system, i.e. it will be '/' in GNU/Linux, Unix, m acOS, and will be '\\' in
Windows. Using [Link] instead of these characters directly will make our program portable
and work across all of these systems.

The [Link]() function takes a specification such as the one we have used in the
above program. The %Y specification will be replaced by the year with the century. The %m

specification will be replaced by the month as a decim al number betwe en 01 and 12 and
so on. The complete list of such specifications can be found in the Python Reference
Manual.

We create the name of the target zip file using the addition operator which concatenates the
strings i.e. it joins the two strings together and returns a new one. Then, we create a string
zip_command which contains the command that we are going to execute. You can check if this
command works by running it in the shell (GNU/Linux terminal or DOS prompt).

The zip command that we are using has some options available, and one of these options
is -r . The -r option specifies that the zip command should work recursively for
directories, i.e. it should include all the subdirectories and files. Options are followed by the
name of the zip archive to create, followed by the list of files and directories to backup. We
convert the source list into a string using the join method of strings which we have
already seen how to use.

Then, we finally run the command using the [Link] function which runs the command
as if it was run from the system i.e. in the shell - it returns 0 if the command was
successfully, else it returns an error number.

Depending on the outcom e of the command, we print the appropriate message that the
backup has failed or succeeded.

That's it, we have created a script to take a backup of our important files!

Note to Windows Users

Instead of double backslash escape sequences, you can also use raw strings. For
example, use 'C:\\Documents' or r'C:\Documents' . However, do not use
'C:\Documents' since you end up using an unknown escape sequence \D .

Now that we have a working backup script, we can use it whenever we want to take a
backup of the files. This is called the operation phase or the deployment phase of the
software.

The above program works properly, but (usually) first programs do not work exactly as you
expect. For example, there might be problems if you have not designed the program
properly or if you have m ade a mistake when typing the code, etc. Appropriately, you will
have to go back to the design phase or you will have to debug your program.

Second Version
The first version of our script works. However, we can m ake some refinements to it so that it
can work better on a daily basis. This is called the maintenance phase of the software.

One of the refinements I felt was useful is a better file-naming mechanism - using the time
as the nam e of the file within a directory with the current date as a directory within the main
backup directory. The first advantage is that your bac kups are stored in a hierarchical
manner and therefore it is m uch easier to manage. The second advantage is that the
filenames are much shorter. The third advantage is that separate directories will help you
check if you have made a backup for each day since the directory would be created only if
you have made a backup for that day.

Save as backup_ver2.py :
import os
import time

# 1. The files and directories to be backed up are

# specified in a list.
# Example on Windows:
# source = ['"C:\\My Documents"', 'C:\\Code']
# Example on Mac OS X and Linux:
source = ['/Users/swa/notes']
# Notice we had to use double quotes inside the string
# for names with spaces in it.

# 2. The backup must be stored in a

# main backup directory
# Example on Windows:
# target_dir = 'E:\\Backup'
# Example on Mac OS X and Linux:
target_dir = '/Users/swa/backup'
# Remember to change this to which folder you will be using

# Create target directory if it is not present

if not [Link](target_dir):
[Link](target_dir) # make directory

# 3. The files are backed up into a zip file.

# 4. The current day is the name of the subdirectory
# in the main directory.
today = target_dir + [Link] + [Link]('%Y%m%d')
# The current time is the name of the zip archive.
now = [Link]('%H%M%S')

# The name of the zip file

target = today + [Link] + now + '.zip'

# Create the subdirectory if it isn't already there

if not [Link](today):
[Link](today)
print('Successfully created directory', today)

# 5. We use the zip command to put the files in a zip archive

zip_command = 'zip -r {0} {1}'.format(target,
' '.join(source))

# Run the backup

print('Zip command is:')
print(zip_command)
print('Running:')
if [Link](zip_command) == 0:
print('Successful backup to', target)
else:
print('Backup FAILED')
Output:

$ python backup_ver2.py
Successfully created directory /Users/swa/backup/20140329
Zip command is:
zip -r /Users/swa/backup/20140329/[Link] /Users/swa/notes
Running:
adding: Users/swa/notes/ (stored 0%)
adding: Users/swa/notes/[Link] (stored 0%)
adding: Users/swa/notes/[Link] (stored 0%)
adding: Users/swa/notes/[Link] (stored 0%)
Successful backup to /Users/swa/backup/20140329/[Link]

How It Works

Most of the program rem ains the same. The changes are that we check if there is a directory
with the current day as its name inside the main backup directory using the [Link]

function. If it doesn't exist, we create it using the [Link] function.

Third Version
The second version works fine when I do many backups, but when there are lots of backups,
I am finding it hard to differentiate what the backups were for! For example, I might have
made some major changes to a program or presentation, then I want to associate what
those changes are with the nam e of the zip archive. This can be easily achieved by
attaching a user-supplied comment to the name of the zip archive.

WARNING: The following program does not work, so do not be alarmed, please follow along
because there's a lesson in here.

Save as backup_ver3.py :

import os
import time

# 1. The files and directories to be backed up are

# specified in a list.
# Example on Windows:
# source = ['"C:\\My Documents"', 'C:\\Code']
# Example on Mac OS X and Linux:
source = ['/Users/swa/notes']
# Notice we had to use double quotes inside the string
# for names with spaces in it.

# 2. The backup must be stored in a

# main backup directory
 # Example on Windows:
# target_dir = 'E:\\Backup'
# Example on Mac OS X and Linux:
target_dir = '/Users/swa/backup'
# Remember to change this to which folder you will be using

# Create target directory if it is not present

if not [Link](target_dir):
[Link](target_dir) # make directory

# 3. The files are backed up into a zip file.

# 4. The current day is the name of the subdirectory
# in the main directory.
today = target_dir + [Link] + [Link]('%Y%m%d')
# The current time is the name of the zip archive.
now = [Link]('%H%M%S')

# Take a comment from the user to

# create the name of the zip file
comment = input('Enter a comment --> ')
# Check if a comment was entered
if len(comment) == 0:
target = today + [Link] + now + '.zip'
else:
target = today + [Link] + now + '_' +
[Link](' ', '_') + '.zip'

# Create the subdirectory if it isn't already there

if not [Link](today):
[Link](today)
print('Successfully created directory', today)

# 5. We use the zip command to put the files in a zip archive

zip_command = "zip -r {0} {1}".format(target,
' '.join(source))

# Run the backup

print('Zip command is:')
print(zip_command)
print('Running:')
if [Link](zip_command) == 0:
print('Successful backup to', target)
else:
print('Backup FAILED')

Output:

$ python backup_ver3.py
File "backup_ver3.py", line 39
target = today + [Link] + now + '_' +
^
SyntaxError: invalid syntax
How This (does not) Work

This program does not work! Python says there is a syntax error which means that the script
does not satisfy the structure that Python expects to see. When we observe the error given
by Python, it also tells us the place where it detected the error as well. So we start
debugging our program from that line.

On careful observation, we see that the single logical line has been split into two physical
lines but we have not specified that these two physical lines belong together. Basically,
Python has found the addition operator ( + ) without any operand in that logical line and
hence it doesn't know how to continue. Rem ember that we can specify that the logical line
continues in the next physical line by the use of a backslash at the end of the physical line.
So, we make this correction to our program. This correction of the program when we find
errors is called bug fixing.

Fourth Version
Save as backup_ver4.py :

import os
import time

# 1. The files and directories to be backed up are

# specified in a list.
# Example on Windows:
# source = ['"C:\\My Documents"', 'C:\\Code']
# Example on Mac OS X and Linux:
source = ['/Users/swa/notes']
# Notice we had to use double quotes inside the string
# for names with spaces in it.

# 2. The backup must be stored in a

# main backup directory
# Example on Windows:
# target_dir = 'E:\\Backup'
# Example on Mac OS X and Linux:
target_dir = '/Users/swa/backup'
# Remember to change this to which folder you will be using

# Create target directory if it is not present

 if not [Link](target_dir):
[Link](target_dir) # make directory

# 3. The files are backed up into a zip file.

# 4. The current day is the name of the subdirectory
# in the main directory.
today = target_dir + [Link] + [Link]( '%Y%m%d')
# The current time is the name of the zip archive.
now = [Link]('%H%M%S')

# Take a comment from the user to

# create the name of the zip file
comment = input('Enter a comment --> ')
# Check if a comment was entered
if len(comment) == 0:
target = today + [Link] + now + '.zip'
else:
target = today + [Link] + now + '_' + \
[Link](' ', '_') + '.zip'

# Create the subdirectory if it isn't already there

if not [Link](today):
[Link](today)
print('Successfully created directory', today)

# 5. We use the zip command to put the files in a zip archive

zip_command = 'zip -r {0} {1}'.format(target,
' '.join(source))

# Run the backup

print('Zip command is:')
print(zip_command)
print('Running:')
if [Link](zip_command) == 0:
print('Successful backup to', target)
else:
print('Backup FAILED')

Output:

$ python backup_ver4.py
Enter a comment --> added new examples
Zip command is:
zip -r /Users/swa/backup/20140329/074122_added_new_examples.zip /Users/swa/notes
Running:
adding: Users/swa/notes/ (stored 0%)
adding: Users/swa/notes/[Link] (stored 0%)
adding: Users/swa/notes/[Link] (stored 0%)
adding: Users/swa/notes/[Link] (stored 0%)
Successful backup to /Users/swa/backup/20140329/074122_added_new_examples.zip
How It Works

This program now works! Let us go through the actual enhancements that we had m ade in
version 3. We take in the user's comments using the input function and then check if the
user actually entered som ething by finding out the length of the input using the len

function. If the user has just pressed enter without entering anything (m aybe it was just a
routine backup or no special changes were made), then we proceed as we have done
before.

However, if a comment was supplied, then this is attached to the name of the zip archive just
before the .zip extension. Notice that we are replacing spaces in the comm ent with
underscores - this is because managing filenames without spaces is m uch easier.

More Refinements
The fourth version is a satisfactorily working script for m ost users, but there is always room
for improvement. For example, you can include a verbosity level for the zip command by
specifying a -v option to m ake your program become m ore talkative or a -q option to
make it quiet.

Another possible enhancement would be to allow extra files and directories to be passed to
the script at the command line. We can get these nam es from the [Link] list and we can
add them to our source list using the extend method provided by the list class.

The most important refinement would be to not use the [Link] way of creating archives
and instead using the zipfile or tarfile built-in m odules to create these archives. They are part
of the standard library and available already for you to use without external dependencies on
the zip program to be available on your computer.

However, I have been using the [Link] way of creating a backup in the above examples
purely for pedagogical purposes, so that the example is sim ple enough to be understood by
everybody but real enough to be useful.

Can you try writing the fifth version that uses the zipfile module instead of the [Link]
call?

The Software Development Process

We have now gone through the various phases in the process of writing a software. These
phases can be summarised as follows:

1. What (Analysis)
 2. How (Design)
3. Do It (Implementation)
4. Test (Testing and Debugging)
5. Use (Operation or Deployment)
6. Maintain (Refinement)

A recommended way of writing programs is the procedure we have followed in creating the
backup script: Do the analysis and design. Start implem enting with a simple version. Test
and debug it. Use it to ensure that it works as expected. Now, add any features that you
want and continue to repeat the Do It-Test-Use cycle as many tim es as required.

Summary
We have seen how to create our own Python programs/scripts and the various stages
involved in writing such programs. You may find it useful to create your own program j ust like
we did in this chapter so that you become comfortable with Python as well as problem -
solving.

Next, we will discuss object-oriented programming.

Object Oriented Programming

In all the programs we wrote till now, we have designed our program around functions i.e.
blocks of statements which m anipulate data. This is called the procedure-oriented way of
programming. There is another way of organizing your program which is to combine data
and functionality and wrap it inside something called an object . This is called the object
oriented programming paradigm. Most of the tim e you can use procedural programming, but
when writing large programs or have a problem that is better suited to this method, you can
use object oriented programming techniques.

Classes and objects are the two main aspects of object oriented programming. A class
creates a new type where objects are instances of the class. An analogy is that you can
have variables of type int which translates to saying that variables that store integers are
variables which are instances (objects) of the int class.

Note for Static Language Programmers

Note that even integers are treated as objects (of the int class). This is unlike C++
and Java (before version 1.5) where integers are primitive native t ypes.

See help(int) for more details on the class.

C# and Java 1.5 programmers will find this similar to the boxing and unboxing concept.
Objects can store data using ordinary variables that belong to the object. Variables that
belong to an object or class are referred to as fields. Objects can also have functionality by
using functions that belong to a class. Such functions are called methods of the class. This
terminology is important because it helps us to differentiate between functions and variables
which are independent and those which belong to a class or object. Collectively, the fields
and methods can be referred to as the attributes of that class.

Fields are of two types - they can belong to each instance/object of the class or they can
belong to the class itself. They are called instance variables and class variables
respectively.

A class is created using the class keyword. The fields and methods of the class are listed
in an indented block.

The self
Class methods have only one specific difference from ordinary functions - they must have an
extra first name that has to be added to the beginning of the param eter list, but you do not
give a value for this parameter when you call the m ethod, Python will provide it. This
particular variable refers to the object itself, and by convention, it is given the name self .

Although, you can give any name for this parameter, it is strongly recommended that you
use the name self - any other name is definitely frowned upon. There are many
advantages to using a standard name - any reader of your program will immediately
recognize it and even specialized IDEs (Integrated Developm ent Environments) can help
you if you use self .

Note for C++/Java/C# Programmers

The self in Python is equivalent to the this pointer in C++ and the this reference
in Java and C#.

You must be wondering how Python gives the value for self and why you don't need to
give a value for it. An example will make this clear. Say you have a class called MyClass

and an instance of this class called myobject . When you call a method of this object as
[Link](arg1, arg2) , this is automatically converted by Python into
[Link](myobject, arg1, arg2) - this is all the special self is about.

This also means that if you have a method which takes no arguments, then you still have to
have one argument - the self .

Classes
The simplest class possible is shown in the following exam ple (save as
oop_simplestclass.py ).

class Person:
pass # An empty block

p = Person()
print(p)

Output:

$ python oop_simplestclass.py
< main .Person instance at 0x10171f518>

How It Works

We create a new class using the class statement and the name of the class. This is
followed by an indented block of statem ents which form the body of the class. In this case,
we have an em pty block which is indicated using the pass statement.

Next, we create an object/instance of this class using the nam e of the class followed by a
pair of parentheses. (We will learn more about instantiation in the next section). For our
verification, we confirm the type of the variable by simply printing it. It tells us that we have
an instance of the Person class in the main module.

Notice that the address of the computer mem ory where your object is stored is also printed.
The address will have a different value on your computer since Python can store the object
wherever it finds space.

Methods
We have already discussed that classes/objects can have methods just like functions except
that we have an extra self variable. We will now see an example (save as
oop_method.py ).

class Person:
def say_hi(self):
print('Hello, how are you?')

p = Person()
p.say_hi()
# The previous 2 lines can also be written as
# Person().say_hi()

Output:

$ python oop_method.py
Hello, how are you?
How It Works

Here we see the self in action. Notice that the say_hi method takes no parameters but
still has the self in the function definition.

Class And Object Variables

We have already discussed the functionality part of classes and objects (i.e. m ethods), now
let us learn about the data part. The data part, i.e. fields, are nothing but ordinary variables
that are bound to the name spaces of the classes and objects. This means that these names
are valid within the context of these classes and objects only. That's why they are called
name spaces.

There are two types of fields - class variables and object variables which are classified
depending on whether the class or the object owns the variables respectively.

Class variables are shared - they can be accessed by all instances of that class. There is
only one copy of the c lass variable and when any one object m akes a change to a class
variable, that change will be seen by all the other instances.

Object variables are owned by each individual object/instance of the class. In this case,
each object has its own copy of the field i.e. they are not shared and are not related in any
way to the field by the sam e name in a different instance. An example will m ake this easy to
understand (save as oop_objvar.py ):
class Robot:
"""Represents a robot, with a name."""

# A class variable, counting the number of robots

population = 0

def init (self, name):

"""Initializes the data."""
[Link] = name
print("(Initializing {})".format([Link]))

# When this person is created, the robot

# adds to the population
[Link] += 1

def die(self):
"""I am dying."""
print("{} is being destroyed!".format([Link]))

[Link] -= 1

if [Link] == 0:
print("{} was the last one.".format([Link]))
else:
print("There are still {:d} robots working." .format(
[Link]))

def say_hi(self):
"""Greeting by the robot.

Yeah, they can do that."""

 print("Greetings, my masters call me {}." .format([Link]))

@classmethod
def how_many(cls):
"""Prints the current population."""
print("We have {:d} robots.".format([Link]))

droid1 = Robot("R2-D2")
droid1.say_hi()
Robot.how_many()

droid2 = Robot("C-3PO")
droid2.say_hi()
Robot.how_many()

print("\nRobots can do some work here.\n")

print("Robots have finished their work. So let's destroy them.")

[Link]()
[Link]()

Robot.how_many()

Output:

$ python oop_objvar.py
(Initializing R2-D2)
Greetings, my masters call me R2-D2.
We have 1 robots.
(Initializing C-3PO)
Greetings, my masters call me C-3PO.
We have 2 robots.

Robots can do some work here.

Robots have finished their work. So let's destroy them.

R2-D2 is being destroyed!
There are still 1 robots working.
C-3PO is being destroyed!
C-3PO was the last one.
We have 0 robots.

How It Works

This is a long exam ple but helps dem onstrate the nature of class and object variables. Here,
population belongs to the Robot class and hence is a class variable. The name variable
belongs to the object (it is assigned using self ) and hence is an object variable.
Thus, we refer to the population class variable as [Link] and not as
[Link] . We refer to the object variable name using [Link] notation in the
methods of that object. Remem ber this simple difference between class and object
variables. Also note that an object variable with the same nam e as a class variable will hide
the class variable!

Instead of [Link] , we could have also used self. class .population because
every object refers to its class via the self. class attribute.

The how_many is actually a method that belongs to the class and not to the object. This
means we can define it as either a classmethod or a staticmethod depending on whether
we need to know which class we are part of. Since we refer to a class variable, let's use
classmethod .

We have marked the how_many method as a class method using a decorator.

Decorators can be im agined to be a shortcut to calling a wrapper function (i.e. a function that
"wraps" around another function so that it can do something before or after the inner
function), so applying the @classmethod decorator is the sam e as calling:

how_many = classmethod(how_many)

Observe that the init method is used to initialize the Robot instance with a name. In
this m ethod, we increase the population count by 1 since we have one more robot being
added. Also observe that the values of [Link] is specific to each object which indicates
the nature of object variables.

Remember, that you m ust refer to the variables and methods of the same object using the
self only. This is called an attribute reference.

In this program, we also see the use of docstrings for classes as well as methods. We can
access the class docstring at runtim e using Robot. doc and the m ethod docstring as
Robot.say_hi. doc

In the die method, we simply decrease the [Link] count by 1.

All class members are public. One exception: If you use data members with nam es using the
double underscore prefix such as privatevar , Python uses name-mangling to effectively
make it a private variable.

Thus, the convention follow ed is that any variable that is to be used only within the class or
object should begin with an underscore and all other nam es are public and can be used by
other classes/objects. Remem ber that this is only a convention and is not enforced by
Python (except for the double underscore prefix).
 Note for C++/Java/C# Programmers

All class members (including the data m embers) are public and all the m ethods are
virtual in Python.

Inheritance
One of the major benefits of object oriented programming is reuse of code and one of the
ways this is achieved is through the inheritance mechanism. Inheritance can be best
imagined as im plementing a type and subtype relationship between classes.

Suppose you want to write a program which has to keep track of the teachers and students
in a college. They have som e common characteristics such as nam e, age and address.
They also have specific characteristics such as salary, courses and leaves for teachers and,
marks and fees for students.

You can create two independent classes for each type and process them but adding a new
common characteristic would mean adding to both of these independent classes. This
quickly becom es unwieldy.

A better way would be to create a common class called SchoolMember and then have the
teacher and student classes inherit from this class, i.e. they will become sub-types of this
type (class) and then we can add specific characteristics to these sub-types.

There are many advantages to this approach. If we add/change any functionality in

SchoolMember , this is automatically reflected in the subtypes as well. For example, you can
add a new ID card field for both teachers and students by simply adding it to the
SchoolMem ber class. However, changes in the subtypes do not affect other subtypes.
Another advantage is that you can refer to a teacher or student object as a SchoolMember

object which could be useful in som e situations such as counting of the number of school
members. This is called polymorphism where a sub-type can be substituted in any situation
where a parent type is expected, i.e. the object can be treated as an instance of the parent
class.

Also observe that we reuse the code of the parent class and we do not need to repeat it in
the different classes as we would have had to in case we had used independent classes.

The SchoolMember class in this situation is known as the base class or the superclass. The
Teacher and Student classes are called the derived classes or subclasses.

We will now see this example as a program (save as oop_subclass.py ):

 class SchoolMember:
'''Represents any school member.'''
def init (self, name, age):
[Link] = name
[Link] = age
print('(Initialized SchoolMember: {})'.format([Link]))

def tell(self):
'''Tell my details.'''
print('Name:"{}" Age:"{}"'.format([Link], [Link]), end=" ")

class Teacher(SchoolMember):
'''Represents a teacher.'''
def init (self, name, age, salary):
SchoolMember. init (self, name, age)
[Link] = salary
print('(Initialized Teacher: {})'.format([Link]))

def tell(self):
[Link](self)
print('Salary: "{:d}"'.format([Link]))

class Student(SchoolMember):
'''Represents a student.'''
def init (self, name, age, marks):
SchoolMember. init (self, name, age)
[Link] = marks
print('(Initialized Student: {})'.format([Link]))

def tell(self):
[Link](self)
print('Marks: "{:d}"'.format([Link]))

t = Teacher('Mrs. Shrividya', 40, 30000)

s = Student('Swaroop', 25, 75)

# prints a blank line

print()

members = [t, s]
for member in members:
# Works for both Teachers and Students
[Link]()

Output:
 $ python oop_subclass.py
(Initialized SchoolMember: Mrs. Shrividya)
(Initialized Teacher: Mrs. Shrividya)
(Initialized SchoolMember: Swaroop)
(Initialized Student: Swaroop)

Name:"Mrs. Shrividya" Age:"40" Salary: "30000"

Name:"Swaroop" Age:"25" Marks: "75"

How It Works

To use inheritance, we specify the base class nam es in a tuple following the class nam e in
the class definition (for exam ple, class Teacher(SchoolMember) ). Next, we observe that the
init method of the base class is explicitly called using the self variable so that we
can initialize the base class part of an instance in the subclass. This is very im portant to
remember- Since we are defining a init method in Teacher and Student subclasses,
Python does not automatically call the constructor of the base class
SchoolMember , you have to explicitly call it yourself.

In contrast, if we have not defined an init method in a subclass, Python will call the
constructor of the base class automatically.

While we could treat instances of Teacher or Student as we would an instance of

SchoolMember and access the tell method of SchoolMember by simply typing
[Link] or [Link] , we instead define another tell method in each subclass
(using the tell method of SchoolMember for part of it) to tailor it for that subclass. Because
we have done this, when we write [Link] Python uses the tell method for that
subclass vs the superclass. However, if we did not have a tell method in the subclass,
Python would use the tell method in the superclass. Python always starts looking for
methods in the actual subclass type first, and if it doesn’t find anything, it starts looking at the
methods in the subclass’s base classes, o ne by one in the order they are specified in the
tuple (here we only have 1 base class, but you can have multiple base classes) in the class
definition.

A note on terminology - if more than one class is listed in the inheritance tuple, then it is
called multiple inheritance.

The end param eter is used in the print function in the superclass's tell() method to
print a line and allow the next print to continue on the same line. This is a trick to m ake
print not print a \n (newline) sym bol at the end of the printing.

Summary
We have now explored the various aspects of classes and objects as well as the various
terminologies associated with it. We have also seen the benefits and pitfalls of object-
oriented programming. Python is highly object-oriented and understanding these concepts
carefully will help you a lot in the long run.

Next, we will learn how to deal with input/output and how to access files in Python.

Input and Output

There will be situations where your program has to interact with the user. For example, you
would want to take input from the user and then print some results back. We can achieve
this using the input() function and print function respectively.

For output, we can also use the various methods of the str (string) class. For example,
you can use the rjust method to get a string which is right justified to a specified width.
See help(str) for more details.

Another common type of input/output is dealing with files. The ability to create, read and
write files is essential to m any programs and we will explore this aspect in this chapter.

Input from user

Save this program as io_input.py :

def reverse(text):
return text[::-1]

def is_palindrome(text):
return text == reverse(text)

something = input("Enter text: ")

if is_palindrome(something):
print("Yes, it is a palindrome")
else:
print("No, it is not a palindrome")

Output:
 $ python3 io_input.py
Enter text: sir
No, it is not a palindrome

$ python3 io_input.py
Enter text: madam
Yes, it is a palindrome

$ python3 io_input.py
Enter text: racecar
Yes, it is a palindrome

How It Works

We use the slicing feature to reverse the text. We've already seen how we can make slices
from sequences using the seq[a:b] code starting from position a to position b . We can
also provide a third argument that determines the step by which the slicing is done. The
default step is 1 because of which it returns a continuous part of the text. Giving a negative
step, i.e., -1 will return the text in reverse.

The input() function takes a string as argument and displays it to the user. Then it waits
for the user to type something and press the return key. Once the user has entered and
pressed the return key, the input() function will then return that text the user has entered.

We take that text and reverse it. If the original text and reversed text are equal, then the text
is a palindrome.

Homework exercise
Checking whether a text is a palindrome should also ignore punctuation, spaces and case.
For example, "Rise to vote, sir." is also a palindrom e but our current program doesn't say it
is. Can you im prove the above program to recognize this palindrom e?
1
If you need a hint, the idea is that...

Files
You can open and use files for reading or writing by creating an object of the file class
and using its read , readline or write methods appropriately to read from or write to the
file. The ability to read or write to the file depends on the mode you have specified for the file
opening. Then finally, when you are finished with the file, you call the close method to tell
Python that we are done using the file.

Exam ple (save as io_using_file.py ):

 poem = '''\
Programming is fun
When the work is done
if you wanna make your work also fun:
use Python!
'''

# Open for 'w'riting

f = open('[Link]', 'w')
# Write text to file
[Link](poem)
# Close the file
[Link]()

# If no mode is specified,
# 'r'ead mode is assumed by default
f = open('[Link]')
while True:
line = [Link]()
# Zero length indicates EOF
if len(line) == 0:
break
# The `line` already has a newline
# at the end of each line
# since it is reading from a file.
print(line, end='')
# close the file
[Link]()

Output:

$ python3 io_using_file.py
Programming is fun
When the work is done
if you wanna make your work also fun:
use Python!

How It Works

Note that we can create a new file object simply by using the open method. We open (or
create it if it doesn't already exist) this file by using the built-in open function and specifying
the name of the file and the m ode in which we want to open the file. The mode can be a
read mode ( 'r' ), write m ode ( 'w' ) or append m ode ( 'a' ). We can also specify whether
we are reading, writing, or appending in text mode ( 't' ) or binary m ode ( 'b' ). There are
actually many more modes available and help(open) will give you more details about them.
By default, open() considers the file to be a 't'ext file and opens it in 'r'ead mode.
In our example, we first open/create the file in write text mode and use the write method of
the file object to write our string variable poem to the file and then we finally close the file.

Next, we open the same file again for reading. We don't need to specify a mode because
'read text file' is the default mode. We read in each line of the file using the readline

method in a loop. This m ethod returns a complete line including the newline character at the
end of the line. When an empty string is returned, it m eans that we have reached the end of
the file and we 'break' out of the loop.

In the end, we finally close the file.

We can see from our readline output that this program has indeed written to and read from
our new [Link] file.

Pickle
Python provides a standard m odule called pickle which you can use to store any plain
Python object in a file and then get it back later. This is called storing the object persistently.

Exam ple (save as io_pickle.py ):

import pickle

# The name of the file where we will store the object

shoplistfile = '[Link]'
# The list of things to buy
shoplist = ['apple', 'mango', 'carrot']

# Write to the file

f = open(shoplistfile, 'wb')
# Dump the object to a file
[Link](shoplist, f)
[Link]()

# Destroy the shoplist variable

del shoplist

# Read back from the storage

f = open(shoplistfile, 'rb')
# Load the object from the file
storedlist = [Link](f)
print(storedlist)
[Link]()

Output:
 $ python io_pickle.py
['apple', 'mango', 'carrot']

How It Works

To store an object in a file, we have to first open the file in write binary mode and then call
the dump function of the pickle module. This process is called pickling.

Next, we retrieve the object using the load function of the pickle module which returns
the object. This process is called unpickling.

Unicode
So far, when we have been writing and using strings, or reading and writing to a file, we
have used simple English characters only. Both English and non-English characters can be
represented in Unicode (please see the articles at the end of this section for more info), and
Python 3 by default stores string variables (think of all that text we wrote using single or
double or triple quotes) in Unicode.

NOTE: If you are using Python 2, and we want to be able to read and write other non-
English languages, we need to use the unicode type, and it all starts with the character
u , e.g. u"hello world"

>>> "hello world"

'hello world'
>>> type("hello world")
<class 'str'>
>>> u"hello world"
'hello world'
>>> type(u"hello world")
<class 'str'>

When data is sent over the Internet, we need to send it in bytes... som ething your computer
easily understands. The rules for translating Unicode (which is what Python uses when it
stores a string) to bytes is called encoding. A popular encoding to use is UTF-8. We can
read and write in UTF-8 by using a simple keyword argum ent in our open function.
 # encoding=utf-8
import io

f = [Link]("[Link]", "wt", encoding="utf-8")

[Link](u"Imagine non-English language here")
[Link]()

text = [Link]("[Link]", encoding="utf-8").read()

print(text)

How It Works

We use [Link] and then use the encoding argument in the first open statem ent to
encode the message, and then again in the second open statement when decoding the
message. Note that we should only use encoding in the open statement when in text m ode.

Whenever we write a program that uses Unicode literals (by putting a u before the string)
like we have used above, we have to make sure that Python itself is told that our program
uses UTF-8, and we have to put # encoding=utf-8 comment at the top of our program.

Summary
We have discussed various types of input/output, about file handling, about the pickle
module and about Unicode.

Next, we will explore the concept of exceptions.

Exceptions
Exceptions occur when exceptional situations occur in your program. For example, what if
you are going to read a file and the file does not exist? Or what if you accidentally deleted it
when the program was running? Such situations are handled using exceptions.

Similarly, what if your program had some invalid statements? This is handled by Python
which raises its hands and tells you there is an error.

Errors
Consider a simple print function call. What if we m isspelt print as Print ? Note the
capitalization. In this case, Python raises a syntax error.
 >>> Print("Hello World")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
NameError: name 'Print' is not defined
>>> print("Hello World")
Hello World

Observe that a NameError is raised and also the location where the error w as detected is
printed. This is what an error handler for this error does.

Exceptions
We will try to read input from the user. Enter the first line below and hit the Enter key.
When your computer prompts you for input, instead press [ctrl-d] on a Mac or [ctrl-z]

with Windows and see what happens. (If you're using Windows and neither option works,
you can try [ctrl-c] in the Command Prompt to generate a KeyboardInterrupt error
instead).

>>> s = input('Enter something --> ')

Enter something --> Traceback (most recent call last):
File "<stdin>", line 1, in <module>
EOFError

Python raises an error called EOFError which basically means it found an end of file symbol
(which is represented by ctrl-d ) when it did not expect to see it.

Handling Exceptions
We can handle exceptions using the try..except statement. We basically put our usual
statem ents within the try-block and put all our error handlers in the except-block.

Exam ple (save as exceptions_handle.py ):

try:
text = input('Enter something --> ')
except EOFError:
print('Why did you do an EOF on me?')
except KeyboardInterrupt:
print('You cancelled the operation.')
else:
print('You entered {}'.format(text))

Output:
 # Press ctrl + d
$ python exceptions_handle.py
Enter something --> Why did you do an EOF on me?

# Press ctrl + c
$ python exceptions_handle.py
Enter something --> ^CYou cancelled the operation.

$ python exceptions_handle.py
Enter something --> No exceptions
You entered No exceptions

How It Works

We put all the statements that might raise exceptions/errors inside the try block and then
put handlers for the appropriate errors/exceptions in the except clause/block. The except

clause can handle a single specified error or exception, or a parenthesized list of

errors/exceptions. If no names of errors or exceptions are supplied, it will handle all errors
and exceptions.

Note that there has to be at least one except clause associated with every try clause.
Otherwise, what's the point of having a try block?

If any error or exception is not handled, then the default Python handler is called which just
stops the execution of the program and prints an error message. We have already seen this
in action above.

You can also have an else clause associated with a try..except block. The else clause
is executed if no exception occurs.

In the next example, we will also see how to get the exception object so that we can retrieve
additional information.

Raising Exceptions
You can raise exceptions using the raise statement by providing the nam e of the
error/exception and the exception object that is to be thrown.

The error or exception that you can raise should be a class which directly or indirectly must
be a derived class of the Exception class.

Exam ple (save as exceptions_raise.py ):

 class ShortInputException(Exception):
'''A user-defined exception class.'''
def init (self, length, atleast):
Exception. init (self)
[Link] = length
[Link] = atleast

try:
text = input('Enter something --> ')
if len(text) < 3:
raise ShortInputException(len(text), 3)
# Other work can continue as usual here
except EOFError:
print('Why did you do an EOF on me?')
except ShortInputException as ex:
print(('ShortInputException: The input was ' +
'{0} long, expected at least {1}')
.format([Link], [Link]))
else:
print('No exception was raised.')

Output:

$ python exceptions_raise.py
Enter something --> a
ShortInputException: The input was 1 long, expected at least 3

$ python exceptions_raise.py
Enter something --> abc
No exception was raised.

How It Works

Here, we are creating our own exception type. This new exception type is called
ShortInputException . It has two fields - length which is the length of the given input, and
atleast which is the minimum length that the program was expecting.

In the except clause, we mention the class of error which will be stored as the variable
name to hold the corresponding error/exception object. This is analogous to parameters and
arguments in a function call. Within this particular except clause, we use the length and
atleast fields of the exception object to print an appropriate m essage to the user.

Try ... Finally

Suppose you are reading a file in your program. How do you ensure that the file object is
closed properly whether or not an exception was raised? This can be done using the
finally block.
Save this program as exceptions_finally.py :

import sys
import time

f = None
try:
f = open("[Link]")
# Our usual file-reading idiom
while True:
line = [Link]()
if len(line) == 0:
break
print(line, end='')
[Link]()
print("Press ctrl+c now")
# To make sure it runs for a while
[Link](2)
except IOError:
print("Could not find file [Link]")
except KeyboardInterrupt:
print("!! You cancelled the reading from the file.")
finally:
if f:
[Link]()
print("(Cleaning up: Closed the file)")

Output:

$ python exceptions_finally.py
Programming is fun
Press ctrl+c now
^C!! You cancelled the reading from the file.
(Cleaning up: Closed the file)

How It Works

We do the usual file-reading stuff, but we have arbitrarily introduced sleeping for 2 seconds
after printing each line using the [Link] function so that the program runs slowly
(Python is very fast by nature). When the program is still running, press ctrl + c to
interrupt/cancel the program.

Observe that the KeyboardInterrupt exception is thrown and the program quits. However,
before the program exits, the finally clause is executed and the file object is always closed.

Notice that a variable assigned a value of 0 or None or a variable which is an em pty

sequence or collection is considered False by Python. This is why we can use if f: in
the code above.

Also note that we use [Link]() after print so that it prints to the screen
immediately.

The with statement

Acquiring a resource in the try block and subsequently releasing the resource in the
finally block is a common pattern. Hence, there is also a with statem ent that enables
this to be done in a clean manner:

Save as exceptions_using_with.py :

with open("[Link]") as f:
for line in f:
print(line, end='')

How It Works

The output should be sam e as the previous example. The difference here is that we are
using the open function with the with statement - we leave the closing of the file to be
done autom atically by with open .

What happens behind the scenes is that there is a protocol used by the with statement. It
fetches the object returned by the open statem ent, let's call it "thefile" in this case.

It always calls the thefile. enter function before starting the block of code under it and
always calls thefile. exit after finishing the block of code.

So the code that we would have written in a finally block should be taken care of
automatically by the exit method. This is what helps us to avoid having to use explicit
try..finally statements repeatedly.

Summary
We have discussed the usage of the try..except and try..finally statements. We have
seen how to create our own exception types and how to raise exceptions as well.

Next, we will explore the Python Standard Library.

Standard Library
The Python Standard Library contains a huge number of useful m odules and is part of every
standard Python installation. It is important to become familiar with the Python Standard
Library since many problems can be solved quickly if you are fam iliar with the range of
things that these libraries can do.
We will explore some of the commonly used m odules in this library. You can find complete
details for all of the modules in the Python Standard Library in the 'Library Reference'
section of the documentation that com es with your Python installation.

Let us explore a few useful modules.

CAUTION: If you find the topics in this chapter too advanced, you may skip this chapter.
However, I highly recommend coming back to this chapter when you are more
comfortable with programming using Python.

sys module
The sys module contains system-specific functionality. We have already seen that the
[Link] list contains the command-line arguments.

Suppose we want to check the version of the Pytho n software being used, the sys module
gives us that inform ation.

>>> import sys

>>> sys.version_info
sys.version_info(major=3, minor=6, micro=0, releaselevel='final', serial=0)
>>> sys.version_info.major == 3
True

How It Works

The sys module has a version_info tuple that gives us the version information. The first
entry is the m ajor version. We can pull out this information to use it.

logging module
What if you wanted to have some debugging messages or important messages to be stored
somewhere so that you can check whether your program has been running as you would
expect it? How do you "store som ewhere" these messages? This can be achieved using the
logging module.

Save as stdlib_logging.py :
 import os
import platform
import logging

if [Link]().startswith('Windows'):
logging_file = [Link]([Link]('HOMEDRIVE'),
[Link]('HOMEPATH'),
'[Link]')
else:
logging_file = [Link]([Link]('HOME'),
'[Link]')

print("Logging to", logging_file)

[Link](
level=[Link],
format='%(asctime)s : %(levelname)s : %(message)s' ,
filename=logging_file,
filemode='w',
)

[Link]("Start of the program")

[Link]("Doing something")
[Link]("Dying now")

Output:

$ python stdlib_logging.py
Logging to /Users/swa/[Link]

$ cat /Users/swa/[Link]
2014-03-29 09:27:36,660 : DEBUG : Start of the program
2014-03-29 09:27:36,660 : INFO : Doing something
2014-03-29 09:27:36,660 : WARNING : Dying now

The cat command is used in the command line to read the '[Link]' file. If the cat

command is not available, you can open the [Link] file in a text editor instead.

How It Works

We use three modules from the standard library - the os module for interacting with the
operating system, the platform module for information about the platform i.e. the operating
system and the logging module to log information.

First, we check which operating system we are using by checking the string returned by
[Link]() (for more inform ation, see import platform; help(platform) ). If it is
Windows, we figure out the home drive, the hom e folder and the filename where we want to
store the information. Putting these three parts together, we get the full location of the file.
For other platforms, we need to know just the home folder of the user and we get the full
location of the file.

We use the [Link]() function to put these three parts of the location together. The
reason to use a special function rather than just adding the strings together is because this
function will ensure the full location matches the format expected by the operating system.
Note: the join()' method we use here that's part of the os module is different from the

string method join()` that we've used elsewhere in this book.

We configure the logging module to write all the messages in a particular format to the file
we have specified.

Finally, we can put messages that are either meant for debugging, i nformation, warning or
even critical m essages. Once the program has run, we can check this file and we will know
what happened in the program, even though no inform ation was displayed to the user
running the program.

Module of the Week Series

There is much more to be explored in the standard library such as debugging, handling
command line options, regular expressions and so on.

The best way to further explore the standard library is to read Doug Hellm ann's excellent
Python Module of the Week series (also available as a book) and reading the Python
docum entation.

Summary
We have explored som e of the functionality of many m odules in the Python Standard
Library. It is highly recommended to browse through the Python Standard Library
docum entation to get an idea of all the m odules that are available.

Next, we will cover various aspects of Python that will make our tour of Python more
complete.

More
So far we have covered a m ajority of the various aspects of Python that you will use. In this
chapter, we will cover some more aspects that will make our knowledge of Python more
well-rounded.

Passing tuples around

Ever wished you could return two different values from a function? You can. All you have to
do is use a tuple.

>>> def get_error_details():

... return (2, 'details')
...
>>> errnum, errstr = get_error_details()
>>> errnum
2
>>> errstr
'details'

Notice that the usage of a, b = <some expression> interprets the result of the expression as
a tuple with two values.

This also means the fastest way to swap two variables in Python is:

>>> a = 5; b = 8
>>> a, b
(5, 8)
>>> a, b = b, a
>>> a, b
(8, 5)

Special Methods
There are certain methods such as the init and del methods which have special
significance in classes.

Special methods are used to mimic certain behaviors of built-in types. For exam ple, if you
want to use the x[key] indexing operation for your class (just like you use it for lists and
tuples), then all you have to do is implement the getitem () method and your job is
done. If you think about it, this is what Python does for the list class itself!

Some useful special methods are listed in the following table. If you want to know a bout all
the special methods, see the manual.

init (self, ...)

This m ethod is called just before the newly created object is returned for usage.
del (self)

Called just before the object is destroyed (which has unpredictable timing, so avoid

str (self)
using this)

Called when we use the print function or when str() is used.

lt (self, other)
 Called when the less than operator (<) is used. Similarly, there are special methods
for all the operators (+, >, etc.)

getitem (self, key)

len (self)

Called when x[key] indexing operation is used.

Called when the built-in len() function is used for the sequence object.

Single Statement Blocks

We have seen that each block of statements is set apart from the rest by its own indentation
level. Well, there is one caveat. If your block of statem ents contains only one single
statem ent, then you can specify it on the same line of, say, a conditional statement or
looping statement. The following example should make this clear:

>>> flag = True

>>> if flag: print('Yes')
...
Yes

Notice that the single statement is used in-place and not as a separate block. Although, you
can use this for making your program smaller, I strongly recommend avoiding this short-cut
method, except for error checking, mainly because it will be much easier to add an extra
statem ent if you are using proper indentation.

Lambda Forms
A lambda statem ent is used to create new function objects. Essentially, the lambda takes a
parameter followed by a single expression. Lambda becom es the body of the function. The
value of this expression is returned by the new function.

Exam ple (save as more_lambda.py ):

points = [{'x': 2, 'y': 3},

{'x': 4, 'y': 1}]
[Link](key=lambda i: i['y'])
print(points)

Output:

$ python more_lambda.py
[{'y': 1, 'x': 4}, {'y': 3, 'x': 2}]
How It Works

Notice that the sort method of a list can take a key param eter which determines how
the list is sorted (usually we know only about ascending or descending order). In our case,
we want to do a custom sort, and for that we need to write a funct ion. Instead of writing a
separate def block for a function that will get used in only this one place, we use a lam bda
expression to create a new function.

List Comprehension
List com prehensions are used to derive a new list from an existing list. Suppose you have a
list of num bers and you want to get a corresponding list with all the numbers multiplied by 2
only when the num ber itself is greater than 2. List com prehensions are ideal for such
situations.

Exam ple (save as more_list_comprehension.py ):

listone = [2, 3, 4]
listtwo = [2*i for i in listone if i > 2]
print(listtwo)

Output:

$ python more_list_comprehension.py
[6, 8]

How It Works

Here, we derive a new list by specifying the manipulation to be done ( 2*i ) when some
condition is satisfied ( if i > 2 ). Note that the original list rem ains unmodified.

The advantage of using list com prehensions is that it reduces the amount of boilerplate code
required when we use loops to process each elem ent of a list and store it in a new list.

Receiving Tuples and Dictionaries in Functions

There is a special way of receiving param eters to a function as a tuple or a dictionary using
the * or ** prefix respectively. This is useful when taking variable number of arguments in
the function.

>>> def powersum(power, *args):

... '''Return the sum of each argument raised to the specified power.'''
... total = 0
... for i in args:
... total += pow(i, power)
... return total
...
>>> powersum(2, 3, 4)
25
>>> powersum(2, 10)
100

Because we have a * prefix on the args variable, all extra argum ents passed to the
function are stored in args as a tuple. If a ** prefix had been used instead, the extra
parameters would be considered to be key/value pairs of a dictionary.

The assert statement

The assert statement is used to assert that som ething is true. For example, if you are very
sure that you will have at least one element in a list you are using and want to check this,
and raise an error if it is not true, then assert statement is ideal in this situation. When the
assert statement fails, an AssertionError is raised. The pop() method rem oves and
returns the last item from the list.

>>> mylist = ['item']

>>> assert len(mylist) >= 1
>>> [Link]()
'item'
>>> assert len(mylist) >= 1
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
AssertionError

The assert statement should be used judiciously. Most of the time, it is better to catch
exceptions, either handle the problem or display an error message to the user and then quit.

Decorators
Decorators are a shortcut to applying wrapper functions. This is helpful to "wrap"
functionality with the same code over and over again. For example, I created a retry
 decorator for myself that I can just apply to any function and if any exc eption is thrown
during a run, it is retried again, till a m aximum of 5 tim es and with a delay between each
retry. This is especially useful for situations where you are trying to make a network call to a
remote com puter:

from time import sleep

from functools import wraps
import logging
[Link]()
log = [Link]("retry")

def retry(f):
@wraps(f)
def wrapper_function(*args, **kwargs):
MAX_ATTEMPTS = 5
for attempt in range(1, MAX_ATTEMPTS + 1):
try:
return f(*args, **kwargs)
except Exception:
[Link]("Attempt %s/%s failed : %s",
attempt,
MAX_ATTEMPTS,
(args, kwargs))
sleep(10 * attempt)
[Link]("All %s attempts failed : %s",
MAX_ATTEMPTS,
(args, kwargs))
return wrapper_function

counter = 0

@retry
def save_to_database(arg):
print("Write to a database or make a network call or etc.")
print("This will be automatically retried if exception is thrown.")
global counter
counter += 1
# This will throw an exception in the first call
# And will work fine in the second call (i.e. a retry)
if counter < 2:
raise ValueError(arg)

if name == ' main ':

save_to_database("Some bad value")

Output:
 $ python more_decorator.py
Write to a database or make a network call or etc.
This will be automatically retried if exception is thrown.
ERROR:retry:Attempt 1/5 failed : (('Some bad value',), {})
Traceback (most recent call last):
File "more_decorator.py", line 14, in wrapper_function
return f(*args, **kwargs)
File "more_decorator.py", line 39, in save_to_database
raise ValueError(arg)
ValueError: Some bad value
Write to a database or make a network call or etc.
This will be automatically retried if exception is thrown.

What Next
If you have read this book thoroughly till now and practiced writing a lot of programs, then
you must have become comfortable and familiar with Python. You have probably created
some Python programs to try out stuff and to exercise your Python skills as well. If you have
not done it already, you should. The question now is 'What Next?'.

I would suggest that you tackle this problem:

Create your own command-line address-book program using which you can browse,
add, modify, delete or search for your contacts such as friends, fam ily and colleagues
and their information such as em ail address and/or phone num ber. Details must be
stored for later retrieval.

This is fairly easy if you think about it in terms of all the various stuff that we have come
across till now. If you still want directions on how to proceed, then here's a hint .

Once you are able to do this, you can claim to be a Python programmer. Now, imm ediately
send me an email thanking me for this great book ;-). This step is optional but
recommended. Also, please consider buying a printed copy to support the continued
development of this book.

If you found that program easy, here's another one:

Im plement the replace command. This command will replace one string with another in
the list of files provided.

The replace command can be as sim ple or as sophisticated as you wish, from sim ple string
substitution to looking for patterns (regular expressions).
Example Code

Installing libraries
There are a huge num ber of open source libraries at the Python Package Index which you
can use in your own programs.

To install and use these libraries, you can use pip.

Graphical Software
Suppose you want to create your own graphical programs using Python. This can be done
using a GUI (Graphical User Interface) library with their Python bindings. Bindings are what
allow you to write programs in Python and use the libraries which are themselves written in
C or C++ or other languages.

PyGTK

This is the Python binding for the GTK+ toolkit which is the foundation u pon which
GNOME is built. GTK+ has many quirks in usage but once you becom e
comfortable, you can create GUI apps fast. The Glade graphical interface designer
is indispensable. The documentation is yet to im prove. GTK+ works well on
GNU/Linux but its port to Windows is incomplete. You can create both free as well
as proprietary software using GTK+. To get started, read the PyGTK tutorial.
PyQt

This is the Python binding for the Qt toolkit which is the foundation upon which the
KDE is built. Qt is extremely easy to use and very powerful especially due to the Qt
Designer and the am azing Qt documentation. PyQt is free if you want to create
open source (GPL'ed) software and you need to buy it if you want to create
proprietary closed source software. Starting with Qt 4.5 you can use it to create
non-GPL software as well. To get started, read about PySide.
wxPython

This is the Python bindings for the wxWidgets toolkit. wxPython has a learning
curve associated with it. However, it is very portable and runs on G NU/Linux,
Windows, Mac and even embedded platforms. There are many IDEs available for
wxPython which include GUI designers as well such as SPE (Stani's Python Editor)
and the wxGlade GUI builder.
Various Implementations
There are usually two parts a programming language - the language and the software. A
language is how you write something. The software is what actually runs our programs.

We have been using the CPython software to run our programs. It is referred to as CPython
because it is written in the C language and is the Classical Python interpreter.

There are also other software that can run your Python programs:

Jython

A Python im plementation that runs on the Java platform. This means you can use
Java libraries and classes from within Python language and vice-versa.
IronPython

A Python implementation that runs on the .NET platform. This means you can use
.NET libraries and classes from within Python language and vice -versa.
PyPy

A Python implem entation written in Python! This is a research project to make it fast
and easy to im prove the interpreter since the interpreter itself is written in a
dynamic language (as opposed to static languages such as C, Java or C# in the
above three im plementations)

There are also others such as CLPython - a Python im plementation written in Common Lisp
and Brython which is an implementation on top of a JavaScript interpreter which could m ean
that you can use Python (instead of JavaScript) to write your web-browser ("Ajax")
programs.

Each of these im plementations have their specialized areas where they are useful.

We have now come to the end of this book but, as they say, this is the the beginning of the
end!. You are now an avid Python user and you are no doubt ready to solve m any problems
using Python. You can start automating your computer to do all kinds of previously
unim aginable things or write your own games and much much m ore. So, get started!

THANKYOU!