Reading Files
Module 3
Software What
It is time to go find some
Next? Data to mess with!
Input Central
and Output Processing Files R
Devices Unit Us
Secondary
if x < 3: print Memory
Main
Memory
File Processing
A text file can be thought of as a sequence of lines
From [Link]@[Link] Sat Jan 5 09:14:16 2008
Return-Path: <postmaster@[Link]>
Date: Sat, 5 Jan 2008 09:12:18 -0500
To: source@[Link]
From: [Link]@[Link]
Subject: [sakai] svn commit: r39772 - content/branches/
Details: [Link]
[Link]
Opening a File
• Before we can read the contents of the file, we must tell Python
which file we are going to work with and what we will be doing
with the file
• This is done with the open() function
• open() returns a “file handle” - a variable used to perform
operations on the file
• Similar to “File -> Open” in a Word Processor
Using open()
fhand = open('[Link]', 'r')
• handle = open(filename, mode)
• returns a handle use to manipulate the file
• filename is a string
• mode is optional and should be 'r' if we are planning to
read the file and 'w' if we are going to write to the file
What is a Handle?
>>> fhand = open('[Link]')
>>> print(fhand)
<_io.TextIOWrapper name='[Link]' mode='r' encoding='UTF-8'>
When Files are Missing
>>> fhand = open('[Link]')
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
FileNotFoundError: [Errno 2] No such file or
directory: '[Link]'
The newline Character
>>> stuff = 'Hello\nWorld!'
>>> stuff
• We use a special character 'Hello\nWorld!'
called the “newline” to indicate >>> print(stuff)
when a line ends Hello
World!
• We represent it as \n in strings >>> stuff = 'X\nY'
>>> print(stuff)
X
• Newline is still one character -
Y
not two >>> len(stuff)
3
File Processing
A text file can be thought of as a sequence of lines
From [Link]@[Link] Sat Jan 5 09:14:16 2008
Return-Path: <postmaster@[Link]>
Date: Sat, 5 Jan 2008 09:12:18 -0500
To: source@[Link]
From: [Link]@[Link]
Subject: [sakai] svn commit: r39772 - content/branches/
Details: [Link]
File Processing
A text file has newlines at the end of each line
From [Link]@[Link] Sat Jan 5 09:14:16 2008\n
Return-Path: <postmaster@[Link]>\n
Date: Sat, 5 Jan 2008 09:12:18 -0500\n
To: source@[Link]\n
From: [Link]@[Link]\n
Subject: [sakai] svn commit: r39772 - content/branches/\n
\n
Details: [Link]
Reading Files in Python
File Handle as a Sequence
• A file handle open for read can
be treated as a sequence of
strings where each line in the xfile = open('[Link]')
file is a string in the sequence for cheese in xfile:
print(cheese)
• We can use the for statement
to iterate through a sequence
• Remember - a sequence is an
ordered set
Counting Lines in a File
fhand = open('[Link]')
• Open a file read-only count = 0
for line in fhand:
• Use a for loop to read each line count = count + 1
print('Line Count:', count)
• Count the lines and print out
the number of lines
$ python [Link]
Line Count: 132045
Reading the *Whole* File
>>> fhand = open('[Link]')
We can read the whole >>> inp = [Link]()
file (newlines and all) >>> print(len(inp))
into a single string 94626
>>> print(inp[:20])
From [Link]
Searching Through a File
We can put an if statement in fhand = open('[Link]')
for line in fhand:
our for loop to only print lines
if [Link]('From:') :
that meet some criteria print(line)
OOPS!
From: [Link]@[Link]
What are all these blank
lines doing here? From: louis@[Link]
From: zqian@[Link]
From: rjlowe@[Link]
...
OOPS!
What are all these blank From: [Link]@[Link]\n
lines doing here? \n
From: louis@[Link]\n
• Each line from the file \n
has a newline at the end From: zqian@[Link]\n
\n
• The print statement adds From: rjlowe@[Link]\n
a newline to each line \n
...
Searching Through a File (fixed)
fhand = open('[Link]')
• We can strip the whitespace for line in fhand:
from the right-hand side of line = [Link]()
if [Link]('From:') :
the string using rstrip() from print(line)
the string library
From: [Link]@[Link]
• The newline is considered
From: louis@[Link]
“white space” and is From: zqian@[Link]
stripped From: rjlowe@[Link]
....
Skipping with continue
fhand = open('[Link]')
We can conveniently for line in fhand:
skip a line by using the line = [Link]()
if not [Link]('From:') :
continue statement continue
print(line)
Using in to Select Lines
fhand = open('[Link]')
We can look for a string for line in fhand:
anywhere in a line as our line = [Link]()
if not '@[Link]' in line :
selection criteria continue
print(line)
From [Link]@[Link] Sat Jan 5 09:14:16 2008
X-Authentication-Warning: set sender to [Link]@[Link] using –f
From: [Link]@[Link]
Author: [Link]@[Link]
From [Link]@[Link] Fri Jan 4 07:02:32 2008
X-Authentication-Warning: set sender to [Link]@[Link] using -f...
fname = input('Enter the file name: ')
fhand = open(fname)
count = 0
Prompt for
for line in fhand:
if [Link]('Subject:') :
count = count + 1
File Name
print('There were', count, 'subject lines in', fname)
Enter the file name: [Link]
There were 1797 subject lines in [Link]
Enter the file name: [Link]
There were 27 subject lines in [Link]
fname = input('Enter the file name: ')
Bad File
try:
fhand = open(fname)
except:
print('File cannot be opened:', fname)
Names quit()
count = 0
for line in fhand:
if [Link]('Subject:') :
count = count + 1
print('There were', count, 'subject lines in', fname)
Enter the file name: [Link]
There were 1797 subject lines in [Link]
Enter the file name: na na boo boo
File cannot be opened: na na boo boo
Summary
• Secondary storage • Searching for lines
• Opening a file - file handle • Reading file names
• File structure - newline character • Dealing with bad files
• Reading a file line by line with a
for loop