+++++++++++

Python News

+++++++++++

What's New in Python 3.2.3?

===========================

*Release date: 10-Apr-2012*

Build

-----

- Issue #14387: Work around a problem building extension modules under Windows

by undefining ``small`` before use in the Python headers.

What's New in Python 3.2.3 release candidate 2?

===============================================

*Release date: 18-Mar-2012*

Library

-------

- Issue #6884: Fix long-standing bugs with MANIFEST.in parsing in distutils

on Windows.

Extension Modules

-----------------

- Issue #14234: CVE-2012-0876: Randomize hashes of xml attributes in the hash

table internal to the pyexpat module's copy of the expat library to avoid a

denial of service due to hash collisions. Patch by David Malcolm with some

modifications by the expat project.

What's New in Python 3.2.3 release candidate 1?

===============================================

*Release date: 24-Feb-2012*

Core and Builtins

-----------------

- Issue #13703: oCERT-2011-003: add -R command-line option and PYTHONHASHSEED

environment variable, to provide an opt-in way to protect against denial of

service attacks due to hash collisions within the dict and set types. Patch

by David Malcolm, based on work by Victor Stinner.

- Issue #14084: Fix a file descriptor leak when importing a module with a

bad encoding.

- Issue #13020: Fix a reference leak when allocating a structsequence object

fails. Patch by Suman Saha.

- Issue #13908: Ready types returned from PyType_FromSpec.

- Issue #11235: Fix OverflowError when trying to import a source file whose

modification time doesn't fit in a 32-bit timestamp.

- Fix the builtin module initialization code to store the init function for

future reinitialization.

- Issue #8052: The posix subprocess module would take a long time closing

all possible file descriptors in the child process rather than just open

file descriptors. It now closes only the open fds if possible for the

default close_fds=True behavior.

- Issue #13629: Renumber the tokens in token.h so that they match the indexes

into _PyParser_TokenNames.

- Fix the fix for issue #12149: it was incorrect, although it had the side

effect of appearing to resolve the issue. Thanks to Mark Shannon for

noticing.

- Issue #13505: Pickle bytes objects in a way that is compatible with

Python 2 when using protocols <= 2.

- Issue #11147: Fix an unused argument in _Py_ANNOTATE_MEMORY_ORDER. (Fix

given by Campbell Barton).

- Issue #7111: Python can now be run without a stdin, stdout or stderr

stream. It was already the case with Python 2. However, the corresponding

sys module entries are now set to None (instead of an unusable file object).

- Issue #13436: Fix a bogus error message when an AST object was passed

an invalid integer value.

- Issue #13338: Handle all enumerations in _Py_ANNOTATE_MEMORY_ORDER

to allow compiling extension modules with -Wswitch-enum on gcc.

Initial patch by Floris Bruynooghe.

- Issue #13333: The UTF-7 decoder now accepts lone surrogates (the encoder

already accepts them).

- Issue #13342: input() used to ignore sys.stdin's and sys.stdout's unicode

error handler in interactive mode (when calling into PyOS_Readline()).

- Issue #13343: Fix a SystemError when a lambda expression uses a global

variable in the default value of a keyword-only argument:

(lambda *, arg=GLOBAL_NAME: None)

- Issue #10519: Avoid unnecessary recursive function calls in

setobject.c.

- Issue #10363: Deallocate global locks in Py_Finalize().

- Issue #13018: Fix reference leaks in error paths in dictobject.c.

Patch by Suman Saha.

- Issue #1294232: In a few cases involving metaclass inheritance, the

interpreter would sometimes invoke the wrong metaclass when building a new

class object. These cases now behave correctly. Patch by Daniel Urban.

- Issue #12604: VTRACE macro expanded to no-op in _sre.c to avoid compiler

warnings. Patch by Josh Triplett and Petri Lehtinen.

- Issue #13188: When called without an explicit traceback argument,

generator.throw() now gets the traceback from the passed exception's

``__traceback__`` attribute. Patch by Petri Lehtinen.

- Issue #7833: Extension modules built using distutils on Windows will no

longer include a "manifest" to prevent them failing at import time in some

embedded situations.

- Issue #13063: the Windows error ERROR_NO_DATA (numbered 232 and described

as "The pipe is being closed") is now mapped to POSIX errno EPIPE

(previously EINVAL).

- Issue #12911: Fix memory consumption when calculating the repr() of huge

tuples or lists.

- Issue #7732: Don't open a directory as a file anymore while importing a

module. Ignore the direcotry if its name matchs the module name (e.g.

"__init__.py") and raise a ImportError instead.

- Issue #13021: Missing decref on an error path. Thanks to Suman Saha for

finding the bug and providing a patch.

- Issue #12973: Fix overflow checks that relied on undefined behaviour in

list_repeat (listobject.c) and islice_next (itertoolsmodule.c). These bugs

caused test failures with recent versions of Clang.

- Issue #12802: the Windows error ERROR_DIRECTORY (numbered 267) is now

mapped to POSIX errno ENOTDIR (previously EINVAL).

- Issue #9200: The str.is* methods now work with strings that contain non-BMP

characters even in narrow Unicode builds.

- Issue #12791: Break reference cycles early when a generator exits with

an exception.

- Issue #12266: Fix str.capitalize() to correctly uppercase/lowercase

titlecased and cased non-letter characters.

Library

-------

- Issue #8033: sqlite3: Fix 64-bit integer handling in user functions

on 32-bit architectures. Initial patch by Philippe Devalkeneer.

- HTMLParser is now able to handle slashes in the start tag.

- Issue #14001: CVE-2012-0845: xmlrpc: Fix an endless loop in

SimpleXMLRPCServer upon malformed POST request.

- Issue #2489: pty.spawn could consume 100% cpu when it encountered an EOF.

- Issue #13014: Fix a possible reference leak in SSLSocket.getpeercert().

- Issue #13015: Fix a possible reference leak in defaultdict.__repr__.

Patch by Suman Saha.

- Issue #1326113: distutils' build_ext command --libraries option now

correctly parses multiple values separated by whitespace or commas.

- Issue #10287: nntplib now queries the server's CAPABILITIES first before

sending MODE READER, and only sends it if not already in READER mode.

Patch by Hynek Schlawack.

- Issue #13979: A bug in ctypes.util.find_library that caused

the wrong library name to be returned has been fixed.

- Issue #13993: HTMLParser is now able to handle broken end tags when

strict=False.

- Issue #9750: Fix sqlite3.Connection.iterdump on tables and fields

with a name that is a keyword or contains quotes. Patch by Marko

Kohtala.

- Issue #10287: nntplib now queries the server's CAPABILITIES again after

authenticating (since the result may change, according to RFC 4643).

Patch by Hynek Schlawack.

- Issue #13989: Document that GzipFile does not support text mode, and give a

more helpful error message when opened with an invalid mode string.

- Issue #13590: On OS X 10.7 and 10.6 with Xcode 4.2, building

Distutils-based packages with C extension modules may fail because

Apple has removed gcc-4.2, the version used to build python.org

64-bit/32-bit Pythons. If the user does not explicitly override

the default C compiler by setting the CC environment variable,

Distutils will now attempt to compile extension modules with clang

if gcc-4.2 is required but not found. Also as a convenience, if

the user does explicitly set CC, substitute its value as the default

compiler in the Distutils LDSHARED configuration variable for OS X.

(Note, the python.org 32-bit-only Pythons use gcc-4.0 and the 10.4u

SDK, neither of which are available in Xcode 4. This change does not

attempt to override settings to support their use with Xcode 4.)

- Issue #13960: HTMLParser is now able to handle broken comments when

strict=False.

- Issue #9021: Add an introduction to the copy module documentation.

- Issue #6005: Examples in the socket library documentation use sendall, where

relevant, instead send method.

- Issue #10811: Fix recursive usage of cursors. Instead of crashing,

raise a ProgrammingError now.

- Issue #10881: Fix test_site failure with OS X framework builds.

- Issue #964437: Make IDLE help window non-modal.

Patch by Guilherme Polo and Roger Serwy.

- Issue #2945: Make the distutils upload command aware of bdist_rpm products.

- Issue #13933: IDLE auto-complete did not work with some imported

module, like hashlib. (Patch by Roger Serwy)

- Issue #13901: Prevent test_distutils failures on OS X with --enable-shared.

- Issue #13676: Handle strings with embedded zeros correctly in sqlite3.

- Issue #13506: Add '' to path for IDLE Shell when started and restarted with Restart Shell.

Original patches by Marco Scataglini and Roger Serwy.

- Issue #13848: open() and the FileIO constructor now check for NUL

characters in the file name. Patch by Hynek Schlawack.

- Issue #13806: The size check in audioop decompression functions was too

strict and could reject valid compressed data. Patch by Oleg Plakhotnyuk.

- Issue #13812: When a multiprocessing Process child raises an exception,

flush stderr after printing the exception traceback.

- Issue #13885: CVE-2011-3389: the _ssl module would always disable the CBC

IV attack countermeasure.

- Issue #13772: In os.symlink() under Windows, do not try to guess the link

target's type (file or directory). The detection was buggy and made the

call non-atomic (therefore prone to race conditions).

- Issue #6631: Disallow relative file paths in urllib urlopen methods.

- Issue #13722: Avoid silencing ImportErrors when initializing the codecs

registry.

- Issue #13781: Fix GzipFile bug that caused an exception to be raised when

opening for writing using a fileobj returned by os.fdopen().

- Issue #13803: Under Solaris, distutils doesn't include bitness

in the directory name.

- Issue #13589: Fix some serialization primitives in the aifc module.

Patch by Oleg Plakhotnyuk.

- Issue #13642: Unquote before b64encoding user:password during Basic

Authentication. Patch contributed by Joonas Kuorilehto.

- Issue #13726: Fix the ambiguous -S flag in regrtest. It is -o/--slow for slow

tests.

- Issue #12364: Fix a hang in concurrent.futures.ProcessPoolExecutor.

The hang would occur when retrieving the result of a scheduled future after

the executor had been shut down.

- Issue #13502: threading: Fix a race condition in Event.wait() that made it

return False when the event was set and cleared right after.

- Issue #12926: Fix a bug in tarfile's link extraction.

- Issue #13696: Fix the 302 Relative URL Redirection problem.

- Issue #13636: Weak ciphers are now disabled by default in the ssl module

(except when SSLv2 is explicitly asked for).

- Issue #12798: Updated the mimetypes documentation.

- Issue #11006: Don't issue low level warning in subprocess when pipe2() fails.

- Issue #11829: Fix code execution holes in inspect.getattr_static for

metaclasses with metaclasses. Patch by Andreas Stührk.

- Issue #1785: Fix inspect and pydoc with misbehaving descriptors.

- Issue #11813: Fix inspect.getattr_static for modules. Patch by Andreas

Stührk.

- Issue #7502: Fix equality comparison for DocTestCase instances. Patch by

Cédric Krier.

- Issue #11870: threading: Properly reinitialize threads internal locks and

condition variables to avoid deadlocks in child processes.

- Issue #8035: urllib: Fix a bug where the client could remain stuck after a

redirection or an error.

- Issue #10350: Read and save errno before calling a function which might

overwrite it. Original patch by Hallvard B Furuseth.

- Issue #13591: A bug in importlib has been fixed that caused import_module

to load a module twice.

- Issue #4625: If IDLE cannot write to its recent file or breakpoint

files, display a message popup and continue rather than crash.

(original patch by Roger Serwy)

- Issue #5905: time.strftime() is now using the locale encoding, instead of

UTF-8, if the wcsftime() function is not available.

- Issue #8641: Update IDLE 3 syntax coloring to recognize b".." and not u"..".

Patch by Tal Einat.

- tarfile.py: Correctly detect bzip2 compressed streams with blocksizes

other than 900k.

- Issue #13439: Fix many errors in turtle docstrings.

- Issue #13487: Make inspect.getmodule robust against changes done to

sys.modules while it is iterating over it.

- Issue #12618: Fix a bug that prevented py_compile from creating byte

compiled files in the current directory. Initial patch by Sjoerd de Vries.

- Issue #13444: When stdout has been closed explicitly, we should not attempt

to flush it at shutdown and print an error.

- Issue #12856: Ensure child processes do not inherit the parent's random

seed for filename generation in the tempfile module. Patch by Brian

Harring.

- Issue #13458: Fix a memory leak in the ssl module when decoding a

certificate with a subjectAltName. Patch by Robert Xiao.

- Issue #13415: os.unsetenv() doesn't ignore errors anymore.

- Issue #13322: Fix BufferedWriter.write() to ensure that BlockingIOError is

raised when the wrapped raw file is non-blocking and the write would block.

Previous code assumed that the raw write() would raise BlockingIOError, but

RawIOBase.write() is defined to returned None when the call would block.

Patch by sbt.

- Issue #13358: HTMLParser now calls handle_data only once for each CDATA.

- Issue #4147: minidom's toprettyxml no longer adds whitespace around a text

node when it is the only child of an element. Initial patch by Dan

Kenigsberg.

- Issues #1745761, #755670, #13357, #12629, #1200313: HTMLParser now correctly

handles non-valid attributes, including adjacent and unquoted attributes.

- Issue #13193: Fix distutils.filelist.FileList under Windows.

- Issue #13384: Remove unnecessary __future__ import in Lib/random.py

- Issue #13373: multiprocessing.Queue.get() could sometimes block indefinitely

when called with a timeout. Patch by Arnaud Ysmal.

- Issue #13254: Fix Maildir initialization so that maildir contents

are read correctly.

- Issue #3067: locale.setlocale() now raises TypeError if the second

argument is an invalid iterable. Its documentation and docstring

were also updated. Initial patch by Jyrki Pulliainen.

- Issue #13140: Fix the daemon_threads attribute of ThreadingMixIn.

- Issue #13339: Fix compile error in posixmodule.c due to missing semicolon.

Thanks to Robert Xiao.

- Issue #10570: curses.putp() and curses.tparm() are now expecting a byte

string, instead of a Unicode string.

- Issue #2892: preserve iterparse events in case of SyntaxError.

- Issue #670664: Fix HTMLParser to correctly handle the content of

``<script>...</script>`` and ``<style>...</style>``.

- Issue #10817: Fix urlretrieve function to raise ContentTooShortError even

when reporthook is None. Patch by Jyrki Pulliainen.

- Issue #13296: Fix IDLE to clear compile __future__ flags on shell restart.

(Patch by Roger Serwy)

- Issue #13293: Better error message when trying to marshal bytes using

xmlrpc.client.

- Issue #13291: NameError in xmlrpc package.

- Issue #13258: Use callable() built-in in the standard library.

- Issue #13273: fix a bug that prevented HTMLParser to properly detect some

tags when strict=False.

- Issue #10332: multiprocessing: fix a race condition when a Pool is closed

before all tasks have completed.

- Issue #13255: wrong docstrings in array module.

- Issue #9168: now smtpd is able to bind privileged port.

- Issue #12529: fix cgi.parse_header issue on strings with double-quotes and

semicolons together. Patch by Ben Darnell and Petri Lehtinen.

- Issue #12448: smtplib now flushes stdout while running ``python -m smtplib``

in order to display the prompt correctly.

- Issue #6090: zipfile raises a ValueError when a document with a timestamp

earlier than 1980 is provided. Patch contributed by Petri Lehtinen.

- Issue #13194: zlib.compressobj().copy() and zlib.decompressobj().copy() are

now available on Windows.

- Issue #13158: Fix decoding and encoding of GNU tar specific base-256 number

fields in tarfile.

- Issue #13177: Functools lru_cache() no longer calls the original function

inside an exception handler. This makes tracebacks easier to read because

chained exceptions are avoided.

- Issue #13025: mimetypes is now reading MIME types using the UTF-8 encoding,

instead of the locale encoding.

- Issue #10653: On Windows, use strftime() instead of wcsftime() because

wcsftime() doesn't format time zone correctly.

- Issue #11171: Fix distutils.sysconfig.get_makefile_filename when Python was

configured with different prefix and exec-prefix.

- Issue #11254: Teach distutils to compile .pyc and .pyo files in

PEP 3147-compliant __pycache__ directories.

- Issue #11250: Back port fix from 3.3 branch, so that 2to3 can handle files

with line feeds. This was ported from the sandbox to the 3.3 branch, but

didn't make it into 3.2.

- Issue #7367: Fix pkgutil.walk_paths to skip directories whose

contents cannot be read.

- Issue #13099: Fix sqlite3.Cursor.lastrowid under a Turkish locale.

Reported and diagnosed by Thomas Kluyver.

- Issue #13087: BufferedReader.seek() now always raises UnsupportedOperation

if the underlying raw stream is unseekable, even if the seek could be

satisfied using the internal buffer. Patch by John O'Connor.

- Issue #7689: Allow pickling of dynamically created classes when their

metaclass is registered with copyreg. Patch by Nicolas M. Thiéry and Craig

Citro.

- Issue #4147: minidom's toprettyxml no longer adds whitespace to text nodes.

- Issue #13034: When decoding some SSL certificates, the subjectAltName

extension could be unreported.

- Issue #9871: Prevent IDLE 3 crash when given byte stings

with invalid hex escape sequences, like b'\x0'.

(Original patch by Claudiu Popa.)

- Issue #8933: distutils' PKG-INFO files will now correctly report

Metadata-Version: 1.1 instead of 1.0 if a Classifier or Download-URL field is

present.

- Issue #9561: distutils now reads and writes egg-info files using UTF-8,

instead of the locale encoding.

- Issue #12888: Fix a bug in HTMLParser.unescape that prevented it to escape

more than 128 entities. Patch by Peter Otten.

- Issue #12878: Expose a __dict__ attribute on io.IOBase and its subclasses.

- Issue #12636: IDLE reads the coding cookie when executing a Python script.

- Issue #12847: Fix a crash with negative PUT and LONG_BINPUT arguments in

the C pickle implementation.

- Issue #11564: Avoid crashes when trying to pickle huge objects or containers

(more than 2**31 items). Instead, in most cases, an OverflowError is raised.

- Issue #12287: Fix a stack corruption in ossaudiodev module when the FD is

greater than FD_SETSIZE.

- Issue #11657: Fix sending file descriptors over 255 over a multiprocessing

Pipe.

- Issue #13007: whichdb should recognize gdbm 1.9 magic numbers.

- Issue #12213: Fix a buffering bug with interleaved reads and writes that

could appear on BufferedRandom streams.

- Issue #12650: Fix a race condition where a subprocess.Popen could leak

resources (FD/zombie) when killed at the wrong time.

- Issue #10860: http.client now correctly handles an empty port after port

delimiter in URLs.

Build

-----

- Issue #6807: Run msisupport.mak earlier.

- Issue #10580: Minor grammar change in Windows installer.

- Issue #13326: Clean __pycache__ directories correctly on OpenBSD.

Tools/Demos

-----------

- Issue #14053: patchcheck.py ("make patchcheck") now works with MQ patches.

Patch by Francisco Martín Brugué.

- Issue #13930: 2to3 is now able to write its converted output files to another

directory tree as well as copying unchanged files and altering the file

suffix. See its new -o, -W and --add-suffix options. This makes it more

useful in many automated code translation workflows.

- Issue #13628: python-gdb.py is now able to retrieve more frames in the Python

traceback if Python is optimized.

Tests

-----

- Issue #11689: Fix a variable scoping error in an sqlite3 test

- Issue #13786: Remove unimplemented 'trace' long option from regrtest.py.

- Issue #13725: Fix regrtest to recognize the documented -d flag.

Patch by Erno Tukia.

- Issue #13304: Skip test case if user site-packages disabled (-s or

PYTHONNOUSERSITE). (Patch by Carl Meyer)

- Issue #13218: Fix test_ssl failures on Debian/Ubuntu.

- Issue #12821: Fix test_fcntl failures on OpenBSD 5.

- Re-enable lib2to3's test_parser.py tests, though with an expected failure

(see issue 13125).

Extension Modules

-----------------

- Issue #13840: The error message produced by ctypes.create_string_buffer

when given a Unicode string has been fixed.

- Issue #9975: socket: Fix incorrect use of flowinfo and scope_id. Patch by

Vilmos Nebehaj.

- Issue #13159: FileIO and BZ2File now use a linear-time buffer growth

strategy instead of a quadratic-time one.

- Issue #13070: Fix a crash when a TextIOWrapper caught in a reference cycle

would be finalized after the reference to its underlying BufferedRWPair's

writer got cleared by the GC.

- Issue #12881: ctypes: Fix segfault with large structure field names.

- Issue #13058: ossaudiodev: fix a file descriptor leak on error. Patch by

Thomas Jarosch.

- Issue #13013: ctypes: Fix a reference leak in PyCArrayType_from_ctype.

Thanks to Suman Saha for finding the bug and providing a patch.

- Issue #13022: Fix: _multiprocessing.recvfd() doesn't check that

file descriptor was actually received.

- Issue #12483: ctypes: Fix a crash when the destruction of a callback

object triggers the garbage collector.

- Issue #12950: Fix passing file descriptors in multiprocessing, under

OpenIndiana/Illumos.

Documentation

-------------

- Issues #13491 and #13995: Fix many errors in sqlite3 documentation.

Initial patch for #13491 by Johannes Vogel.

- Issue #13402: Document absoluteness of sys.executable.

- Issue #13883: PYTHONCASEOK also used on OS X and OS/2.

- Issue #12949: Document the kwonlyargcount argument for the PyCode_New

C API function.

- Issue #2134: The tokenize documentation has been clarified to explain why

all operator and delimiter tokens are treated as token.OP tokens.

- Issue #13513: Fix io.IOBase documentation to correctly link to the

io.IOBase.readline method instead of the readline module.

- Issue #13237: Reorganise subprocess documentation to emphasise convenience

functions and the most commonly needed arguments to Popen.

- Issue #13141: Demonstrate recommended style for socketserver examples.

What's New in Python 3.2.2?

===========================

*Release date: 03-Sep-2011*

Core and Builtins

-----------------

- Issue #12326: sys.platform is now always 'linux2' on Linux, even if Python

is compiled on Linux 3.

- Accept bytes for the AST string type. This is temporary until a proper fix in

3.3.

Library

-------

- Issue #8286: The distutils command sdist will print a warning message instead

of crashing when an invalid path is given in the manifest template.

- Issue #12841: tarfile unnecessarily checked the existence of numerical user

and group ids on extraction. If one of them did not exist the respective id

of the current user (i.e. root) was used for the file and ownership

information was lost.

- Issue #10946: The distutils commands bdist_dumb, bdist_wininst and bdist_msi

now respect a --skip-build option given to bdist.

- Issue #12839: Fix crash in zlib module due to version mismatch.

Fix by Richard M. Tew.

Extension Modules

-----------------

- Issue #9651: Fix a crash when ctypes.create_string_buffer(0) was passed to

some functions like file.write().

What's New in Python 3.2.2 release candidate 1?

===============================================

*Release date: 14-Aug-2011*

Core and Builtins

-----------------

- Issue #12732: In narrow unicode builds, allow Unicode identifiers which fall

outside the BMP.

- Issue #11603: Fix a crash when __str__ is rebound as __repr__. Patch by

Andreas Stührk.

- Issue #11321: Fix a crash with multiple imports of the _pickle module when

embedding Python. Patch by Andreas Stührk.

- Verify the types of AST strings and identifiers provided by the user before

compiling them.

- Issue #12579: str.format_map() now raises a ValueError if used on a

format string that contains positional fields. Initial patch by

Julian Berman.

- Issue #11627: Fix segfault when __new__ on a exception returns a

non-exception class.

- Issue #12149: Update the method cache after a type's dictionary gets

cleared by the garbage collector. This fixes a segfault when an instance

and its type get caught in a reference cycle, and the instance's

deallocator calls one of the methods on the type (e.g. when subclassing

IOBase). Diagnosis and patch by Davide Rizzo.

- When a generator yields, do not retain the caller's exception state on the

generator.

- Issue #12475: Prevent generators from leaking their exception state into the

caller's frame as they return for the last time.

Library

-------

- Issue #11513: Fix exception handling ``tarfile.TarFile.gzopen()`` when

the file cannot be opened.

- Issue #12687: Fix a possible buffering bug when unpickling text mode

(protocol 0, mostly) pickles.

- Issue #10087: Fix the html output format of the calendar module.

- Issue #12540: Prevent zombie IDLE processes on Windows due to changes

in os.kill().

- Issue #12683: urlparse updated to include svn as schemes that uses relative

paths. (svn from 1.5 onwards support relative path).

- Issues #11104, #8688: Fix the behavior of distutils' sdist command with

manually-maintained MANIFEST files.

- Issue #12464: tempfile.TemporaryDirectory.cleanup() should not follow

symlinks: fix it. Patch by Petri Lehtinen.

- Issue #8887: "pydoc somebuiltin.somemethod" (or help('somebuiltin.somemethod')

in Python code) now finds the doc of the method.

- Issue #12603: Fix pydoc.synopsis() on files with non-negative st_mtime.

- Issue #12514: Use try/finally to assure the timeit module restores garbage

collections when it is done.

- Issue #12607: In subprocess, fix issue where if stdin, stdout or stderr is

given as a low fd, it gets overwritten.

- Issue #12590: IDLE editor window now always displays the first line

when opening a long file. With Tk 8.5, the first line was hidden.

- Issue #12576: Fix urlopen behavior on sites which do not send (or obfuscates)

Connection:close header.

- Issue #1813: Fix codec lookup under Turkish locales.

- Issue #12591: Improve support of "universal newlines" in the subprocess

module: the piped streams can now be properly read from or written to.

- Issue #12591: Allow io.TextIOWrapper to work with raw IO objects (without

a read1() method), and add an undocumented *write_through* parameter to

mandate unbuffered writes.

- Issue #9611, #9015: FileIO.read() clamps the length to INT_MAX on Windows.

- Issue #10883: Fix socket leaks in urllib.request when using FTP.

- Issue #12571: Add a plat-linux3 directory mirroring the plat-linux2

directory, so that "import DLFCN" and other similar imports work on

Linux 3.0.

- Issue #7484: smtplib no longer puts <> around addresses in VRFY and EXPN

commands; they aren't required and in fact postfix doesn't support that form.

- Close the call queue in concurrent.futures.ProcessPoolExecutor when

shutdown() is called, without waiting for the garbage collector to kick in.

- Issue #12502: asyncore: fix polling loop with AF_UNIX sockets.

- Issue #4376: ctypes now supports nested structures with an endianness

different than that of the parent structure. Patch by Vlad Riscutia.

- Raise ValueError when attempting to set the _CHUNK_SIZE attribute of a

TextIOWrapper to a huge value, not TypeError.

- Issue #12493: subprocess: Popen.communicate() now also handles EINTR errors

if the process has only one pipe.

- Issue #12451: pydoc: html_getfile() now uses tokenize.open() to support

Python modules using a encoding different than UTF-8 (reading the coding

cookie of the module).

- Issue #12451: pydoc: importfile() now opens the Python module in binary mode,

instead of text mode using the locale encoding, to avoid encoding issues.

- Issue #12451: runpy: run_path() now opens the Python module in binary mode,

instead of text mode using the locale encoding, to support other encodings

than UTF-8 (modules using the coding cookie).

- Issue #12451: xml.dom.pulldom: parse() now opens files in binary mode instead

of the text mode (using the locale encoding) to avoid encoding issues.

Extension Modules

-----------------

- Issue #12764: Fix a crash in ctypes when the name of a Structure field is not

a string.

- Issue #11241: subclasses of ctypes.Array can now be subclassed.

- Issue #10309: Define _GNU_SOURCE so that mremap() gets the proper

signature. Without this, architectures where sizeof void* != sizeof int are

broken. Patch given by Hallvard B Furuseth.

C-API

-----

Build

-----

- Issue #12560: Build libpython.so on OpenBSD. Patch by Stefan Sperling.

- Issue #12592: Make Python build on OpenBSD 5 (and future major releases).

- Issue #12372: POSIX semaphores are broken on AIX: don't use them.

Tools/Demos

-----------

- Issue #10639: reindent.py no longer converts newlines and will raise

an error if attempting to convert a file with mixed newlines.

Tests

-----

- Issue #12331: The test suite for lib2to3 can now run from an installed

Python.

- Issue #12626: In regrtest, allow to filter tests using a glob filter

with the ``-m`` (or ``--match``) option. This works with all test cases

using the unittest module. This is useful with long test suites

such as test_io or test_subprocess.

- Issue #12624: It is now possible to fail after the first failure when

running in verbose mode (``-v`` or ``-W``), by using the ``--failfast``

(or ``-G``) option to regrtest. This is useful with long test suites

such as test_io or test_subprocess.

- Issue #12587: Correct faulty test file and reference in test_tokenize.

(Patch by Robert Xiao)

- Try harder to reap dangling threads in test.support.reap_threads().

- Issue #12573: Add resource checks for dangling Thread and Process objects.

- Issue #12549: Correct test_platform to not fail when OS X returns 'x86_64'

as the processor type on some Mac systems.

- Avoid failing in test_robotparser when mueblesmoraleda.com is flaky and

an overzealous DNS service (e.g. OpenDNS) redirects to a placeholder

Web site.

- Issue #12440: When testing whether some bits in SSLContext.options can be

reset, check the version of the OpenSSL headers Python was compiled against,

rather than the runtime version of the OpenSSL library.

- Issue #12497: Install test/data to prevent failures of the various codecmaps

tests.

- Issue #12496: Install test/capath directory to prevent test_connect_capath

testcase failure in test_ssl.

- Issue #12469: Run "wakeup" signal tests in subprocess to run the test in a

fresh process with only one thread and to not change signal handling of the

parent process.

- Issue #8716: Avoid crashes caused by Aqua Tk on OSX when attempting to run

test_tk or test_ttk_guionly under a username that is not currently logged

in to the console windowserver (as may be the case under buildbot or ssh).

What's New in Python 3.2.1?

===========================

*Release date: 10-Jul-2011*

Library

-------

- Issue #12467: warnings: fix a race condition if a warning is emitted at

shutdown, if globals()['__file__'] is None.

Tests

-----

- Skip network tests when getaddrinfo() returns EAI_AGAIN, meaning a temporary

failure in name resolution.

- Issue #11812: Solve transient socket failure to connect to 'localhost'

in test_telnetlib.py.

- Solved a potential deadlock in test_telnetlib.py. Related to issue #11812.

- Avoid failing in test_urllibnet.test_bad_address when some overzealous

DNS service (e.g. OpenDNS) resolves a non-existent domain name. The test

is now skipped instead.

What's New in Python 3.2.1 release candidate 2?

===============================================

*Release date: 03-Jul-2011*

Core and Builtins

-----------------

- Issue #12291: You can now load multiple marshalled objects from a stream, with

other data interleaved between marshalled objects.

- Issue #12084: os.stat on Windows now works properly with relative symbolic

links when called from any directory.

- Issue #1195: my_fgets() now always clears errors before calling fgets(). Fix

the following case: sys.stdin.read() stopped with CTRL+d (end of file),

raw_input() interrupted by CTRL+c.

- Issue #9670: Increase the default stack size for secondary threads on Mac OS X

and FreeBSD to reduce the chances of a crash instead of a "maximum recursion

depth" RuntimeError exception (patch by Ronald Oussoren).

Library

-------

- Issue #12147: Adjust the new-in-3.2 smtplib.send_message method for better

conformance to the RFCs: correctly handle Sender and Resent headers.

- Issue #12352: Fix a deadlock in multiprocessing.Heap when a block is freed by

the garbage collector while the Heap lock is held.

- Issue #12451: The XInclude default loader of xml.etree now decodes files from

UTF-8 instead of the locale encoding if the encoding is not specified. It now

also opens XML files for the parser in binary mode instead of the text mode to

avoid encoding issues.

- Issue #12451: doctest.debug_script() doesn't create a temporary file anymore

to avoid encoding issues.

- Issue #12451: pydoc.synopsis() now reads the encoding cookie if available, to

read the Python module from the right encoding.

- Issue #12451: distutils now opens the setup script in binary mode to read the

encoding cookie, instead of opening it in UTF-8.

- Issue #9516: On Mac OS X, change Distutils to no longer globally attempt to

check or set the MACOSX_DEPLOYMENT_TARGET environment variable for the

interpreter process. This could cause failures in non-Distutils subprocesses

and was unreliable since tests or user programs could modify the interpreter

environment after Distutils set it. Instead, have Distutils set the the

deployment target only in the environment of each build subprocess. It is

still possible to globally override the default by setting

MACOSX_DEPLOYMENT_TARGET before launching the interpreter; its value must be

greater or equal to the default value, the value with which the interpreter

was built.

- Issue #12383: Fix subprocess module with env={}: don't copy the environment

variables, start with an empty environment.

- Issue #11584: email.header.decode_header no longer fails if the header passed

to it is a Header object, and Header/make_header no longer fail if given

binary unknown-8bit input.

- Issue #11700: mailbox proxy object close methods can now be called multiple

times without error.

- Issue #11767: Correct file descriptor leak in mailbox's __getitem__ method.

- Issue #12133: AbstractHTTPHandler.do_open() of urllib.request closes the HTTP

connection if its getresponse() method fails with a socket error. Patch

written by Ezio Melotti.

- Issue #9284: Allow inspect.findsource() to find the source of doctest

functions.

- Issue #12009: Fixed regression in netrc file comment handling.

- Issue #10694: zipfile now ignores garbage at the end of a zipfile.

- Issue #12283: Fixed regression in smtplib quoting of leading dots in DATA.

- Issue #12168: SysLogHandler now allows NUL termination to be controlled using

a new 'append_nul' attribute on the handler.

- Issue #11583: Speed up os.path.isdir on Windows by using GetFileAttributes

instead of os.stat.

- Named tuples now work correctly with vars().

- Issue #12085: Fix an attribute error in subprocess.Popen destructor if the

constructor has failed, e.g. because of an undeclared keyword argument. Patch

written by Oleg Oshmyan.

- Issue #985064: Make plistlib more resilient to faulty input plists. Patch by

Mher Movsisyan.

- Issue #12175: RawIOBase.readall() now returns None if read() returns None.

- Issue #12175: FileIO.readall() now raises a ValueError instead of an IOError

if the file is closed.

- Issue #12070: Fix the Makefile parser of the sysconfig module to handle

correctly references to "bogus variable" (e.g. "prefix=$/opt/python").

- Issue #12100: Don't reset incremental encoders of CJK codecs at each call to

their encode() method anymore, but continue to call the reset() method if the

final argument is True.

- Issue #5715: In socketserver, close the server socket in the child process.

- Correct lookup of __dir__ on objects. Among other things, this causes errors

besides AttributeError found on lookup to be propagated.

- Issue #12124: zipimport doesn't keep a reference to zlib.decompress() anymore

to be able to unload the module.

- Issue #12065: connect_ex() on an SSL socket now returns the original errno

when the socket's timeout expires (it used to return None).