Consensus PDF
Consensus PDF
Historians interested in conflict and consensus overlooked, however, is the extent to which the
in technological systems stand much to gain success of the Internet depended on organiza-
from examining standardization—the process- tional innovations directed by Cerf, Kahn, and
es of creating and implementing technical stan- other Internet pioneers such as Jon Postel and
dards. Standardization requires sophisticated David Clark. Starting in the 1970s, researchers
technical work as well as organizational and in groups such as the Internet Configuration
strategic coordination. In the late 1970s, it was Control Board (ICCB), the Internet Activities
reasonable to assume that formal standards-set- Board (IAB), and the Internet Engineering Task
ting institutions, such as the International Force (IETF) coordinated Internet standards
Telecommunication Union (ITU) and the and architectural development. These institu-
International Organization for Standardization tions deserve special attention not only for
(ISO), would lead the coordination and stan- their technical achievements, but also because
dardization of information services, much as they fostered a voluntary international con-
they did for international telecommunications. sensus during a period of intense technical
Beginning in 1977, ISO oversaw a large, ambi- and institutional change in computing and
tious attempt to define a network architecture telecommunications.
called Open Systems Interconnection (OSI). These organizational innovations emerged
Between the late 1970s and the early 1990s, the as responses to external competition from ISO
OSI seven-layer model became enshrined in as well as to internal strains in the processes of
computer science curricula and endorsed by Internet standardization. As the Internet grew
governments around the world. Competing rapidly in the late 1980s and 1990s, groups such
networks—including experimental TCP/IP net- as the IAB and IETF started to become victims
works—were expected to fade away once OSI of their own success and struggled to preserve
protocols were standardized and implemented their founding principles. If we understand
by users and manufacturers. “politics” to mean relations of control between
By the mid-1990s, however, ISO’s slow stan- individuals and groups, the political values of
dardization process had failed to keep up with Internet architects and engineers were especial-
alternative, informal mechanisms that were ly evident as these people built political struc-
more effective at coordinating rapid techno- tures—standards bodies—from scratch.3
logical change.1 These informal mechanisms— Standardization is technically and organiza-
the focus of this article—provided vital tionally complex as well as deeply value-laden.4
institutional support for the eventual success Leaders and participants in the IAB and IETF
and global deployment of the Internet archi- articulated institutional rules, cultural tradi-
tecture and Internet standards such as TCP/IP. tions, and versions of their own history as they
In most existing histories of the Internet, responded to challenges from within and with-
leaders such as Vinton Cerf and Robert Kahn out. A memorable phrase encapsulates the pre-
receive plaudits for their technical work, espe- vailing technical and organizational values of
cially for their roles in the creation of the core those who were involved in the Internet stan-
Internet standards TCP and IP.2 What is often dards process from the mid-1970s to the pres-
48 IEEE Annals of the History of Computing Published by the IEEE Computer Society 1058-6180/06/$20.00 © 2006 IEEE
ent: “We reject: kings, presidents, and voting. Arpanet (PRnet was developed in Hawaii), but
We believe in: rough consensus and running faced a problem of trying to connect what he
code.”5 This article explains how this phrase— later called “two radically different networks”
which became a motto for Internet standardi- with different network capacities, protocols,
zation—articulated a common set of beliefs and routing systems.10 ARPA’s concurrent
about the work culture and engineering style of development of satellite packet switching in
Internet standardization. SATnet further compounded this problem,
In 1999, law professor Lawrence Lessig leading Kahn to conclude that network inter-
declared that “rough consensus and running connection could not be achieved on an ad
code” had broad significance as “a manifesto hoc, network-to-network level.
that will define our generation.”6 An examina- To overcome this problem, Kahn in 1973
tion of the origins of this credo—coined by rekindled an effective partnership with Vint
David Clark in 1992—illustrates some techni- Cerf—the two had worked together on the first
cal, rhetorical, and philosophical differences nodes of the Arpanet in 1969—and proposed a
between the Internet standards process and the new way to transport data packets. This mech-
competing ISO process. Most participants in the anism was a simple technical protocol (trans-
Internet standards process today consider mission control protocol, or TCP) and system
“rough consensus and running code” to be a of gateways (now known as routers) to transfer
succinct and accurate description of the data packets between the dissimilar networks.11
Internet standards process.7 For historians, Kahn’s ultimate goal was to make the network
“rough consensus and running code” stands as transparent, “a seamless whole,” invisible to
a revealing depiction of the international poli- the user who would be more interested in
tics of computer internetworking in the last accessing information over the network instead
quarter of the 20th century, as well as a point of of the operation of the network itself.12 This
entry for investigating why contemporaries basic principle—interconnection via standard
described the competition between the Internet protocols—is the Internet’s fundamental struc-
and OSI as “the Internet religious war.”8 ture and defining feature.13 In 1978, Cerf and
two other DARPA-funded network researchers,
Internet architecture: TCP/IP and the Danny Cohen and Jon Postel, split the func-
end-to-end argument tions of TCP into two protocols, TCP and the
In 1996, the Internet Architecture Board Internet Protocol (IP), that worked together in
(IAB) published RFC 1958, “Architectural the now-familiar combination of TCP/IP.14
Principles of the Internet,” to record aspects of Network transparency and application
architectural approach practiced in the Internet autonomy are the two key elements of a design
community over the previous 25 years. They philosophy first articulated in 1981 by David
wrote: “in very general terms, the community Clark, Jerome Saltzer, and David Reed, three
believes that the goal is connectivity, the tool veterans of ARPA-sponsored networking exper-
is the Internet Protocol, and the intelligence is iments at the Massachusetts Institute of
end to end rather than hidden in the net- Technology’s (MIT’s) Laboratory for Computer
work.”9 This section provides a brief overview Science. Their paper, “End-To-End Arguments
of the distinctive aspects of Internet architec- in System Design,” was written to explore a
ture by exploring these three principles: inter- design principle that they claimed had “been
connection, the Internet Protocol, and the used for many years with[out] explicit recog-
“end-to-end” argument. nition.”15 An outgrowth of substantial experi-
After initial networking experiments with ence with TCP/IP networking, the end-to-end
the Arpanet beginning in 1969, the Advanced principle held that the Internet’s complex
Projects Research Agency (ARPA) continued to functions should be performed at the end-
explore networking concepts for satellite and points, leaving only the (relatively) simple
radio. The problem of how to enable commu- tasks of interconnection and data transport to
nication between technically disparate systems the network. The authors commended the
also had implications for mobile military com- technical merits and simplicity of the end-to-
munications. In the early 1970s, ARPA devel- end model by concluding, “end-to-end argu-
oped a packet radio network (known as PRnet) ments are a kind of ‘Occam’s razor’ when it
based on the same packet-switching technolo- comes to choosing the functions to be provid-
gy being tested in the Arpanet. Robert Kahn, as ed in a communications subsystem.”16
program manager for this project, identified The end-to-end design principle thus calls
the need to connect packet radio networks to for a simple standard for data transfer that
large computers in the continental US via the allows new innovations to be added at the
July–September 2006 49
‘Rough Consensus and Running Code’
edges and on top of the “stupid network.”17 sion formally to expand the involvement of the
From this distributed design follows decentral- research community in making decisions about
ized control, both over the functionality of the the network:
network and over the content of the network
traffic. Marjory Blumenthal and David Clark [W]hen we started the internet program in the
argued in 2001 that end-to-end principles form mid 1970s, originally it was just me in the office
the heart of the running the program. And after Vint was hired,
then it was just Vint running the program with
conventional understanding of the “Internet me to kibitz. And he was so good at what he did
philosophy”: freedom of action, user empower- that he basically had everything in his head.
ment, end-user responsibility for actions under- What I worried about was what would happen if
taken, and lack of controls “in” the Net that limit he got hit by a truck? Number two, what would
or regulate what users can do.18 happen if he would ever have to leave? And
number three, how was anybody else in the com-
By building in minimum control and allow- munity ever going to be part of the thinking
ing the “broadest range of development” to process. So he set up, after some discussions, a
end users, the technical standards of the kind of kitchen cabinet, if you will, of knowl-
Internet have, as Lessig wrote, “erected a free edgeable people that he would convene periodi-
space of innovation.”19 cally. These were mostly the workers in the field,
On 1 January 1983, TCP/IP replaced NCP (an the key people who were implementing proto-
older networking protocol) as the standard host cols . . . When he left, that group stayed intact.24
protocol for the Arpanet.20 “With the use of
TCP/IP now mandatory on the Arpanet,” Kahn This group, Cerf’s “kitchen cabinet,” was the
recalled in 1994, “the rationale for connection ICCB, created in 1979 and “chaired by David
of local area networks was evident and the Clark from MIT to assist ARPA in the planning
growth of users and networks accelerated. It also and execution of the evolution of the TCP/IP
led to a rethinking of the process that ARPA was suite.”25 The ICCB expanded control over
using to manage the evolution of the net- Internet development by bringing more of the
work.”21 The next section examines the evolu- network users—technical experts distributed in
tion of this management process as the Internet universities, firms, and government agencies—
community faced the problems and challenges into Cerf’s inner circle in a more formal way.
that accompanied the growth of the network. For Kahn, the ICCB was important because it
“brought a wider segment of the research com-
Governance of Internet protocols, munity more directly into the decision-making
1979–1992 aspects of the Internet project which, until
Internet researchers created and presided then, had been almost solely undertaken by
over the governing bodies of Internet proto- ARPA.”26
cols—the ICCB, IAB, and IETF—to manage the Cerf left his position as head of the Internet
growth of end-to-end networks based on TCP/IP. research program at ARPA in 1982, and was
The history of these groups reveals the creation replaced in 1983 by Barry Leiner. Leiner and
of increasingly formal structures by a core of Clark, in response to the continued growth of
Internet researchers who strove to preserve the the Internet community, disbanded the ICCB
design principles and work culture that had fos- in September 1984 and created the Internet
tered the Internet’s successful growth. Advisory Board (IAB).27 Clark continued his
Cerf’s involvement with ARPA started at close involvement as the first chair of the IAB—
Stanford University, where he worked from a position that confers the title of “Internet
1974 to 1976 to implement TCP/IP. Kahn, who Architect.”28 Leiner created task forces within
joined ARPA’s Information Processing the IAB to focus on specific aspects of Internet
Techniques Office as a program manager in technology (such as gateway algorithms, end-
1972, hired Cerf to come to ARPA in 1976 to to-end protocols, and security) in an attempt to
run a program to pursue and coordinate keep discussions focused while accommodat-
Internet research. Cerf later recalled that, upon ing growing numbers of participants.29 The
moving to ARPA, “The single-minded goal was Board itself consisted of the chairs of the task
to get the Internet system up and running.”22 forces. There were no elections in the IAB.
When he began at ARPA, Cerf worked with Instead, as Vint Cerf explained in 1989, new
“only a few researchers” to “develop and test members were appointed by the chairman of
versions of the internet protocols.”23 Kahn, the IAB, with the advice and consent of the
Cerf’s manager at the time, recalled the deci- remaining members. Cerf wrote,
July–September 2006 51
‘Rough Consensus and Running Code’
“council of elders.” Historians of the Internet the TCP/IP Internet and the open systems
unequivocally praise this group as a source of interconnection (OSI) model were designed as
its astounding growth. Frequently described as nonproprietary networks that would allow
a meritocracy, this close-knit network of peo- users more flexibility. Although they shared
ple worked together since the early Arpanet some common architectural features, these two
days (many as graduate students at MIT or the models—the Internet and OSI—emerged with-
University of California, Los Angeles, or as in different organizational contexts under
engineers at Bolt Beranek and Newman, the somewhat different motivations. This section
consulting firm that had designed aspects of describes the ideas behind the development of
the Arpanet) and provided the bulk of the tech- OSI, and its adoption by the US Department of
nical and bureaucratic leadership necessary to Defense (DoD).39
keep the Internet up and running.36 (For more OSI is an example of a broader movement
on BBN, see the special issues of Annals: vol. 27, toward “open systems” that “encouraged com-
no. 2 and vol. 28, no. 1.) “Relatively few, com- patibility between systems from different man-
petent, highly motivated people were ufacturers.”40 The emergence of many types of
involved,” recalled Larry Press, “and they had open systems in the 1970s and 1980s (such as
considerable autonomy.”37 for stereo components and microcomputers)
Kahn’s observation about the ICCB’s role as helped smaller producers and consumers who
a sort of kitchen cabinet provides an insight did not want to be locked in to proprietary
into the second model of governance, which products from a single manufacturer.41 For
has received less attention from historians: the computer networks, open systems such as OSI
function of the ICCB, IAB, and IETF as mecha- and the TCP/IP Internet emerged as alternatives
nisms for engaging and directing the efforts of that could challenge the dominance of IBM
a distributed group of Internet researchers. The and its System Network Architecture. These
Internet user community was small enough in various standards coexisted throughout the late
1979 that the ICCB functioned simultaneous- 1970s and 1980s, as networking executives and
ly as both a “council of elders” and a “grass- engineers developed strategies and organiza-
roots mechanism” for Internet standards.38 By tional structures to facilitate network intercon-
1992, the IAB and Internet Society maintained nection.42 In short, open systems articulated a
the character of the council of elders, responsi- network interconnection strategy that at the
ble for architectural and bureaucratic oversight, same time facilitated a more decentralized
while the IETF, as its name implies, assumed industry structure.
responsibility for the distributed, hands-on OSI dates from 1977, when, according to
tasks involved in the engineering and imple- one of its protagonists, the ISO “recognized the
mentation of protocols and provided a forum special and urgent need for standards for het-
for interested newcomers. erogeneous informatic networks” and formed
The transfer of responsibility for technical a subcommittee to create a Reference Model of
standards from the ICCB to the IAB and then Open Systems Interconnection.43 The goal of
to the IETF demonstrated a strong desire on the this seven-layer OSI Reference Model was not
part of the council of elders to engage and to define the internal operations of networks,
empower the broader community that wanted but only to standardize the external interfaces
to contribute to the further development of the between networks: in other words, to set the
Internet. Under this system, the Internet’s ground rules for network interconnection.44
architectural oversight remained with the During the 1980s and early 1990s, OSI
reconstituted IAB, while the efforts of partici- enjoyed widespread support from national gov-
pants in the IETF were channeled toward the ernments, particularly in Western Europe,
technical aspects of protocol development and North America, and the Far East.45 OSI enjoyed
implementation. this level of support due in part to the strategic
position of its sponsor, ISO. ISO was an “offi-
OSI in Europe and GOSIP in the US cial” international standards body, meaning
This development of TCP/IP networks with- that it was populated by representatives from
in the ICCB, IAB, and IETF occurred while national governments who, in most cases,
other groups developed competing protocol acted on behalf of the interests of their nation-
architectures for computer internetworking. al telecommunications and computer firms.46
Vendors such as IBM and DEC (Digital ISO’s organizational culture—concerned with
Equipment Corporation) offered proprietary defining and controlling the future of infor-
networking solutions that were difficult if not mation and telecommunication services on
impossible to connect to other networks. Both behalf of its representatives from national gov-
July–September 2006 53
‘Rough Consensus and Running Code’
July–September 2006 55
‘Rough Consensus and Running Code’
those who were committed to defending the Internet standards community refer to the
traditions of the IETF. Although most of his “rough consensus and running code” ideal,
presentation was devoted to the pressing tech- Clark’s rejection of alternative forms of deci-
nical and organizational problems within the sion making—kings, presidents, and voting—
Internet standards community, Clark’s memo- reminds us of the close links between network
rable phrase was an attempt to unite the frac- standards and international politics.
tured community by contrasting it to their OSI Throughout the 1970s, 1980s, and 1990s, the
rivals. After their successful campaigns against open and decentralized technical architecture of
the IAB and the CLNP proposal, one can imag- the Internet embodied the technical and orga-
ine IETF engineers leaving the July 1992 meet- nizational values of its design group. Internet
ing with a certain sense of optimism about the architecture and organizations were created at
future of the Internet. the same time, by the same people, as part of an
effort “to unite the community behind a single
Conclusion objective—to focus the effort and guarantee the
By the time National Institute of Standards continued growth of the Internet.”80 As the evi-
and Technology (NIST) abandoned GOSIP in dence in this article demonstrates, defining a
favor of TCP/IP in 1994, the grand future single goal and then uniting the community
planned for OSI was on the rapid decline.78 The behind it was no small feat.
market for network protocols had tipped in These organizational and procedural prob-
favor of TCP/IP, epitomized by the popularity of lems intensified throughout the 1990s, and con-
a new application—the World Wide Web—that tinue to haunt the IETF and IAB—as well as the
was designed to take advantage of the Internet’s broader reaches of information technology stan-
end-to-end architecture.79 The veterans of the dards—today.81 The structure and process of
Internet-OSI standards war were no doubt wiser Internet standards set precedents and influenced
from the experience, but the millions of users the development of subsequent efforts to set
who got on the Internet in the mid-1990s were standards for digital networks in institutional
oblivious to the fact that their new toy was the imitators such as the World Wide Web
product of a protracted international struggle. Consortium, the Global Grid Forum, and, most
For those who read the last issue of Tele- recently, the Voting Systems Performance
communications Policy in 1993, William Drake Rating.82 The Internet standards community not
provided an insightful summary: only introduced technological innovations; it
also pioneered organizational innovations such
The debate is not merely about the comparative as the use of electronic mailing lists to build con-
efficacy of two sets of standards, but it is rather sensus around technical work, a process open to
between two competing visions of how interna- all interested stakeholders, and the free and
tional standardization processes and network unrestricted distribution of standards.
development should be organized and controlled.8 As it embodied a new style of standardiza-
tion, the Internet standards community con-
The religious, political, and military stantly dealt with problems that stemmed from
metaphors that participants used to describe the tension between centralized authority and
the competition between the Internet and OSI grassroots initiatives, as well as the rising influ-
confirm that this was no mere technical dis- ence of commercial values. Since 1992, IETF
pute. At the height of the “religious war” participants in multiple working groups and
between TCP/IP and OSI, tensions within the mailing lists have spent tremendous amounts
IETF and IAB over architecture and organiza- of energy defining formal procedures for the
tional power created a “constitutional crisis.” IETF, to the point that many in the IETF feel
This crisis, a divisive force in a community that that their technical work is suffering from a lack
had always prided itself on its attention to due of attention.83 In light of its history, it seems cer-
process and consensus, forced engineers in the tain that the IETF’s ongoing efforts to refine and
IETF and IAB to examine their core procedural reform its structure and process will dictate the
beliefs. In other words, strains in the technical future success of its standards. Organizational
architecture—the address space—prompted and political conflicts within standards bodies
strains in the organizational architecture. define the terrain within which effective col-
Forged in the face of this crisis, the credo laborations can take place. Standards wars such
“rough consensus and running code” articulat- as the Internet-OSI conflict provide ample
ed a political philosophy, a style of network research opportunities for historians who want
architecture and of engineering. While it is to understand computers, networks, and the
now common to see participants in the people who designed and used them.
July–September 2006 57
‘Rough Consensus and Running Code’
IETF RFC 801, Nov. 1981; [Link] 1462, May 1993; [Link]
rfc/[Link]. [Link].
21. R.E. Kahn, “The Role of the Government in the 31. See B. Leiner et al., “A Brief History of the Inter-
Evolution of the Internet,” Comm. ACM, vol. 37, net”; [Link]
no. 8, 1994, p. 16. Kahn was director of ARPA’s shtml. Since 1989, the number of IETF areas has
Information Processing Techniques Office from shifted between seven and ten.
August 1979 until September 1985. Because Cerf 32. B. Leiner et al., “A Brief History of the Internet”;
left ARPA in October 1982 and Barry Leiner did and R. Kahn, “The Role of the Government,” p.
not replace him until August 1983, Kahn person- 17. For Internet Research Task Force mission and
ally managed the transition to TCP/IP. R.E. Kahn, activities, see [Link]
oral history interview, OH 192, CBI. 33. See S. Bradner, “The Internet Engineering Task
22. V.G. Cerf, oral history interview by J.E. O’Neill, 24 Force,” OnTheInternet, vol. 7, no. 1, 2001, p. 24;
Apr. 1990, OH 191, CBI. and J. Abbate, Inventing the Internet, pp. 207-
23. V. Cerf, “The Internet Activities Board,” IETF RFC 208.
1160, May 1990; [Link] 34. V. Cerf, “IETF and ISOC,” 18 July 1995;
[Link]. [Link]
24. R.E. Kahn oral history interview, OH 192, CBI. l. Kahn also worked to provide institutional sup-
The term “kitchen cabinet” dates from the port for the growth of the Internet when he
administration of President Andrew Jackson, who founded the Corporation for National Research
preferred to consult with an informal group of Initiatives in 1986. See [Link]
advisors—allegedly in the White House kitchen— about_cnri.html.
instead of his formal “Parlor” cabinet. See R.V. 35. B. Leiner et al., “A Brief History of the Internet.”
Remini, Andrew Jackson: The Course of American In a 1993 article, Dave Crocker concurred: “In
Freedom, 1822−1832, Johns Hopkins Univ. Press, general, the IETF is applying its own technical
1998, pp. 315-330. design philosophy to its own operation.” D.
25. V. Cerf, as told to B. Aboba, “How the Internet Crocker, “Making Standards the IETF Way,” Stan-
Came to Be,” The Online User’s Encyclopedia: Bul- dardView, vol. 1, no. 1, 1993, p. 54. The 1968
letin Boards and Beyond, B. Aboba, Addison-Wes- musings of Melvin Conway are also strikingly rel-
ley, 1993. Kahn and Cerf note that the ICCB, evant: “There is a very close relationship between
unlike the IAB and IETF, functioned in a time the structure of a system and the structure of the
where there was very little commercial interest in organization which designed it.” See M.E. Con-
the Internet, no personal computers, and a nas- way, “How Do Committees Invent?” Datamation,
cent networking industry. R.E. Kahn and V.G. vol. 14, no. 4, 1968, p. 30; and “Conway’s Law,”
Cerf, “What Is The Internet (And What Makes It at [Link]
Work),” Dec. 1999; [Link] [Link].
us/what_is_internet.html. 36. A.L. Norberg and J.E. O’Neill, Transforming Com-
26. R.E. Kahn, “The Role of the Government,” p. 16. puter Technology, Johns Hopkins Univ. Press,
27. The acronym “IAB” remained consistent since 1996; and T.P. Hughes, Rescuing Prometheus, Pan-
1984, but the “A”—and the meanings behind theon Books, 1998, pp. 15-68.
it—have changed. From 1984 to 1986, the IAB 37. L. Press, “Seeding Networks: The Federal Role,”
was the Internet Advisory Board; in 1986 its Comm. ACM, vol. 39, no. 10, 1996, pp. 11-18.
name changed to the Internet Activities Board; in 38. The description of the ICCB as a “grass-roots
1992 it changed once again, this time to the mechanism” comes from Kahn, “The Role of the
Internet Architecture Board. See “A Brief History Government,” p. 18.
of the Internet Advisory/Activities/Architecture 39. Various aspects of OSI adoption—too numerous
Board”; [Link] and complex to describe in full in this article—
28. Clark was Internet Architect from 1983 to 1989; permeate Internet history. Although we lack a
Cerf served from 1989 to 1992, and was followed comprehensive historical analysis of the Internet,
by Lyman Chapin (through March 1993). OSI, and other computer internetworking archi-
29. See B. Leiner et al., “A Brief History of the Inter- tectures of the period, three excellent
net”; [Link] comparisons may be found in J. Abbate, Inventing
shtml, and R.E. Kahn, oral history interview, OH the Internet, pp. 147-169; National Research
192, CBI. Task forces or working groups have Council, Global Networks and Local Values: A Com-
been a consistent feature in the history of techni- parative Look at Germany and the United States,
cal standards bodies. See C. Cargill, Open Systems National Academy Press, 2001, pp. 23-45; and T.
Standardization: A Business Approach, Paladin Egyedi, “‘Tension between Standardisation and
Consulting, 1997. Flexibility’ Revisited: A Critique,” Standardisation
30. [Link], “FYI on ‘What is the Internet?’” IETF RFC and Innovation in Information Technology: Conf.
July–September 2006 59
‘Rough Consensus and Running Code’
July–September 2006 61