Internet exchange point

Internet history timeline

Early research and development: 1960–4 (1960–4): RAND networking concepts developed 1962–4 (1962–4): ARPA networking ideas 1965 (1965): NPL network concepts conceived 1966 (1966): Merit Network founded 1967 (1967): ARPANET planning begins 1967 (1967): Symposium on Operating Systems Principles 1969 (1969): NPL followed by the ARPANET carry their first packets 1970 (1970): Network Information Center (NIC) 1971 (1971): Tymnet switched-circuit network 1972 (1972): Merit Network's packet-switched network operational 1972 (1972): Internet Assigned Numbers Authority (IANA) established 1973 (1973): CYCLADES network demonstrated 1973 (1973): PARC Universal Packet development begins 1974 (1974): Transmission Control Program specification published 1975 (1975): Telenet commercial packet-switched network 1976 (1976): X.25 protocol approved and deployed on public data networks 1978 (1978): Minitel introduced 1979 (1979): Internet Activities Board (IAB) 1980 (1980): USENET news using UUCP 1980 (1980): Ethernet standard introduced 1981 (1981): BITNET established Merging the networks and creating the Internet: 1981 (1981): Computer Science Network (CSNET) 1982 (1982): TCP/IP protocol suite formalized 1982 (1982): Simple Mail Transfer Protocol (SMTP) 1983 (1983): Domain Name System (DNS) 1983 (1983): MILNET split off from ARPANET 1984 (1984): OSI Reference Model released 1985 (1985): First .COM domain name registered 1986 (1986): NSFNET with 56 kbit/s links 1986 (1986): Internet Engineering Task Force (IETF) 1987 (1987): UUNET founded 1988 (1988): NSFNET upgraded to 1.5 Mbit/s (T1) 1988 (1988): Morris worm 1988 (1988): Complete Internet protocol suite 1989 (1989): Border Gateway Protocol (BGP) 1989 (1989): PSINet founded, allows commercial traffic 1989 (1989): Federal Internet Exchanges (FIX East|FIXes) 1990 (1990): GOSIP (without TCP/IP) 1990 (1990): ARPANET decommissioned 1990 (1990): Advanced Network and Services (ANS) 1990 (1990): UUNET/Alternet allows commercial traffic 1990 (1990): Archie search engine 1991 (1991): Wide area information server (WAIS) 1991 (1991): Gopher 1991 (1991): Commercial Internet eXchange (CIX) 1991 (1991): ANS CO+RE allows commercial traffic 1991 (1991): World Wide Web (WWW) 1992 (1992): NSFNET upgraded to 45 Mbit/s (T3) 1992 (1992): Internet Society (ISOC) established 1993 (1993): Classless Inter-Domain Routing (CIDR) 1993 (1993): InterNIC established 1993 (1993): AOL added USENET access 1993 (1993): Mosaic web browser released 1994 (1994): Full text web search engines 1994 (1994): North American Network Operators' Group (NANOG) established Commercialization, privatization, broader access leads to the modern Internet: 1995 (1995): New Internet architecture with commercial ISPs connected at NAPs 1995 (1995): NSFNET decommissioned 1995 (1995): GOSIP updated to allow TCP/IP 1995 (1995): very high-speed Backbone Network Service (vBNS) 1995 (1995): IPv6 proposed 1996 (1996): AOL changes pricing model from hourly to monthly 1998 (1998): Internet Corporation for Assigned Names and Numbers (ICANN) 1999 (1999): IEEE 802.11b wireless networking 1999 (1999): Internet2/Abilene Network 1999 (1999): vBNS+ allows broader access 2000 (2000): Dot-com bubble bursts 2001 (2001): New top-level domain names activated 2001 (2001): Code Red I, Code Red II, and Nimda worms 2003 (2003): UN World Summit on the Information Society (WSIS) phase I 2003 (2003): National LambdaRail founded 2004 (2004): UN Working Group on Internet Governance (WGIG) 2005 (2005): UN WSIS phase II 2006 (2006): First meeting of the Internet Governance Forum 2010 (2010): First internationalized country code top-level domains registered 2012 (2012): ICANN begins accepting applications for new generic top-level domain names 2013 (2013): Montevideo Statement on the Future of Internet Cooperation 2014 (2014): NetMundial international Internet governance proposal 2016 (2016): ICANN contract with U.S. Dept. of Commerce ends, IANA oversight passes to the global Internet community on October 1st Examples of Internet services: 1989 (1989): AOL dial-up service provider, email, instant messaging, and web browser 1990 (1990): IMDb Internet movie database 1994 (1994): Yahoo! web directory 1995 (1995): Amazon online retailer 1995 (1995): eBay online auction and shopping 1995 (1995): Craigslist classified advertisements 1995 (1995): AltaVista search engine 1996 (1996): Outlook (formerly Hotmail) free web-based e-mail 1996 (1996): RankDex search engine 1997 (1997): Google Search 1997 (1997): Babel Fish automatic translation 1998 (1998): Yahoo Groups (formerly Yahoo! Clubs) 1998 (1998): PayPal Internet payment system 1998 (1998): Rotten Tomatoes review aggregator 1999 (1999): 2ch Anonymous textboard 1999 (1999): i-mode mobile internet service 1999 (1999): Napster peer-to-peer file sharing 2000 (2000): Baidu search engine 2001 (2001): 2chan Anonymous imageboard 2001 (2001): BitTorrent peer-to-peer file sharing 2001 (2001): Wikipedia, the free encyclopedia 2003 (2003): LinkedIn business networking 2003 (2003): Myspace social networking site 2003 (2003): Skype Internet voice calls 2003 (2003): iTunes Store 2003 (2003): 4chan Anonymous imageboard 2003 (2003): The Pirate Bay, torrent file host 2004 (2004): Facebook social networking site 2004 (2004): Podcast media file series 2004 (2004): Flickr image hosting 2005 (2005): YouTube video sharing 2005 (2005): Reddit link voting 2005 (2005): Google Earth virtual globe 2006 (2006): Twitter microblogging 2007 (2007): WikiLeaks anonymous news and information leaks 2007 (2007): Google Street View 2007 (2007): Kindle, e-reader and virtual bookshop 2008 (2008): Amazon Elastic Compute Cloud (EC2) 2008 (2008): Dropbox cloud-based file hosting 2008 (2008): Encyclopedia of Life, a collaborative encyclopedia intended to document all living species 2008 (2008): Spotify, a DRM-based music streaming service 2009 (2009): Bing search engine 2009 (2009): Google Docs, Web-based word processor, spreadsheet, presentation, form, and data storage service 2009 (2009): Kickstarter, a threshold pledge system 2009 (2009): Bitcoin, a digital currency 2010 (2010): Instagram, photo sharing and social networking 2011 (2011): Google+, social networking 2011 (2011): Snapchat, photo sharing 2012 (2012): Coursera, massive open online courses 2016 (2016): TikTok, video sharing and social networking

Internet exchange points (IXes or IXPs) are common grounds of IP networking, allowing participant Internet service providers (ISPs) to exchange data destined for their respective networks. IXPs are generally located at places with preexisting connections to multiple distinct networks, i.e., datacenters, and operate physical infrastructure (switches) to connect their participants. Organizationally, most IXPs are each independent not-for-profit associations of their constituent participating networks (that is, the set of ISPs that participate in that IXP). The primary alternative to IXPs is private peering, where ISPs directly connect their networks.

IXPs reduce the portion of an ISP's traffic that must be delivered via their upstream transit providers, thereby reducing the average per-bit delivery cost of their service. Furthermore, the increased number of paths available through the IXP improves routing efficiency (by allowing routers to select shorter paths) and fault-tolerance. IXPs exhibit the characteristics of the network effect.

History

NSFNet Internet architecture, c. 1995

Internet exchange points began as Network Access Points or NAPs, a key component of Al Gore's National Information Infrastructure (NII) plan, which defined the transition from the US Government-paid-for NSFNET era (when Internet access was government sponsored and commercial traffic was prohibited) to the commercial Internet of today. The four Network Access Points (NAPs) were defined as transitional data communications facilities at which Network Service Providers (NSPs) would exchange traffic, in replacement of the publicly financed NSFNET Internet backbone. The National Science Foundation let contracts supporting the four NAPs, one to MFS Datanet for the preexisting MAE-East in Washington, D.C., and three others to Sprint, Ameritech, and Pacific Bell, for new facilities of various designs and technologies, in New York (actually Pennsauken, New Jersey), Chicago, and California, respectively. As a transitional strategy, they were effective, providing a bridge from the Internet's beginnings as a government-funded academic experiment, to the modern Internet of many private-sector competitors collaborating to form a network-of-networks, transporting Internet bandwidth from its points-of-production at Internet exchange points to its sites-of-consumption at users' locations.

This transition was particularly timely, coming hard on the heels of the ANS CO+RE controversy, which had disturbed the nascent industry, led to congressional hearings, resulted in a law allowing NSF to promote and use networks that carry commercial traffic, prompted a review of the administration of NSFNET by the NSF's Inspector General (no serious problems were found), and caused commercial operators to realize that they needed to be able to communicate with each other independent of third parties or at neutral exchange points.

Although the three telco-operated NAPs faded into obscurity relatively quickly after the expiration of the federal subsidies, MAE-East, thrived for fifteen more years, and its west-coast counterpart MAE-West continued for more than twenty years.

Today, the phrase "Network Access Point" is of historical interest only, since the four transitional NAPs disappeared long ago, replaced by hundreds of modern Internet exchange points, though in Spanish-speaking Latin America, the phrase lives on to a small degree, among those who conflate the NAPs with IXPs.

Function

Initial location of the London Internet Exchange (LINX): Telehouse Docklands

The primary purpose of an IXP is to allow networks to interconnect directly, via the exchange, rather than going through one or more third-party networks. The primary advantages of direct interconnection are cost, latency, and bandwidth.

Traffic passing through an exchange is typically not billed by any party, whereas traffic to an ISP's upstream provider is. The direct interconnection, often located in the same city as both networks, avoids the need for data to travel to other cities—and potentially on other continents—to get from one network to another, thus reducing latency.

The third advantage, speed, is most noticeable in areas that have poorly developed long-distance connections. ISPs in regions with poor connections might have to pay between 10 or 100 times more for data transport than ISPs in North America, Europe, or Japan. Therefore, these ISPs typically have slower, more limited connections to the rest of the Internet. However, a connection to a local IXP may allow them to transfer data without limit, and without cost, vastly improving the bandwidth between customers of such adjacent ISPs.

Internet Exchange Points (IXPs) are public locations where several networks are connected to each other. Public peering is done at IXPs, while private peering can be done with direct links between networks.

Operations

A 19-inch rack used for switches at the DE-CIX in Frankfurt, Germany

Technical operations

A typical IXP consists of one or more network switches, to which each of the participating ISPs connect. Prior to the existence of switches, IXPs typically employed fiber-optic inter-repeater link (FOIRL) hubs or Fiber Distributed Data Interface (FDDI) rings, migrating to Ethernet and FDDI switches as those became available in 1993 and 1994.

Asynchronous Transfer Mode (ATM) switches were briefly used at a few IXPs in the late 1990s, accounting for approximately 4% of the market at their peak, and there was an attempt by Stockholm-based IXP NetNod to use SRP/DPT, but Ethernet has prevailed, accounting for more than 95% of all existing Internet exchange switch fabrics. All Ethernet port speeds are to be found at modern IXPs, ranging from 10 Mb/second ports in use in small developing-country IXPs, to ganged 10 Gb/second ports in major centers like Seoul, New York, London, Frankfurt, Amsterdam, and Palo Alto. Ports with 100 Gb/second are available, for example, at the AMS-IX in Amsterdam and at the DE-CIX in Frankfurt.

An optical fiber patch panel at the Amsterdam Internet Exchange

Business operations

The principal business and governance models for IXPs include:

• Not-for-profit association (usually of the participating ISPs)
• Operator-neutral for-profit company (usually the operator of a datacenter hosting the IXP)
• University
• Government agency (often the communications ministry or regulator, at national scale, or municipal government, at local scale)
• Unincorporated informal association of networks (defined by an open-ended multi-party contract, without independent legal existence)

The technical and business logistics of traffic exchange between ISPs is governed by bilateral or multilateral peering agreements. Under such agreements, traffic is exchanged without compensation. When an IXP incurs operating costs, they are typically shared among all of its participants.

At the more expensive exchanges, participants pay a monthly or annual fee, usually determined by the speed of the port or ports which they are using. Fees based on the volume of traffic are less common because they provide a counterincentive to the growth of the exchange. Some exchanges charge a setup fee to offset the costs of the switch port and any media adaptors (gigabit interface converters, small form-factor pluggable transceivers, XFP transceivers, XENPAKs, etc.) that the new participant requires.

Traffic exchange

Diagram of the Layer 1 (physical) and Layer 2 (Data Link) topology of an Internet exchange point (IXP)

Diagram of the Layer 3 (network) topology of an Internet exchange point (IXP)

Internet traffic exchange between two participants on an IXP is facilitated by Border Gateway Protocol (BGP) routing configurations between them. They choose to announce routes via the peering relationship – either routes to their own addresses or routes to addresses of other ISPs that they connect to, possibly via other mechanisms. The other party to the peering can then apply route filtering, where it chooses to accept those routes, and route traffic accordingly, or to ignore those routes, and use other routes to reach those addresses.

In many cases, an ISP will have both a direct link to another ISP and accept a route (normally ignored) to the other ISP through the IXP; if the direct link fails, traffic will then start flowing over the IXP. In this way, the IXP acts as a backup link.

When these conditions are met, and a contractual structure exists to create a market to purchase network services, the IXP is sometimes called a "transit exchange". The Vancouver Transit Exchange, for example, is described as a "shopping mall" of service providers at one central location, making it easy to switch providers, "as simple as getting a VLAN to a new provider". The VTE is run by BCNET, a public entity.

Advocates of green broadband schemes and more competitive telecommunications services often advocate aggressive expansion of transit exchanges into every municipal area network so that competing service providers can place such equipment as video on demand hosts and PSTN switches to serve existing phone equipment, without being answerable to any monopoly incumbent.

Since the dissolution of the Internet backbone and transition to the IXP system in 1992, the measurement of Internet traffic exchanged at IXPs has been the primary source of data about Internet bandwidth production: how it grows over time and where it is produced. Standardized measures of bandwidth production have been in place since 1996 and have been refined over time.

See also

• Historical IXPs
  • MAE-East and MAE-West
  • Commercial Internet eXchange (CIX)
  • Federal Internet Exchange (FIX)
• Associations of Internet exchange point operators:
  • Euro-IX, the European Internet Exchange Association
  • APIX, the Asia Pacific Internet Exchange Association
  • LAC-IX, the Latin America & Caribbean Internet Exchange Association
  • Af-IX, the African IXP Association
• Route server
• Internet service provider
• Data center
• Packet Clearing House
• List of Internet exchange points
• Peering

External links

• European Internet Exchange Association
• Internet Exchange Directory maintained by Packet Clearing House
• Internet Exchange Points from Data Center Map
• PeeringDB
• Lookin'Glass.Org BGP Looking Glass services at IX's.