Terabit Ethernet: Difference between revisions
JeffMorriss (talk | contribs) →400G port types: Set ref names on recent MSA specs. |
JeffMorriss (talk | contribs) →400G port types: Say "MSA" in the Standard column - to make it easier to differentiate IEEE vs. MSA vs. truly proprietary (vendor-specific) |
||
Line 405: | Line 405: | ||
| style="background-color:yellow" | {{nowrap|OSx: 6000}} |
| style="background-color:yellow" | {{nowrap|OSx: 6000}} |
||
|- |
|- |
||
| 400GBASE-LR4-10<br> |
| 400GBASE-LR4-10<br> |
||
| {{partial|''proprietary<br /><small>( |
| {{partial|''proprietary<br /><small>([[Multi-source_agreement|MSA]], Sept 2020)</small>''}} |
||
| style="background-color:yellow" | {{nowrap|OSx: 10000}} |
| style="background-color:yellow" | {{nowrap|OSx: 10000}} |
||
| Multi-Vendor Standard<ref name="400G-LR4-10-Spec">{{cite web |last1=Nowell |first1=Mark |title=400G-LR4-10 Technical Specification |url=http://100glambda.com/specifications/summary/2-specifications/10-400g-lr4-10-technical-spec-rev1-0 |website=100glambda.com |publisher=100G Lambda MSA Group |access-date=26 May 2021}}</ref> |
| Multi-Vendor Standard<ref name="400G-LR4-10-Spec">{{cite web |last1=Nowell |first1=Mark |title=400G-LR4-10 Technical Specification |url=http://100glambda.com/specifications/summary/2-specifications/10-400g-lr4-10-technical-spec-rev1-0 |website=100glambda.com |publisher=100G Lambda MSA Group |access-date=26 May 2021}}</ref> |
Revision as of 14:42, 26 May 2021
Terabit Ethernet or TbE is Ethernet with speeds above 100 Gbit/s. 400 Gigabit Ethernet (400G, 400GbE) and 200 Gigabit Ethernet (200G, 200GbE)[1] standards developed by the IEEE P802.3bs Task Force using broadly similar technology to 100 Gigabit Ethernet[2][3] were approved on December 6, 2017.[4][5] In 2016, several networking equipment suppliers were already offering proprietary solutions for 200G and 400G.[5]
The Ethernet Alliance's 2020 technology roadmap expects speeds of 800 Gbit/s and 1.6 Tbit/s become IEEE standard after 2020, possibly between 2023 and 2025.[6][7] Doubling to 800 GbE is expected to occur after 112 Gbit/s SerDes become available. The Optical Internetworking Forum (OIF) has already announced five new projects at 112 Gbit/s which would also make 4th generation (single-lane) 100 GbE links possible.[8]
History
Facebook and Google, among other companies, have expressed a need for TbE.[9] While a speed of 400 Gbit/s is achievable with existing technology, 1 Tbit/s (1000 Gbit/s) would require different technology.[2][10] Accordingly, at the IEEE Industry Connections Higher Speed Ethernet Consensus group meeting in September 2012, 400 GbE was chosen as the next generation goal.[2] Additional 200GbE objectives were added in January 2016.
The University of California, Santa Barbara (UCSB) attracted help from Agilent Technologies, Google, Intel, Rockwell Collins, and Verizon Communications to help with research into next generation Ethernet.[11]
As of early 2016, chassis/modular based core router platforms from Cisco, Juniper and other major manufacturers support 400 Gbit/s full duplex data rates per slot. One, two and four port 100GbE and one port 400GbE line cards are presently available. As of early 2019, 200GbE line cards became available after 802.3cd standard ratification.[12][13]
200G Ethernet uses PAM4 signaling which allows 2 bits to be transmitted per clock cycle, but at a higher implementation cost.[14]
Standards development
The IEEE formed the "IEEE 802.3 Industry Connections Ethernet Bandwidth Assessment Ad Hoc", to investigate the business needs for short and long term bandwidth requirements.[15][16][17]
IEEE 802.3's "400 Gb/s Ethernet Study Group" started working on the 400 Gbit/s generation standard in March 2013.[18] Results from the study group were published and approved on March 27, 2014. Subsequently, the IEEE 802.3bs Task Force[19] started working to provide physical layer specifications for several link distances.[20]
The IEEE 802.3bs standard was approved on December 6, 2017[4] and is available online.[21]
The IEEE 802.3cd standard was approved on December 5, 2018.
The IEEE 802.3cn standard was approved on December 20, 2019.
The IEEE 802.3cm standard was approved on January 30, 2020.
The IEEE 802.3cu standard was approved on February 11, 2021.
IEEE project objectives
Like all speeds since 10 Gigabit Ethernet, the standards support only full-duplex operation. Other objectives include:[20]
- Support MAC data rates of 400 Gbit/s and 200 Gbit/s[1]
- Preserve the Ethernet frame format utilizing the Ethernet MAC
- Preserve minimum and maximum frame size of current Ethernet standard
- Support a bit error ratio (BER) of 10−13, which is an improvement over the 10−12 BER that was specified for 10GbE, 40GbE, and 100GbE.
- Support for OTN (transport of Ethernet across optical transport networks), and optional support for Energy-Efficient Ethernet (EEE).
802.3bs project
Define physical layer specifications supporting:[20]
- 400 Gbit/s Ethernet
- at least 100 m over multi-mode fiber (400GBASE-SR16) using sixteen parallel strands of fiber each at 25 Gbit/s[22][23]
- at least 500 m over single-mode fiber (400GBASE-DR4) using four parallel strands of fiber each at 100 Gbit/s[24][25]
- at least 2 km over single-mode fiber (400GBASE-FR8) using eight parallel wavelengths (CWDM) each at 50 Gbit/s[24][26][27]
- at least 10 km over single-mode fiber (400GBASE-LR8) using eight parallel wavelengths (CWDM) each at 50 Gbit/s[24][27][28]
- eight and sixteen lane chip-to-chip/chip-to-module electrical interfaces (400GAUI-8 and 400GAUI-16)
- 200 Gbit/s Ethernet
- at least 500 m over single-mode fiber (200GBASE-DR4) using four parallel strands of fiber each at 50 Gbit/s[29][30]
- at least 2 km over single-mode fiber (200GBASE-FR4) using four parallel wavelengths (CWDM) each at 50 Gbit/s[1][30]
- at least 10 km over single-mode fiber (200GBASE-LR4) using four parallel wavelengths (CWDM) each at 50 Gbit/s[1][30]
- four and eight lane chip-to-chip/chip-to-module electrical interfaces (200GAUI-4 and 200GAUI-8)
802.3cd project
- Define four-lane 200 Gbit/s PHYs for operation over:
- copper twin-axial cables with lengths up to at least 3 m (200GBASE-CR4).
- printed circuit board backplane with a total channel insertion loss of ≤ 30 dB at 13.28125 GHz (200GBASE-KR4).
- Define 200 Gbit/s PHYs for operation over MMF with lengths up to at least 100 m (200GBASE-SR4).
802.3ck project
- 200 Gbit/s Ethernet
- Define a two-lane 200 Gbit/s Attachment Unit interface (AUI) for chip-to-module applications, compatible with PMDs based on 100 Gbit/s per lane optical signaling (200GAUI-2 C2M)
- Define a two-lane 200 Gbit/s Attachment Unit Interface (AUI) for chip-to-chip applications (200GAUI-2 C2C)
- Define a two-lane 200 Gbit/s PHY for operation over electrical backplanes an insertion loss ≤ 28 dB at 26.56 GHz (200GBASE-KR2)
- Define a two-lane 200 Gbit/s PHY for operation over twin axial copper cables with lengths up to at least 2 m (200GBASE-CR2)
- 400 Gbit/s Ethernet
- Define a four-lane 400 Gbit/s Attachment Unit interface (AUI) for chip-to-module applications, compatible with PMDs based on 100 Gbit/s per lane optical signaling (400GAUI-4 C2M)
- Define a four-lane 400 Gbit/s Attachment Unit Interface (AUI) for chip-to-chip applications (400GAUI-4 C2C)
- Define a four-lane 400 Gbit/s PHY for operation over electrical backplanes an insertion loss ≤ 28 dB at 26.56 GHz (400GBASE-KR4)
- Define a four-lane 400 Gbit/s PHY for operation over twin axial copper cables with lengths up to at least 2 m (400GBASE-CR4)
802.3cm project
- 400 Gbit/s Ethernet
- Define a physical layer specification supporting 400 Gbit/s operation over 8 pairs of MMF with lengths up to at least 100 m (400GBASE-SR8)
- Define a physical layer specification supporting 400 Gbit/s operation over 4 pairs of MMF with lengths up to at least 100 m (400GBASE-SR4.2)
802.3cn project
- 200 Gbit/s Ethernet
- Provide a physical layer specification supporting 200 Gbit/s operation over four wavelengths capable of at least 40 km of SMF (200GBASE-ER4) [31]
- 400 Gbit/s Ethernet
- Provide a physical layer specification supporting 400 Gbit/s operation over eight wavelengths capable of at least 40 km of SMF (400GBASE-ER8)[31]
802.3cu project
- Define a four-wavelength 400 Gbit/s PHY for operation over SMF with lengths up to at least 2 km (400GBASE-FR4)
- Define a four-wavelength 400 Gbit/s PHY for operation over SMF with lengths up to at least 6 km (400GBASE-LR4-6) [32]
802.3cw project
- Provide a physical layer specification supporting 400 Gbit/s operation on a single wavelength capable of at least 80 km over a DWDM system (400GBASE-ZR) (using dual polarization 16-state quadrature amplitude modulation (DP-16QAM) with coherent detection) [33]
802.3db project
- Define a physical layer specification that supports 200 Gbit/s operation over 2 pairs of MMF with lengths up to at least 50 m
- Define a physical layer specification that supports 400 Gbit/s operation over 4 pairs of MMF with lengths up to at least 50 m [34]
200G port types
Fibre type | Introduced | Performance |
---|---|---|
MMF FDDI 62.5/125 µm | 1987 | 160 MHz·km @ 850 nm |
MMF OM1 62.5/125 µm | 1989 | 200 MHz·km @ 850 nm |
MMF OM2 50/125 µm | 1998 | 500 MHz·km @ 850 nm |
MMF OM3 50/125 µm | 2003 | 1500 MHz·km @ 850 nm |
MMF OM4 50/125 µm | 2008 | 3500 MHz·km @ 850 nm |
MMF OM5 50/125 µm | 2016 | 3500 MHz·km @ 850 nm + 1850 MHz·km @ 950 nm |
SMF OS1 9/125 µm | 1998 | 1.0 dB/km @ 1300/1550 nm |
SMF OS2 9/125 µm | 2000 | 0.4 dB/km @ 1300/1550 nm |
Name | Standard | Media | OFC or RFC | Reach in m |
# Media (⇆) |
# Lambdas (→) |
# Lanes (→) |
Gigabaud per lane |
Notes |
---|---|---|---|---|---|---|---|---|---|
200GBASE-CR2 | 802.3ck (cl162) |
twinaxial copper cable | QSFP112 | 2 | 4 | N/A | 2 | 53.125 (PAM4) | |
200GBASE-KR2 | 802.3ck (cl163) |
Cu backplane | — | 53.125 (PAM4) | Insertion loss ≤ 28 dB at 26.56 GHz | ||||
200GBASE-CR4 | 802.3cd (cl136) |
twinaxial copper cable | QSFP56 | 3 | 8 | N/A | 4 | 26.5625 (PAM4) | |
200GBASE-KR4 | 802.3cd (cl137) |
Cu backplane | — | 26.5625 (PAM4) | Insertion loss of ≤ 30 dB at 13.28125 GHz | ||||
200GAUI-8 | 802.3bs (cl 120B/C) |
Chip-to-module/ Chip-to-chip interface |
— | 0.25 | 16 | N/A | 8 | 26.5625 (NRZ) | |
200GAUI-4 | 802.3bs (cl 120D/E) |
8 | N/A | 4 | 26.5625 (PAM4) | ||||
200GAUI-2 | 802.3ck (cl 120F/G) |
4 | N/A | 2 | 53.125 (PAM4) | ||||
200GBASE-SR4 | 802.3cd (cl138) |
Fiber 850 nm |
MPO/MTP (MPO-12) |
OM3: 70 | 8 | 1 | 4 | 26.5625 (PAM4) | |
OM4: 100 | |||||||||
200GBASE-DR4 | 802.3bs (cl121) |
Fiber 1304.5 - 1317.5 nm |
MPO/MTP (MPO-12) |
OSx: 500 | 26.5625 (PAM4) | ||||
200GBASE-FR4 | 802.3bs (cl122) |
Fiber 1271−1331 nm |
LC | OSx: 2000 | 2 | 4 | 4 | 26.5625 (PAM4) | |
200GBASE-LR4 | 802.3bs (cl122) |
Fiber 1295−1309 nm[36] |
OSx: 10000 | 26.5625 (PAM4) | |||||
200GBASE-ER4 | 802.3cn (cl122) |
OSx: 40000 | 26.5625 (PAM4) |
400G port types
Fibre type | Introduced | Performance |
---|---|---|
MMF FDDI 62.5/125 µm | 1987 | 160 MHz·km @ 850 nm |
MMF OM1 62.5/125 µm | 1989 | 200 MHz·km @ 850 nm |
MMF OM2 50/125 µm | 1998 | 500 MHz·km @ 850 nm |
MMF OM3 50/125 µm | 2003 | 1500 MHz·km @ 850 nm |
MMF OM4 50/125 µm | 2008 | 3500 MHz·km @ 850 nm |
MMF OM5 50/125 µm | 2016 | 3500 MHz·km @ 850 nm + 1850 MHz·km @ 950 nm |
SMF OS1 9/125 µm | 1998 | 1.0 dB/km @ 1300/1550 nm |
SMF OS2 9/125 µm | 2000 | 0.4 dB/km @ 1300/1550 nm |
Name | Standard | Media | OFC or RFC | Reach in m |
# Media (⇆) |
# Lambdas (→) |
# Lanes (→) |
Gigabaud per lane |
Notes |
---|---|---|---|---|---|---|---|---|---|
400GBASE-CR4 | 802.3ck (cl162) |
twinaxial copper cable | QSFPDD | 2 | 8 | N/A | 4 | 53.125 (PAM4) | |
400GBASE-KR4 | 802.3ck (cl163) |
Cu backplane | — | 8 | N/A | 4 | 53.125 (PAM4) | Insertion loss ≤ 28 dB at 26.56 GHz | |
400GAUI-16 | 802.3bs (cl 120B/C) |
Chip-to-module/ Chip-to-chip interface |
— | 0.25 | 32 | N/A | 16 | 26.5625 (NRZ) | |
400GAUI-8 | 802.3bs (cl 120D/E) |
16 | N/A | 8 | 26.5625 (PAM4) | ||||
400GAUI-4 | 802.3ck (cl 120F/G) |
8 | N/A | 4 | 53.125 (PAM4) | ||||
400GBASE-SR16 | 802.3bs (cl 123) |
Fiber 850 nm |
MPO/MTP (MPO-32) |
OM3: 70 | 32 | 1 | 16 | 26.5625 (NRZ) | |
OM4: 100 | |||||||||
OM5: 100 | |||||||||
400GBASE-SR8 | 802.3cm (cl 138) |
MPO/MTP (MPO-16) |
OM3: 70 | 16 | 1 | 8 | 26.5625 (PAM4) | ||
OM4: 100 | |||||||||
OM5: 100 | |||||||||
400GBASE-SR4.2 (Bidirectional) |
802.3cm (cl 150) |
Fiber 850 nm 912 nm |
MPO/MTP (MPO-12) |
OM3: 70 | 8 | 2 | 8 | 26.5625 (PAM4) | Uses bidirectional (on 2 lambdas) wavelength-division duplexing |
OM4: 100 | |||||||||
OM5: 150 | |||||||||
400GBASE-FR8 | 802.3bs (cl 122) |
Fiber 1273−1309 nm[37] |
LC | OSx: 2000 | 2 | 8 | 8 | 26.5625 (PAM4) | |
400GBASE-LR8 | 802.3bs (cl 122) |
OSx: 10000 | 26.5625 (PAM4) | ||||||
400GBASE-ER8 | 802.3cn (cl 122) |
OSx: 40000 | 26.5625 (PAM4) | ||||||
400GBASE-DR4 | 802.3bs (cl 124) |
Fiber 1304.5 - 1317.5 nm |
MPO/MTP (MPO-12) |
OSx: 500 | 8 | 1 | 4 | 53.125 (PAM4) | |
400GBASE-XDR4 | proprietary (non IEEE) |
OSx: 2000 | |||||||
400GBASE-FR4 | 802.3cu (cl 151) |
Fiber 1271−1331 nm |
LC | OSx: 2000 | 2 | 4 | 4 | 53.125 (PAM4) | Multi-Vendor Standard [38] |
400GBASE-LR4-6 | 802.3cu (cl 151) |
OSx: 6000 | |||||||
400GBASE-LR4-10 |
proprietary (MSA, Sept 2020) |
OSx: 10000 | Multi-Vendor Standard[39] | ||||||
400GBASE-ZR | 802.3cw (cl 155/156) |
Fiber | LC | OSx: 80000 | 2 | 1 | 2 | 59.84375 (DP-16QAM) |
See also
- Ethernet Alliance
- Interconnect bottleneck
- Optical fiber cable
- Optical communication
- Parallel optical interface
References
- ^ a b c d "IEEE 802.3 NGOATH SG Adopted Changes to 802.3bs Project Objectives" (PDF).
- ^ a b c "Network boffins say Terabit Ethernet is TOO FAST: Sticking to 400Gb for now".
- ^ On-board optics: beyond pluggables
- ^ a b "[STDS-802-3-400G] IEEE P802.3bs Approved!". IEEE 802.3bs Task Force. Retrieved 2017-12-14.
- ^ a b "High-Speed Transmission Update: 200G/400G". 2016-07-18.
- ^ "The 2020 Ethernet Roadmap". Ethernet Alliance.
- ^ Jain, P. C. (2016). "Recent trends in next generation terabit Ethernet and gigabit wireless local area network". 2016 International Conference on Signal Processing and Communication (ICSC). IEEE. pp. 106–110. doi:10.1109/ICSPCom.2016.7980557. ISBN 978-1-5090-2684-5. S2CID 25506683.
- ^ "OIF Launches CEI-112G Project for 100G Serial Electrical Links". Businesswire. 30 Aug 2016.
- ^ Feldman, Michael (February 3, 2010). "Facebook Dreams of Terabit Ethernet". HPCwire. Tabor Communications, Inc.
- ^ Matsumoto, Craig (March 5, 2010). "Dare We Aim for Terabit Ethernet?". Light Reading. UBM TechWeb.
- ^ Craig Matsumoto (October 26, 2010). "The Terabit Ethernet Chase Begins". Light Reading. Retrieved December 15, 2011.
- ^ "Cisco 4 x 100 Gbit/s interface".
- ^ "Alcatel-Lucent boosts operator capacity to deliver big data and video over existing networks with launch of 400G IP router interface".
- ^ Smith, Ryan. "Micron Spills on GDDR6X: PAM4 Signaling For Higher Rates, Coming to NVIDIA's RTX 3090". www.anandtech.com.
- ^ Stephen Lawson (May 9, 2011). "IEEE Seeks Data on Ethernet Bandwidth Needs". PC World. Retrieved May 23, 2013.
- ^ "IEEE Industry Connections Ethernet Bandwidth Assessment" (PDF). IEEE 802.3 Ethernet Working Group. July 19, 2012. Retrieved 2015-03-01.
- ^ Max Burkhalter Brafton (May 12, 2011). "Terabit Ethernet could be on its way". Perle. Retrieved December 15, 2011.
- ^ "400 Gb/s Ethernet Study Group". Group web site. IEEE 802.3. Retrieved May 23, 2013.
- ^ IEEE 802.3bs Task Force
- ^ a b c "Objectives" (PDF). IEEE 802.3bs Task Force. Mar 2014. Retrieved 2015-03-01.
- ^ "P802.3bs - IEEE Standard for Ethernet Amendment: Media Access Control Parameters, Physical Layers and Management Parameters for 200 Gb/s and 400 Gb/s Operation". IEEE 802.3bs Task Force. Retrieved 2017-12-14.
- ^ 100 m MMF draft proposal
- ^ "400GBase-SR16 draft specifications" (PDF).
- ^ a b c IEEE 802.3 Ethernet Working Group Liaison letter to ITU-T Questions 6/15 and 11/15
- ^ 400G-PSM4: A Proposal for the 500 m Objective using 100 Gbit/s per Lane Signaling
- ^ 400Gb/s 8x50G PAM4 WDM 2km SMF PMD Baseline Specifications
- ^ a b Baseline Proposal for 8 x 50G NRZ for 400GbE 2 km and 10 km PMD
- ^ "400 GbE technical draft specifications" (PDF).
- ^ IEEE 802.3 NGOATH SG Adopted Changes to 802.3bs Project Objectives Updated by IEEE 802.3 NGOATH Study Group, Mar 16, 2016, IEEE 802 Mar 2016 Plenary, Macau, China.
- ^ a b c IEEE 802.3bs 200/400 Gb/s Ethernet (Standards Informant)
- ^ a b http://www.ieee802.org/3/cn/proj_doc/3cn_Objectives_181113.pdf
- ^ https://www.ieee802.org/3/cu/Objectives_Approved_Sept_2019.pdf
- ^ http://www.ieee802.org/3/cw/proj_doc/3cw_Objectives_190911.pdf
- ^ http://www.ieee802.org/3/db/P802d3db_Objectives_Approved_May_2020.pdf
- ^ a b Charles E. Spurgeon (2014). Ethernet: The Definitive Guide (2nd ed.). O'Reilly Media. ISBN 978-1-4493-6184-6.
- ^ 1295.5595/1300.0540/1304.5799/1309.1374 nm (229.0/229.8/230.6/231.4 THz)
- ^ 1273.5449/1277.8877/1282.2603/1286.6629 + 1295.5595/1300.0540/1304.5799/1309.1374 nm (229.0/229.8/230.6/231.4 + 233.0/233.8/234.6/235.4 THz)
- ^ Nowell, Mark. "400G-FR4 Technical Specification". 100glambda.com. 100G Lambda MSA Group. Retrieved 26 May 2021.
- ^ Nowell, Mark. "400G-LR4-10 Technical Specification". 100glambda.com. 100G Lambda MSA Group. Retrieved 26 May 2021.
Further reading
- Chris Jablonski. "Researchers to develop 1 Terabit Ethernet by 2015". ZD Net. Retrieved October 9, 2011.
- Iljitsch van Beijnum (August 2011). "Speed matters: how Ethernet went from 3 Mbps to 100 Gbps... and beyond". Ars Technica. Retrieved October 9, 2011.
- Rick Merritt (May 9, 2011). "IEEE Looks beyond 100G Ethernet". The Cutting Edge. Retrieved October 9, 2011.
- Stephen Lawson (February 2, 2010). "Facebook Sees Need for Terabit Ethernet". PC World. Retrieved December 15, 2011.
- IEEE Reports
- "100 gigabit Ethernet and beyond". IEEE Optical Communications : Design, Technologies, and Applications. March 2010. doi:10.1109/MCOM.2010.5434372. ISSN 0163-6804.
- Elby, Stuart (July 2011). "The drive towards Terabit Ethernet". 2011 IEEE Photonics Society Summer Topical Meeting Series. pp. 104–105. doi:10.1109/PHOSST.2011.6000067. ISBN 978-1-4244-5730-4. S2CID 9077455.
- Detwiler, Thomas; Stark, Andrew; Basch, Bert; Ralph, Stephen E. (July 2011). "DQPSK for Terabit Ethernet in the 1310 nm band". 2011 IEEE Photonics Society Summer Topical Meeting Series. pp. 143–144. doi:10.1109/PHOSST.2011.6000087. ISBN 978-1-4244-5730-4. S2CID 44199212.
External links
- West, John (April 3, 2009). "Terabit Ethernet on the way". insideHPC.
- Mellor, Chris (February 15, 2009). "Terabit Ethernet possibilities". The Register.
- Wang, Brian (April 24, 2008). "Terabit Ethernet around 2015".
- Duffy, Jim (April 20, 2009). "100 Gigabit Ethernet: Bridge to Terabit Ethernet". Network World. Archived from the original on May 14, 2010.
- Fleishman, Glenn (February 13, 2009). "Terabit Ethernet becomes a photonic possibility". Ars Technica. Condé Nast.