Network mapping: Difference between revisions
m Adding Cheleby link correctly for anon user... |
Aadirulez8 (talk | contribs) m v2.05 - Autofix / Fix errors for CW project (Link equal to linktext) |
||
(143 intermediate revisions by 96 users not shown) | |||
Line 1: | Line 1: | ||
{{short description|Study of a computer network's physical connections}} |
|||
{{Unreferenced|date=March 2009}} |
|||
{{More citations needed|date=April 2016}} |
|||
[[File:Internet map 1024.jpg|thumb|right|A visual representation of a part of the Internet |
[[File:Internet map 1024.jpg|thumb|right|A visual representation of a part of the Internet]] |
||
⚫ | '''Network mapping''' is the study of the physical connectivity of networks e.g. the [[Internet]]. Network mapping discovers the devices on the network and their connectivity. It is not to be confused with network discovery or [[network enumeration]] which discovers devices on the network and their characteristics such as [[operating system]], open [[Computer port (software)|ports]], listening [[network service]]s, etc. The field of automated network mapping has taken on greater importance as networks become more dynamic and complex in nature. |
||
⚫ | '''Network mapping''' is the study of the physical connectivity of networks. |
||
==Large-scale mapping project== |
==Large-scale mapping project== |
||
Images of some of the first attempts at a large scale map of the internet were produced by the [[Internet Mapping Project]] and appeared in [[Wired magazine]]. The maps produced by this project were based on the [[Network Layer|layer 3]] or [[Internet Protocol|IP]] level connectivity of the Internet (see [[OSI model]]), but there are different aspects of internet structure that have also been mapped. |
Images of some of the first attempts at a large scale map of the internet were produced by the [[Internet Mapping Project]] and appeared in ''[[Wired (magazine)|Wired]]'' magazine. The maps produced by this project were based on the [[Network Layer|layer 3]] or [[Internet Protocol|IP]] level connectivity of the Internet (see [[OSI model]]), but there are different aspects of internet structure that have also been mapped. |
||
More recent efforts to map the internet have been improved by more sophisticated methods, allowing them to make faster and more sensible maps. An example of such an effort is the [[Opte Project|OPTE project]], which is attempting to develop a system capable of mapping the internet in a single day. |
More recent efforts to map the internet have been improved by more sophisticated methods, allowing them to make faster and more sensible maps. An example of such an effort is the [[Opte Project|OPTE project]], which is attempting to develop a system capable of mapping the internet in a single day. |
||
The "Map of the Internet Project" |
The "Map of the Internet Project" maps over 4 billion internet locations as cubes in 3D [[cyberspace]]. Users can add [[Uniform Resource Locator|URL]]s as cubes and re-arrange objects on the map. |
||
In early 2011 Canadian based ISP [[Peer 1|PEER 1 Hosting]] created their own [[Map of the Internet]] that depicts a graph of 19,869 [[Autonomous system (Internet)|autonomous system]] nodes connected by 44,344 connections. The sizing and layout of the autonomous systems was calculated based on their [[eigenvector]] centrality, which is a measure of how central to the network each autonomous system is. |
|||
⚫ | [[Graph theory]] can be used to better understand maps of the internet and to help choose between the many ways to [[Information visualization|visualize]] internet maps. Some projects have attempted to incorporate geographical data into their internet maps (for example, to draw locations of [[router]]s and [[node (networking)|node]]s on a map of the world), but others are only concerned with representing the more abstract structures of the internet, such as the allocation, structure, and purpose of [[IPv4|IP space]]. |
||
⚫ | [[Graph theory]] can be used to better understand maps of the internet and to help choose between the many ways to [[Information visualization|visualize]] internet maps. Some projects have attempted to incorporate geographical data into their internet maps (for example, to draw locations of [[Router (computing)|router]]s and [[node (networking)|node]]s on a map of the world), but others are only concerned with representing the more abstract structures of the internet, such as the allocation, structure, and purpose of [[IPv4|IP space]]. |
||
⚫ | |||
⚫ | Many |
||
⚫ | |||
⚫ | |||
⚫ | Many organizations create network maps of their network system. These maps can be made manually using simple tools such as [[Microsoft Visio]], or the mapping process can be simplified by using tools that [[Network documentation|integrate auto network discovery with Network mapping]], one such example being the Fabric platform. Many of the vendors from the [[Network mapping#Notable network mappers|Notable network mappers]] list enable you to customize the maps and include your own labels, add un-discoverable items and background images. Sophisticated mapping is used to help visualize the network and understand relationships between end devices and the transport layers that provide service. Mostly, network scanners detect the network with all its components and deliver a list which is used for creating charts and maps using network mapping software.<ref>{{Cite web|title=FREE network mapping software PRTG|url=https://www.paessler.com/network-mapping|access-date=2021-09-07|website=www.paessler.com|language=en}}</ref> Items such as bottlenecks and [[root cause analysis]] can be easier to spot using these tools. |
||
⚫ | The SNMP based approach retrieves data from Router and Switch MIBs in order to build the network map. The |
||
⚫ | |||
==Mapping Techniques== |
|||
⚫ | There are two prominent techniques used today to create Internet maps. The first works on the data plane of the [[Internet]] and is called active probing. It is used to infer [[Internet topology]] based on [[router]] adjacencies. The second works on the control plane and infers [[autonomous system (Internet)|autonomous system]] connectivity based on [[BGP]] data. |
||
⚫ | The SNMP based approach retrieves data from Router and Switch MIBs in order to build the network map. The active probing approach relies on a series of traceroute-like probe packets in order to build the network map. The route analytics approach relies on information from the [[routing protocol]]s to build the network map. Each of the three approaches have advantages and disadvantages in the methods that they use. |
||
⚫ | |||
⚫ | This technique relies on [[traceroute]]-like probing on the IP address space. |
||
==Internet mapping techniques== |
|||
⚫ | |||
⚫ | There are two prominent techniques used today to create Internet maps. The first works on the data plane of the [[Internet]] and is called active probing. It is used to infer [[Internet topology]] based on [[Router (computing)|router]] adjacencies. The second works on the control plane and infers [[autonomous system (Internet)|autonomous system]] connectivity based on [[Border Gateway Protocol|BGP]] data. A BGP speaker sends 19-byte keep-alive messages every 60 seconds to maintain the connection. |
||
⚫ | This technique relies on various [[BGP]] collectors who collect routing updates and tables and provide this information publicly. Each |
||
⚫ | |||
==Notable network mappers== |
|||
⚫ | This technique relies on [[traceroute]]-like probing on the IP address space. These probes report back IP forwarding paths to the destination address. By combining these paths one can infer router level topology for a given [[Point of presence|POP]]. Active probing is advantageous in that the paths returned by probes constitute the actual forwarding path that data takes through networks. It is also more likely to find [[peering]] links between [[ISP]]s. However, active probing requires massive amounts of probes to map the entire Internet. It is more likely to infer false topologies due to load balancing routers and routers with multiple IP address aliases. Decreased global support for enhanced probing mechanisms such as [[source-route probing]], [[Internet Control Message Protocol|ICMP]] Echo Broadcasting, and [[IP Address Resolution]] techniques leaves this type of probing in the realm of network diagnosis. |
||
Notable network mapping software includes: |
|||
* [[HP OpenView]] |
|||
⚫ | |||
⚫ | |||
⚫ | This technique relies on various [[Border Gateway Protocol|BGP]] collectors who collect routing updates and tables and provide this information publicly. Each BGP entry contains a [[Path Vector]] attribute called the AS Path. This path represents an [[autonomous system (Internet)|autonomous system]] forwarding path from a given origin for a given set of [[prefixes]]. These paths can be used to infer AS-level connectivity and in turn be used to build AS topology graphs. However, these paths do not necessarily reflect how data is actually forwarded and adjacencies between AS nodes only represent a policy relationship between them. A single AS link can in reality be several router links. It is also much harder to infer peerings between two AS nodes as these peering relationships are only propagated to an ISP's customer networks. Nevertheless, support for this type of mapping is increasing as more and more ISP's offer to peer with public route collectors such as [[Route-Views]] and [[Réseaux IP Européens|RIPE]]. New toolsets are emerging such as Cyclops and [[NetViews]] that take advantage of a new experimental BGP collector [[BGPMon]]. NetViews can not only build topology maps in seconds but visualize topology changes moments after occurring at the actual router. Hence, routing dynamics can be visualized in real time. |
||
* [[NetCrunch]] |
|||
In comparison to what the tools using BGPMon does there is another tool netTransformer able to discover and generate BGP peering maps either through SNMP polling or by converting MRT dumps<ref>{{Cite web | url=https://tools.ietf.org/html/rfc6396 | title=RFC 6396 - Multi-Threaded Routing Toolkit (MRT) Routing Information Export Format }}</ref> to a [[graphml]] file format. netTransformer allows us also to perform network diffs between any two dumps and thus to reason how does the BGP peering has evolved through the years.<ref>{{cite web|url=http://www.slideshare.net/itransformersCrew/tracking-network-evolution-process-with-nettransformer-bulgarian-internet-bgp-peering-evolution-from-2001-till-now-network-evolution|title=Tracking network evolution process with netTransformer & Bulgarian In…|date=2 November 2014|publisher=|accessdate=30 August 2016}}</ref> [[WhatsUp Gold]], an [[Information technology|IT]] monitoring tool, tracks networks, servers, applications, storage devices, virtual devices and incorporates infrastructure management, application performance management.<ref>{{cite web|url=https://www.pcmag.com/article2/0,2817,2410487,00.asp|title=Ipswitch WhatsUp Gold|magazine=PC Magazine}}</ref> |
|||
* [[Nmap]] |
|||
{{Image frame|width=800|content=[[Image:NetTransformer Internet BGP map.jpg|800px]] |
|||
* [[PacketTrap]] |
|||
|caption=Internet BGP peering map (red - multi homed AS, green stubs) |link=BGP peering|align=center}} |
|||
* [[Plixer_International#Items_.26_Services| Scrutinizer]] |
|||
* [[SolarWinds]] |
|||
* [[Spiceworks]] |
|||
== See also == |
== See also == |
||
* [[Comparison of network diagram software]] |
|||
⚫ | |||
* [[Idea networking]] |
|||
⚫ | |||
* [[Opte Project]] |
* [[Opte Project]] |
||
* [[DIMES ]] |
|||
* [[Webometrics]] |
* [[Webometrics]] |
||
⚫ | |||
== |
==Notes== |
||
{{reflist}} |
|||
⚫ | |||
⚫ | |||
== External links == |
|||
*[http://netlab.cs.memphis.edu/projects_cri.html/ CRI Collaborative Research: Building the Next-Generation Global Routing Monitoring Systems] |
|||
⚫ | |||
⚫ | |||
*[http://netlab.cs.memphis.edu/netviews1.html NetViews: Multi-level Realtime Internet Mapping] |
|||
*[http://cyclops.cs.ucla.edu/ Cyclops: An AS level Observatory] |
*[http://cyclops.cs.ucla.edu/ Cyclops: An AS level Observatory] |
||
*[http://www. |
*[https://web.archive.org/web/20050523235412/http://www.netdimes.org/ DIMES Research Project] |
||
*[http://research.lumeta.com/ches/map/ Internet Mapping Research Project] |
*[https://web.archive.org/web/20060106055420/http://research.lumeta.com/ches/map/ Internet Mapping Research Project] |
||
*[http://www.opte.org/ The Opte Project] |
*[https://web.archive.org/web/20040824013519/http://www.opte.org/ The Opte Project] |
||
[[Category:Internet]] |
[[Category:Internet architecture]] |
||
[[Category:Network mappers]] |
[[Category:Network mappers]] |
||
[[pt:Mapeamento da internet]] |
|||
[[sv:Internetmappning]] |
[[sv:Internetmappning]] |
Latest revision as of 21:40, 14 December 2024
This article needs additional citations for verification. (April 2016) |
Network mapping is the study of the physical connectivity of networks e.g. the Internet. Network mapping discovers the devices on the network and their connectivity. It is not to be confused with network discovery or network enumeration which discovers devices on the network and their characteristics such as operating system, open ports, listening network services, etc. The field of automated network mapping has taken on greater importance as networks become more dynamic and complex in nature.
Large-scale mapping project
[edit]Images of some of the first attempts at a large scale map of the internet were produced by the Internet Mapping Project and appeared in Wired magazine. The maps produced by this project were based on the layer 3 or IP level connectivity of the Internet (see OSI model), but there are different aspects of internet structure that have also been mapped.
More recent efforts to map the internet have been improved by more sophisticated methods, allowing them to make faster and more sensible maps. An example of such an effort is the OPTE project, which is attempting to develop a system capable of mapping the internet in a single day.
The "Map of the Internet Project" maps over 4 billion internet locations as cubes in 3D cyberspace. Users can add URLs as cubes and re-arrange objects on the map.
In early 2011 Canadian based ISP PEER 1 Hosting created their own Map of the Internet that depicts a graph of 19,869 autonomous system nodes connected by 44,344 connections. The sizing and layout of the autonomous systems was calculated based on their eigenvector centrality, which is a measure of how central to the network each autonomous system is.
Graph theory can be used to better understand maps of the internet and to help choose between the many ways to visualize internet maps. Some projects have attempted to incorporate geographical data into their internet maps (for example, to draw locations of routers and nodes on a map of the world), but others are only concerned with representing the more abstract structures of the internet, such as the allocation, structure, and purpose of IP space.
Enterprise network mapping
[edit]Many organizations create network maps of their network system. These maps can be made manually using simple tools such as Microsoft Visio, or the mapping process can be simplified by using tools that integrate auto network discovery with Network mapping, one such example being the Fabric platform. Many of the vendors from the Notable network mappers list enable you to customize the maps and include your own labels, add un-discoverable items and background images. Sophisticated mapping is used to help visualize the network and understand relationships between end devices and the transport layers that provide service. Mostly, network scanners detect the network with all its components and deliver a list which is used for creating charts and maps using network mapping software.[1] Items such as bottlenecks and root cause analysis can be easier to spot using these tools.
There are three main techniques used for network mapping: SNMP based approaches, active probing and route analytics.
The SNMP based approach retrieves data from Router and Switch MIBs in order to build the network map. The active probing approach relies on a series of traceroute-like probe packets in order to build the network map. The route analytics approach relies on information from the routing protocols to build the network map. Each of the three approaches have advantages and disadvantages in the methods that they use.
Internet mapping techniques
[edit]There are two prominent techniques used today to create Internet maps. The first works on the data plane of the Internet and is called active probing. It is used to infer Internet topology based on router adjacencies. The second works on the control plane and infers autonomous system connectivity based on BGP data. A BGP speaker sends 19-byte keep-alive messages every 60 seconds to maintain the connection.
Active probing
[edit]This technique relies on traceroute-like probing on the IP address space. These probes report back IP forwarding paths to the destination address. By combining these paths one can infer router level topology for a given POP. Active probing is advantageous in that the paths returned by probes constitute the actual forwarding path that data takes through networks. It is also more likely to find peering links between ISPs. However, active probing requires massive amounts of probes to map the entire Internet. It is more likely to infer false topologies due to load balancing routers and routers with multiple IP address aliases. Decreased global support for enhanced probing mechanisms such as source-route probing, ICMP Echo Broadcasting, and IP Address Resolution techniques leaves this type of probing in the realm of network diagnosis.
AS PATH inference
[edit]This technique relies on various BGP collectors who collect routing updates and tables and provide this information publicly. Each BGP entry contains a Path Vector attribute called the AS Path. This path represents an autonomous system forwarding path from a given origin for a given set of prefixes. These paths can be used to infer AS-level connectivity and in turn be used to build AS topology graphs. However, these paths do not necessarily reflect how data is actually forwarded and adjacencies between AS nodes only represent a policy relationship between them. A single AS link can in reality be several router links. It is also much harder to infer peerings between two AS nodes as these peering relationships are only propagated to an ISP's customer networks. Nevertheless, support for this type of mapping is increasing as more and more ISP's offer to peer with public route collectors such as Route-Views and RIPE. New toolsets are emerging such as Cyclops and NetViews that take advantage of a new experimental BGP collector BGPMon. NetViews can not only build topology maps in seconds but visualize topology changes moments after occurring at the actual router. Hence, routing dynamics can be visualized in real time. In comparison to what the tools using BGPMon does there is another tool netTransformer able to discover and generate BGP peering maps either through SNMP polling or by converting MRT dumps[2] to a graphml file format. netTransformer allows us also to perform network diffs between any two dumps and thus to reason how does the BGP peering has evolved through the years.[3] WhatsUp Gold, an IT monitoring tool, tracks networks, servers, applications, storage devices, virtual devices and incorporates infrastructure management, application performance management.[4]
See also
[edit]- Comparison of network diagram software
- DIMES
- Idea networking
- Network topology
- Opte Project
- Webometrics
Notes
[edit]- ^ "FREE network mapping software PRTG". www.paessler.com. Retrieved 2021-09-07.
- ^ "RFC 6396 - Multi-Threaded Routing Toolkit (MRT) Routing Information Export Format".
- ^ "Tracking network evolution process with netTransformer & Bulgarian In…". 2 November 2014. Retrieved 30 August 2016.
- ^ "Ipswitch WhatsUp Gold". PC Magazine.