Part 3 to this series presented serialization delay, or the delay incurred while placing packets of data on the wire. Part 4 of this series on measuring the latency in messaging systems will focus on the latency of these packets as they travel between the sending and receiving nodes.
The speed of light, or circa 186,000 miles per second is clearly the upper limit for the speed which packets can travel between sending and receiving nodes. The material used to wire and connect computer networks, be it copper or fiber, limits the speed at which messages can travel by a factor of the speed of light to roughly 75%.
The Telecommunications Industry Association (TIA) has developed standards over the years to address commercial cabling for telecom products and services ensuring minimum quality thresholds are met throughout the world. Cable types are typically characterized with performance attributes like those shown in the table below.
The table displays the propagation characteristics of that category of cable. The propagation delay is typically quoted for a 100 meters length cable, which represents the maximum recommended distance for cables in a 10/100/1000baseT[X] environment.
To illustrate, at a high-level, how propagation delay affects common messaging applications, imagine a streaming application that generates 2,600 new 100 byte messages per second. Individual messages for this application would require about 3 seconds to travel between nodes in New York and California connected when traveling at T1 speeds. Circa 1.5 seconds of this time (2600messages*100bytes / 192,500bytes/second) would be spent serializing the messages onto the wire, and another 20+ milliseconds(3200 miles/ 75% the speed of light) for the messages to propagate between New York and California. Additional latencies are incurred as each network device routes the packet along the its path. We’ll cover these other latencies in part 5 of this series.
Fiber Optic Cabling
Copper wiring is not the only cable type that is used in modern computer networks. Fiber optic cables make up the backbone wiring technology to many of the world’s computer networks. We read above that various types of copper cables exhibit roughly 5.48 nanosecond propagation delay per meter of cable. For a practical understanding of the propagation delay characteristics of fiber optic cable, refer to the comments following this post.
The minimum packet size for Ethernet networks is closely related to the maximum cable length for segmented nodes in these networks. Click here for a detailed description of this relationship.
Minimizing Propagation Delay
Low latency sensitive industries, such as the financial services, have relied heavily on tactics such as collocation, which geographically minimizes the distance between nodes along the message path by hosting sender and receiver in the same physical location. As the geographic distance is minimized, so is the propagation delay between nodes.
In part 5 of this series, we’ll wrap up the topic of measuring latency by covering other factors that contribute to latency.