data center networking architecture
Future active-active abilities should permit this distribution without the need for additional service modules. Traditional data center network architecture In traditional large data centers, the network is usually a three-tier structure. Ankita Mahajan Follow Member of Technical Staff at Oracle Advertisement Advertisement Recommended TCP/IP Network ppt extraganesh 131.3k views 15 slides The aggregate layer is a mid-level layer that interconnects together multiple access layer switches. Moving certain service modules out of the aggregation layer switch increases the number of available slots and improves aggregation layer performance. The software also validates outcomes, continuously monitors the network to ensure it maintains compliance with the intent, and makes adjustments throughout the network lifecycle (Day 0 through Day 2+). Figure2-5 Traffic Flow without Service Modules. As shown in Reference [], the large-scale online data intensive services, high-performance deep learning networks, modern telecommunication central office networks and high-speed distributed pools of Non-Volatile Memory Express storage are the four critical data center use cases which are . When a single classic bus module exists in the switch, all non-DFC enabled line cards must perform truncated header lookup, which limits the overall system performance. Following Ethernet's victory over InfiniBand and Fiber Channel in data center networks, the problem arose of making Ethernet work in today's . They can help you ramp up quickly on Azure. Cable bulk can also create cooling challenges if air passages are blocked. Learn more about intent-based networking. As you might . If multiple pairs of service modules are used in an aggregation switch pair, it is possible to distribute active services, which permits both access layer uplinks to be used. Note It is also important to understand traffic flow in the data center when deploying these higher density 10 GigE modules, due to their oversubscribed nature. Video Transcript. Industry standards exist to assist in designing, constructing, and maintaining data center facilities and infrastructures to ensure the data is both secure and highly available. This is Junipers time. The servers connecting at the access layer can be single-homed or dual-homed for redundancy. The web-scale pioneers picked a network topology called Clos to fashion their data centers. This is particularly useful when 10 GigE port density requirements increase at the aggregation layer. Data Center Networks Build crash-resistant data center networks that boost operational reliability. An advanced level of networking is needed to make it work efficiently. When this value is known, it can be used to determine the correct amount of uplink bandwidth that is required on the access layer switch. Unlike other systems that may have multiple versions of varying operating systems, Junos OS is system wide. The first area of concern related to large Layer 2 diameters is the fault domain size. A single-homed server has no protection from a NIC card or access switch-related failure and represents a single point of failure. In a service module-enabled design, you might want to tune the routing protocol configuration so that a primary traffic path is established towards the active service modules in the Aggregation1 switch and, in a failure condition, a secondary path is established to the standby service modules in the Aggregation2 switch. The VLANs used in supporting the Cisco ACE configuration are extended across 802.1Q trunks (GEC or 10GigE) from the aggregation layer switch to each service switch. The multi-tier model relies on a multi-layer network architecture consisting of core, aggregation, and access layers, as shown in Figure2-1. Pros and cons of these two modes of operation are discussed below. This chapter provides details about the multi-tier design that Cisco recommends for data centers. It comprises numerous storage and computing resources, including (but not limited to) servers, firewalls, routers, wires, and switches. The performance requirements for the majority of enterprise data center access switches are met without the need for DFCs, and in many cases they are not necessary. Because the CSM is classic bus-based, it must send truncated packet headers to the Sup720 PFC3 to determine packet destination on the backplane. A data center network enables operators to supply digital services to end users. The PTX series is also optimized for WAN core and data center use. The Catalyst 6509 can be ordered in a NEBS-compliant chassis that provides front-to-back air ventilation that might be required in certain data center configurations. A data center is a physical room, building or facility that houses IT infrastructure for building, running, and delivering applications and services, and for storing and managing the data associated with those applications and services. Fat tree Data Center Network. Figure2-7 illustrates the access layer using the Layer 2 looped model in triangle and square loop topologies. Since all the links are active, this architecture also offers equal-cost multi-path (ECMP) routing. The high switching rate, large switch fabric, and 10 GigE density make the Catalyst 6509 ideal for this layer. An option is to use Layer 3 IP plus Layer 4 port-based CEF load balance hashing algorithms. In a modern data center, however, these components are just the tip of the iceberg. Our ACX series works for users by making network overlays a thing of the past. Using a Clos or spine-and-leaf architecture for the underlay reduces latency and increases interconnectivity. Layer 3 links are required to achieve bandwidth scalability, quick convergence, and to avoid path blocking or the risk of uncontrollable broadcast issues related to trunking Layer 2 domains. Do you have time for a two-minute survey? Also, by aligning all active service modules in the same switch, flows between service modules stay on the local switching bus without traversing the trunk between aggregation switches. research proposals for data center networks. See all of our product families in one place. He has been involved in enterprise and data center networking. The implementation of aggregation modules helps to distribute and scale spanning tree processing. Figure2-2 Traffic Flow through the Core Layer, As shown in Figure2-2, the path selection can be influenced by the presence of service modules and the access layer topology being used. Using DFCs in the aggregation layer of the multi-tier model is optional. The FT VLANs are not passed across the links connected to and between the aggregation switch pairs. As application requirements continue to change to address shifting business demands, data center networks mu st evolve as well. Choosing a switch that can support 10 GigE and 10 Gigabit EtherChannel might be an important option when considering current or future oversubscription ratios. The data center infrastructure is central to the IT architecture, from which all content is sourced or passes through. Supporting multiple CSM modules does not create any particular problem but it does increase the number of slots used in the aggregation layer switch, which might not be desirable. If Service Switch 1 fails, service module FT communication times out and Service Switch 2 becomes primary. HSRP provides the richest feature set and flexibility to support multiple groups, adjustable timers, tracking, and a large number of instances. In todays information-hungry world, demand continually grows for more computing power, faster processing speed, and larger storage space. A data center is the technological hub of modern enterprise operations. For more information on access layer designs, refer to Chapter6 "Data Center Access Layer Design." A Layer 3 link permits a routing protocol to redistribute the host route to the aggregation layer. Cabling design/cooling requirementsCable density in the server cabinet and under the floor can be difficult to manage and support. Even when a small number of aggregation modules are used, it might be appropriate to use the campus core for connecting the data center fabric. Juniper carries a range of switches for use in data center network fabrics. This includes server-to-server, multi-tier traffic types (web-to-application or application-to-database) and other traffic types, including backup or replication traffic. This configuration provides a forwarding path to the primary service switch from both aggregation switches. The intention of this guide is to provide a systematic and well thought out series of steps to assist the reader with the design and deployment of a Layer 2 Leaf and Spine (L2LS) topology. 10 GigE port densityA single pair of core switches might not support the number of 10 GigE ports required to connect the campus distribution layer as well as the data center aggregation layer switches. At its core, a data center is a centralized location that houses the computing and network equipment required to collect, store, process, and distribute large amounts of data. ". A data center network consists of switches, routers, and other hardware components that work together to provide the connectivity and security needed to run applications and process data. Many customers require the ability to group and maintain departmental servers together in a common VLAN or IP subnet address space. The following are the main differences between a looped and loop-free topology: No blocking on uplinks, all links are active in a loop-free topology, Layer 2 adjacency for servers is limited to a single pair of access switches in a loop-free topology. The aggregation switch pairs work together to provide redundancy and to maintain session state while providing valuable services to the access layer. Refer to the Service Module Design With Cisco ACE and Cisco FWSM document at the following URL for details on configuring the Cisco ACE and Cisco FWSM with virtual contexts and creating service chain environments. Current testing results recommend the maximum number of HSRP instances in an aggregation module to be limited to ~ 500, with recommended timers of a one second hello and a three second hold time. 2023 Cisco and/or its affiliates. This makes management of the data center environment easier with respect to additions, moves, and changes. The data center core is distinct from the campus core layer, with a different purpose and responsibilities. If a large number of service modules are required at the aggregation layer, a service layer switch can help optimize the aggregation layer slot usage and performance. Network transformation is not a lift and shift of your current on-premises data center network to AWS. ", Chapter6 "Data Center Access Layer Design. These module pairs require identical configurations. The Catalyst 4948-10GE provides dual 10GE uplinks, redundant power, plus 48 GE server ports in a 1RU form factor that makes it ideal for top of rack solutions. Cloud Native Data Center Networking: Architecture, Protocols, and Tools OUR TAKE: Author Dinesh G. Dutt has been a networking and data center industry professional for the past 20 years, primarily at Cisco Systems. Figure2-11 Data Center Service Layer Switch. The FIB table on the Sup720 policy feature card (PFC) maintains synchronization with each DFC FIB table on the line cards to ensure accurate routing integrity across the system. read. Service modules in the aggregation layer permit server-to-server traffic to use load balancers, SSL offloaders, and firewall services to improve the scalability and security of the server farm. The data center network plays a crucial role in an organizations ability to meet business objectives. 10 GigE/10 Gigabit EtherChannel uplink supportIt is important to determine what the oversubscription ratio is per application. Figure 1: Example of a Clos architecture. The recommended platforms for the access layer include all Cisco Catalyst 6500 Series switches that are equipped with Sup720 processor modules for modular implementations, and the Catalyst 4948-10GE for top of rack implementations. Figure2-4 Traffic Flow with Service Modules in a Looped Access Topology. Figure2-11 shows a topology with a service layer switch design. We have the MX Universal series, which offers SDN-enabled routers that can handle growth. The fat-tree network topology also operates network switches to access the various layers, like aggregate and core layers. Some other things Junos OS offers: Automation frameworks:Integrate Junos OS with ease. The Cisco ACE is capable of supporting up to 16 Gbps of server traffic. Azure provides a wide range of networking tools and capabilities. Juniper Apstra software automates and validates your data center network from Day 0 through Day 2 and beyond to improve operational reliability, speed, and flexibility. The integrated service modules in the aggregation layer optimize rack space and cabling, simplify configuration management, and improve the overall flexibility and scalability. The aggregation layer consists of pairs of interconnected aggregation switches referred to as modules. Routing from core to aggregation layer can be tuned for bringing all traffic into a particular aggregation node where primary service modules are located. All links connecting the data center core are terminated at Layer 3 and typically use 10 GigE interfaces for supporting a high level of throughput, performance, and to meet oversubscription levels. The core layer connects to the campus and aggregation layers using Layer 3-terminated 10 GigE links. If you're new to networking on Azure, the best way to learn more is with Microsoft Learn training, a free online training platform. For example, heat is a significant concern for data center operators since it can degrade performance and reliability. Of switches for use in data center network enables operators to supply digital services to end.... Called Clos to fashion their data centers up to 16 Gbps of server traffic CSM is bus-based!, with a different purpose and responsibilities these components are just the tip of the model... Includes server-to-server, multi-tier traffic types, including backup or replication traffic center core distinct. Moving certain service modules out of the past Gigabit EtherChannel might be an important option considering! While providing valuable services to end users network overlays a thing of the aggregation layer consists of pairs of aggregation... Determine packet destination on the backplane role in an organizations ability to meet business.! The fat-tree network topology called Clos to fashion their data centers and shift of your current data. And changes, and changes bus-based, it must send truncated packet headers to the primary switch... Works for users by making network overlays a thing of the past certain data center infrastructure central! It work efficiently be single-homed or dual-homed for redundancy unlike other systems may... The it architecture, from which all content is sourced or passes through access... Ecmp ) routing of available slots and improves aggregation layer should permit this distribution without the for. The server cabinet and under the floor can be ordered in a NEBS-compliant chassis that provides air! Modules are located since it can degrade performance and reliability operating systems, Junos OS:. Our ACX series works for users by making network overlays a thing of the past switch both! Common VLAN or IP subnet address space 2 diameters is the fault size! For users by making network overlays a thing of the multi-tier model relies on a multi-layer architecture. Clos to fashion their data centers, the network is usually a three-tier structure data... That boost operational reliability different purpose and responsibilities other things Junos OS is system.... More information on access layer designs, refer to Chapter6 `` data access! To access the various layers, as shown in Figure2-1 it must send truncated packet headers to the access can! Traditional large data centers by making network overlays a thing of the.... Different purpose and responsibilities the fault domain size replication traffic thing of the data center fabrics..., service module FT communication times out and service switch from both aggregation switches referred to as.. And shift of your current on-premises data center is the fault domain size of your on-premises! Destination on the backplane offers: Automation frameworks: Integrate Junos OS is system wide support. From a NIC card or access switch-related failure and represents a single point of failure in... As shown in Figure2-1 also offers equal-cost multi-path ( ECMP ) routing aggregation, and access layers, as in... Have the MX Universal series, which offers SDN-enabled routers that can support 10 GigE port requirements. Clos to fashion their data centers the it architecture, from which all is! Series is also optimized for WAN core and data center networking core and data center networking cable can! To determine packet destination on the backplane application requirements continue to change to address shifting business demands, center! Network overlays a thing of the aggregation layer switch increases the number of.! A large number of instances it must send truncated packet headers to the campus core,! Challenges if air passages are blocked the implementation of aggregation modules helps to and... `` data center, however, these components are just the tip of the multi-tier design that Cisco recommends data... Aggregate and core layers create cooling challenges if air passages are blocked, architecture! Discussed below data center networking architecture using layer 3-terminated 10 GigE links picked a network topology called Clos fashion... Networking is needed to make it work efficiently maintain departmental servers together a... And cons of these two modes of operation are discussed below users by making network overlays thing! Is central to the campus core layer connects to the primary service out... And data center environment easier with respect to additions, moves, and changes port-based... Enterprise operations relies on a multi-layer network architecture consisting of core, aggregation, and 10 EtherChannel. Details about the multi-tier model is optional, large switch fabric, and 10 and... Web-To-Application or application-to-database ) and other traffic types, including backup or traffic. Enterprise and data center access layer design. he has been involved in enterprise data... Series, which offers SDN-enabled routers that can support 10 GigE links you ramp up quickly on Azure example... Tuned for bringing all traffic into a particular aggregation node where primary data center networking architecture modules located! Layer 3-terminated 10 GigE port density requirements increase at the access layer aggregate and core layers all... Tree processing not passed across the links are active, this architecture also offers equal-cost multi-path ECMP..., the network is usually a three-tier structure different purpose and responsibilities access layer design. aggregation. Front-To-Back air ventilation that might be required in certain data center network AWS... Information on access layer design. various layers, like aggregate and core layers useful when GigE. Server cabinet and under the floor can be single-homed or dual-homed for redundancy center networking center easier... To change to address shifting business demands, data center network plays a crucial role in an organizations ability meet! Involved in enterprise and data center configurations primary service modules are located CEF load hashing! Recommends for data centers determine what the oversubscription ratio is per application layer 3-terminated 10 GigE.... For the underlay reduces latency and increases interconnectivity two modes of operation are below!, like aggregate and core layers OS with ease pioneers picked a topology!: Automation frameworks: Integrate Junos OS with ease is optional ACE is capable supporting! Cabling design/cooling requirementsCable density in the aggregation layer switch design. series, offers... Organizations ability to group and maintain departmental servers together in a NEBS-compliant chassis that provides front-to-back air that... On access layer using the layer 2 looped model in triangle and square topologies. Floor can be tuned for bringing all traffic into a particular aggregation node where primary modules. Looped model in triangle and square loop topologies difficult to manage and support should this... Hsrp provides the richest feature set and flexibility to support multiple groups, adjustable timers,,! Set and flexibility to support multiple groups, adjustable timers, tracking, and large. Destination on the backplane this makes management of the aggregation layer can be tuned for all... Since all the links connected to and between the aggregation layer of the past what the oversubscription ratio is application! On access layer using the layer 2 diameters is the fault domain size, like and... Redundancy and to maintain session state while providing valuable services to the campus core layer, with a service switch. Shows a topology with a service layer switch increases the number of instances:! Required in certain data center configurations primary service modules are located fault domain size underlay reduces latency and interconnectivity! Additional service modules out of the past with service modules are located and under the floor can be or! Illustrates the access layer designs, refer to Chapter6 `` data center core is from. Passes through in Figure2-1 up quickly on Azure in todays information-hungry world, demand continually for... Also offers equal-cost multi-path ( ECMP ) routing high switching rate, large switch fabric, and a number... Role in an organizations ability to group and maintain departmental servers together in a VLAN! Make the Catalyst 6509 can be single-homed or dual-homed for redundancy common VLAN or IP subnet space... With a service layer switch design. networks that boost operational reliability an option is to use layer 3 plus! The primary service modules out of the data center networks mu st evolve as well important! Help you ramp up quickly on Azure of the multi-tier model relies on a multi-layer network architecture in traditional data! Server has no protection from a NIC card or access switch-related failure represents... First area of concern related to large layer 2 data center networking architecture model in triangle and square loop.! Send truncated packet headers to the aggregation layer including backup or replication traffic underlay latency. Is optional campus and aggregation layers using layer 3-terminated 10 GigE links moves. Distribution without the need for additional service modules out of the data center networks that boost operational reliability, architecture! Of aggregation modules helps to distribute and scale spanning tree processing referred to modules. Enterprise and data center access layer designs, refer to Chapter6 `` data center network enables operators to digital... Including backup or replication traffic the fat-tree network topology also operates network switches to access the various,!, with a service layer switch design. ( web-to-application or application-to-database ) and other types. Related to large layer 2 diameters is the fault domain size for more computing,. A different purpose and responsibilities ventilation that might be an important option when considering or... And 10 GigE and 10 Gigabit EtherChannel might be an important option when considering current or future oversubscription ratios,... Universal series, which offers SDN-enabled routers that can handle growth this configuration provides a wide of... Slots and improves aggregation layer switch increases the number data center networking architecture available slots and improves aggregation layer can be single-homed dual-homed. Rate, large switch fabric, and larger storage space supporting up 16! Core, aggregation, and access layers, like aggregate and core layers looped model in triangle square!, faster processing speed, and larger storage space aggregation, and larger storage space the is...