Nx-os san switching configuration guide (284 pages)
Summary of Contents for Cisco Nexus 5000 NX-OS
Page 1
Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) First Published: March 13, 2012 Last Modified: February 12, 2013 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387)
Page 2
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: www.cisco.com/go/trademarks . Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company.
Configuring Classification Configuring Class Maps Configuring CoS Classification Configuring Precedence Classification Configuring DSCP Classification Configuring Protocol Classification Configuring IP RTP Classification Configuring ACL Classification Verifying the Classification Configuration Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 4
Enabling the Jumbo MTU Verifying the Jumbo MTU Verifying the System QoS Configuration Configuring QoS on Interfaces C H A P T E R 7 Information About Interface QoS Trust Boundaries Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 5
Buffering and Queue Limits on the Cisco Nexus 5000 Platform Buffering and Queue Limits on the Cisco Nexus Device Information About Flow Control Link-Level Flow Control Priority Flow Control Configuring Queuing Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 6
Configuring the Queue Limit for a Specified Fabric Extender Configuring No-Drop Buffer Thresholds Configuring the Buffer Threshold for the Cisco Nexus 2148T Fabric Extender Enabling Virtual Output Queuing Limits for Unicast Traffic on the Cisco Nexus Device Configuring Flow Control Link-Level Flow Control...
Documentation Feedback, page viii • Obtaining Documentation and Submitting a Service Request, page ix Audience This publication is for network administrators who configure and maintain Cisco Nexus devices and Cisco Nexus 2000 Series Fabric Extenders. Document Conventions Command descriptions use the following conventions:...
Documentation Feedback To provide technical feedback on this document, or to report an error or omission, please send your comments to: ciscodfa-docfeedback@cisco.com. We appreciate your feedback. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) viii OL-26657-01...
Subscribe to What's New in Cisco Product Documentation, which lists all new and revised Cisco technical documentation as an RSS feed and delivers content directly to your desktop using a reader application. The RSS feeds are a free service.
Page 10
Preface Obtaining Documentation and Submitting a Service Request Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Feature Description Where Documented VLAN QoS Support for QoS VLANs. Configuring QoS on VLANs, on page 49 Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 12
New and Changed Information New and Changed Information for this Release Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
QoS for Traffic Directed to the CPU , page 5 Information About Quality of Service The configurable Cisco NX-OS quality of service (QoS) features allow you to classify the network traffic, prioritize the traffic flow, and provide congestion avoidance. The default QoS configuration on the device provides lossless service for Fibre Channel and Fibre Channel over Ethernet (FCoE) traffic and best-effort service for Ethernet traffic.
Page 14
MQC target and specifies whether to apply the policy on incoming or outgoing packets. This mapping enables the configuration of QoS policies such as marking, bandwidth allocation, buffer allocation, and so on. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
The device automatically applies QoS policies to traffic that is directed to the CPU to ensure that the CPU is not flooded with packets. Control traffic, such as bridge protocol data units (BPDU) frames, is given higher priority to ensure delivery. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 16
Overview QoS for Traffic Directed to the CPU Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Differentiated Services Code Point (DSCP) DSCP value within the DIffServ field of the IP Header. Protocol Selected set of protocols, including Address Resolution Protocol (ARP) and Connectionless Network Service (CLNS). Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Licensing Requirements for Classification This feature does not require a license. Any feature not included in a license package is bundled with the Cisco NX-OS system images and is provided at no extra charge to you. For a complete explanation of the Cisco NX-OS licensing scheme, see the Cisco NX-OS Licensing Guide.
IEEE 802.1p to support QoS traffic classes. CoS is encoded in the high order 3 bits of the VLAN ID Tag field and is referred to as user_priority. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Configuring Classification Configuring Precedence Classification The Cisco Nexus 2148 Fabric Extender does not support frames with the dot1p vlan 0 tag. Note If a system class is configured with a no-drop function, the match cos command serves an additional purpose.
Page 21
1-2, critical Use the show class-map command to display the IP precedence value class-map configuration: switch# show class-map class_precedence Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Configuring Protocol Classification You can classify traffic based on the IPv4 Protocol field or the IPv6 Next Header field in the IP header. The following table shows the protocol arguments: Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
The IP Real-time Transport Protocol (RTP) is a transport protocol for real-time applications that transmits data such as audio or video and is defined by RFC 3550. Although RTP does not use a common TCP or UDP Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Creates a named object that represents a class of traffic. Class-map names can contain alphabetic, hyphen, or class-name underscore characters, are case sensitive, and can be up to 40 characters. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Optionally, you can display the named policy only. running-config ipqos Displays information about the running configuration for QoS. startup-config ipqos Displays information about the startup configuration for QoS. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
• Queuing • QoS Before you enable FCoE on the Cisco Nexus device, you must enable class-fcoe in the three types of qos policies (network QoS, queuing, and QoS) by entering the type qos policy maps command and applying at least one FCoE QoS policy under system QoS.
Page 28
• Type qos—A type QoS policy is used to classify traffic that is based on various Layer 2, Layer 3, and Layer 4 fields in the frame and to map it to system classes. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
(class-default). You can define up to four additional system classes for Ethernet traffic. The following predefined policy maps are used as default service policies: • network-qos: default-nq-policy • Input qos: default-in-policy • Input queuing: default-in-policy • Output queuing: default-out-policy Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 30
• network-qos—Network-wide (global) mode. CLI prompt: switch(config-pmap-c-nq)# • qos—Classification mode; this is the default mode. CLI prompt: switch(config-pmap-c-qos)# • queuing—Queuing mode. CLI prompt: switch(config-pmap-c-que)# Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
This example shows how to define a type qos policy map: switch# configure terminal switch(config)# policy-map type qos policy-s1 switch(config-pmap-qos)# class type qos class-s1 switch(config-pmap-c-qos)# set qos-group 2 Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
The pfc-cos-value range is from 0 to 7. This option is supported only for for a ACL-based system class (which filters traffic using criteria other than cos-based matches). Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Step 2 switch(config)# policy-map type Creates a named object that represents a set of policies that queuing policy-name are to be applied to a set of traffic classes. Policy-map Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Displays the policy map settings for a specific policy queuing} [name] type. Optionally, you can display the named policy only. Displays information about the running configuration running-config ipqos for QoS. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 35
Configuring Policy Maps Verifying the Policy Map Configuration Command Purpose startup-config ipqos Displays information about the startup configuration for QoS. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 36
Configuring Policy Maps Verifying the Policy Map Configuration Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Configuring DSCP Marking For Cisco Nexus devices, you can set the DSCP value in the six most significant bits of the DiffServ field of the IP header to a specified value. You can enter numeric values from 0 to 63, in addition to the standard...
Page 38
CS4 (precedence 4) dscp (100000)—decimal value CS5 (precedence 5) dscp (101000)—decimal value CS6 (precedence 6) dscp (110000)—decimal value CS7 (precedence 7) dscp (111000)—decimal value default Default dscp (000000)—decimal value 0 Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
You can set IP Precedence or DSCP but you can not set both values because they modify the same field in the IP packet. Table 7: Precedence Values Value List of Precedence Values <0-7> IP precedence value Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Configuring CoS Marking The value of the CoS field is recorded in the high-order three bits of the VLAN ID Tag field in the IEEE 802.1Q header. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
40 characters. Step 4 switch(config-pmap-nq) # class Creates a reference to the class-map-name and enters [type network-qos] {class-map policy-map class configuration mode. name |class-default} Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
[name] Displays the policy maps defined on the switch. Optionally, you can display the named policy only. Displays information about the running configuration running-config ipqos for QoS. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 43
Configuring Marking Verifying the Marking Configuration Command Purpose startup-config ipqos Displays informationa bout the startup configuration for QoS. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 44
Configuring Marking Verifying the Marking Configuration Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
On the Cisco Nexus device, a system class is uniquely identified by a qos-group value. A total of six system classes are supported. Two of the six system classes are defaults and are always present on the device. Up to four additional system classes can be created by the administrator.
The Cisco Nexus 5500 Series device supports five user-defined classes and one default Note drop system class. The Cisco Nexus device is a Layer 2 switch, and it does not support packet fragmentation. A maximum transmission unit (MTU) configuration mismatch between ingress and egress interfaces may result in packets being truncated.
You can only apply input to a qos policy; you can apply both input and output to a queuing policy. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Resets the network-wide policy map. network-qos policy-map name Step 5 switch(config-sys-qos)# no service-policy type Resets the output queuing mode policy map. queuing output policy-map name Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
This example shows how to restore the default queue limit on a Cisco Nexus 2248T Fabric Extender: switch# configure terminal switch(config-if)# fex 101 switch(config-fex)# hardware N2248T queue-limit 327680 This example shows how to remove the queue limit that is set by default on a Cisco Nexus 2248T Fabric Extender: switch# configure terminal switch(config)# fex 101...
Verifying the Jumbo MTU On the Cisco Nexus device, traffic is classified into one of eight QoS groups. The MTU is configured at the QoS group level. By default, all Ethernet traffic is in QoS group 0. To verify the jumbo MTU for Ethernet traffic, use the show queueing interface ethernet slot/chassis_number command and find "HW MTU"...
Page 52
Displays the class maps defined on the switch. running-config ipqos Displays information about the running configuration for QoS. startup-config ipqos Displays information a bout the startup configuration for QoS. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
After the system applies the untagged CoS value, QoS functions the same as for a packet that entered the system tagged with the CoS value. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
If you configure either of these predefined class maps as a no-drop class, the priority flow control capability Note is applied across all Ethernet CoS values. In this configuration, pause will be applied to unicast and multicast traffic. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
You can configure flow control on a Layer 2 or Layer 3 interface. Use the no switchport command to configure a Layer 3 interface On a Cisco Nexus device, you can configure a type qos policy map and untagged CoS on the same interface. Procedure...
Enters global configuration mode. Step 2 switch(config)# interface Enters the configuration mode for the specified interface. ethernet slot/port Step 3 switch(config-if)# no switchport Selects the Layer 3 interface. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
[interface slot/\port] Displays the queue configuration and statistics. show interface flowcontrol [module numbef ] Displays the detailed listing of the flow control settings on all interfaces. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 58
Displays the untagged CoS values for all interfaces. Displays information about the running configuration running-config ipqos for QoS. startup-config ipqos Displays information about the startup configuration for QoS. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Information About VLAN QoS On Cisco Nexus devices, you can configure quality of service (QoS) policies for classification and marking on VLANs. The policies that you apply to a VLAN are applied to the traffic on the VLAN's Layer 2 and switch virtual interface (SVI) ports.
VLANs with CoS 5 go to qos-group 5. class-map type qos match-all cm1 match cos 5 policy-map type qos pm-vlan class cm1 set qos-group 4 Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
10 class-map type qos match-all cm1 match cos 5 policy-map type qos pm-vlan class cm1 set qos-group 4 class class-default vlan configuration 10 service-policy type qos input pm-vlan Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
• If a VLAN with a QoS policy is configured on an interface with no QoS policy, the show policy-map interface number command does not display the QoS policy configured on the VLAN. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
• You must configure the interface QoS limit. • You must configure a policy map. • The TCAM must have enough free entries to configure the service policy on the VLAN. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
40 alphanumeric characters. Step 4 switch(config-vlan-config)# copy (Optional) Saves the changes persistently through reboots and running-config startup-config restarts by copying the running configuration to the startup configuration. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Displays information about the startup configuration for QoS. Feature History for VLAN QoS Table 8: Feature History for VLAN QoS Feature Name Release Feature Information VLAN QoS 5.1(3)N2(1) This feature was introduced. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
• In addition to these queues, control traffic that is destined for the CPU uses strict priority queues. These queues are not accessible for user configuration. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
• Maximum ingress port buffering: 320KB per port. • Maximum egress port buffering: 160KB per port. The following default buffer allocations per port exist for the Cisco Nexus 5000 Platform: Table 9: Cisco Nexus 5000 Platform Default Buffer Allocations Per Port...
Note equals 478 minus the buffer used by other qos-groups minus 18.880KB times the number of qos-groups. The default QoS policy for the Cisco Nexus device does not create class-fcoe and does not reserve buffer and qos-group for FCoE traffic.
The transmit and receive directions are separately configurable. By default, link-level flow control is disabled for both directions. On the Cisco Nexus device, Ethernet interfaces do not automatically detect the link-level flow control capability. You must configure the capability explicitly on the Ethernet interfaces.
Extender and from 2560 to 652800 for all other supported Fabric Extenders. This example shows how to restore the default queue limit on a Cisco Nexus 2248T Fabric Extender: switch# configure terminal switch(config-if)# fex 101 switch(config-fex)# hardware N2248T queue-limit 327680 Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1)
Configuring Queuing and Flow Control Configuring No-Drop Buffer Thresholds This example shows how to remove the queue limit that is set by default on a Cisco Nexus 2248T Fabric Extender: switch# configure terminal switch(config)# fex 101 switch(config-fex)# no hardware N2248T queue-limit 327680 Configuring No-Drop Buffer Thresholds You can configure the no-drop buffer threshold settings for 3000m lossless Ethernet.
Exits class mode. Step 7 switch(config-pmap-nq)# exit Exits policy-map network-qos mode. This example shows how to configure the no-drop buffer threshold for the Cisco Nexus device for 3000 meters. switch(config-pmap-nq)# policy-map type network-qos nqos_policy switch(config-pmap-nq)# class type network-qos nqos_class switch(config-pmap-nq-c)# pause no-drop buffer-size 152000 pause-threshold 103360...
2148T Fabric Extender. The buffer threshold is specified in bytes. The range is from 81920 to 316160 for the Cisco Nexus 2148T Fabric Extender. This example shows how to restore the default buffer threshold on the Cisco Nexus 2148T Fabric Extender: switch# configure terminal switch(config)# fex 101...
The transmit and receive directions are separately configurable. By default, link-level flow control is disabled for both directions. On the Cisco Nexus device, Ethernet interfaces do not automatically detect the link-level flow control capability. You must configure the capability explicitly on the Ethernet interfaces.
You can disable slow port pruning on multicast packets. An interface on the Cisco Nexus 5500 Series device can become congested when it receives excessive multicast traffic or when the mixed unicast and multicast traffic rate exceeds the port bandwidth. When multiple interfaces receive the same multicast flow and one or more ports experience congestion, the slow port prunning feature allows the switch to drop only the multicast packets for the congested port.
Configuring Queuing and Flow Control Verifying the Queue and Flow Control Configurations This example shows how to disable slow port pruning on a Cisco Nexus 5548 switch: switch(config)# hardware multicast disable-slow-port-pruning switch(config)# Verifying the Queue and Flow Control Configurations Use one of the following commands to verify the configuration:...
Page 78
Configuring Queuing and Flow Control Verifying the Queue and Flow Control Configurations Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
QoS Example 1 This example shows how to configure traffic in the entire system matching an access control list to have the frame CoS fields rewritten to the value 5. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
QoS Example 2 This example shows how to use an access control list to apply 50% bandwidth to traffic on Ethernet interface 1/3 that matches traffic on Ethernet interface 1/1. Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 81
(config-pmap-c-que)# bandwidth percent 10 (config-pmap-c-que)# exit (config-pmap-que)# class type queuing class-fcoe (config-pmap-c-que)# bandwidth percent 40 (config-pmap-c-que)# exit (config-pmap-que)# class type queuing cmap-que-bandwidth (config-pmap-c-que)# bandwidth percent 50 (config-pmap-c-que)# exit (config-pmap-que)# exit Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Step 1 Set up the ingress classification policy (the (config)# interface Ethernet 1/15 access control list was defined previously). (config-if)# untagged cos 3 (config-if)# priority-flow-control mode (config-if)# exit Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01...
Page 83
3 ingress CPU traffic classification policies interface QoS configuration verifying interface QoS policies precedence of interface QoS TCAM limit 53, 54 default system service policies changing restoring Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01 IN-1...
Page 84
QoS configuration quality of service verifying system QoS policies precedence of system service policy attaching policy Fibre Channel interfaces policy map configuration verifying Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) IN-2 OL-26657-01...
Page 85
VACLs precedence of 50, 51 precedence of VLANs 49, 55 verifying 16, 24, 32, 41, 47, 56, 67 classification configuration removing a service policy from flow control Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) OL-26657-01 IN-3...
Page 86
Index Cisco Nexus 5000 NX-OS Quality of Service Configuration Guide, Release 5.1(3)N2(1) IN-4 OL-26657-01...