Brocade Communications Systems Brocade ICX 6650 53-1002599-01 User Manuals

Table of Contents

• Contents

  3
  • About This Document

    3
  • Index

    6
• Figures

  7
• Tables

  9
• About This Document

  11
  • Audience

    11
  • Supported hardware and software

    11
• Brocade ICX 6650 slot and Ethernet port numbering

  11
  • • Slot 2 is located on the back of the ICX 6650 device and contains ports 1 through 3 on the top row and port 4 on the bottom row. These ports are 2x40 GbE QSFP+. Refer to the following figure.

    12
  • How this document is organized

    12
  • Document conventions

    13
    • This section describes text formatting conventions and important notice formats used in this document.

      13
    • Text formatting

      13
    • Command syntax conventions

      13
    • Notes, cautions, and warnings

      13
    • A Caution statement alerts you to situations that can be potentially hazardous to you or cause damage to hardware, firmware, software, or data.

      14
    • A Danger statement indicates conditions or situations that can be potentially lethal or extremely hazardous to you. Safety labels are also attached directly to products to warn of these conditions or situations.

      14
  • Notice to the reader

    14
  • Related publications

    14
  • Additional information

    15
    • This section lists additional Brocade and industry-specific documentation that you might find helpful.

      15
    • Brocade resources

      15
  • Getting technical help

    15
  • Document feedback

    15
    • Chapter

      17
    • 1

      17
  • Brocade ICX 6650 Overview

    17
    • In this chapter

      17
• Brocade ICX 6650 overview

  17
• Views of the Brocade ICX 6650 switch

  18
  • Figure 1 Front view of the Brocade ICX 6650

    18
  • Figure 2 Back view of the Brocade ICX 6650

    18
• Ports-on-Demand licensing

  19
  • Figure 3 Brocade ICX 6650 front-panel ports

    19
  • Figure 4 Brocade ICX 6650 rear-panel ports

    19
  • The breakout ports support either:

    20
    • • Direct-attached copper breakout cables QSPF+ to 4 SFP+ (Part number 40G-QSFP-4SFP-C-/0101/0301/0501)

      20
    • • Breakout capable SR4 QSPF+ optical transceiver (Part number 40G-QSFP-SR4-INT)

      20
• Brocade ICX 6650 slot and Ethernet port numbering

  20
  • • Slot 2 is located on the back of the ICX 6650 device and contains ports 1 through 3 on the top row and port 4 on the bottom row. These ports are 2x40 GbE QSFP+. Refer to the following figure.

    20
• Supported transceivers and cables

  21
• Breakout cables

  22
  • The rear panel of the Brocade ICX 6650 device contains two 4x10 GbE ports which support the following:

    22
    • • QSFP+ to 4 SFP+ (4 x 10 GbE) direct attach copper breakout cables (see Figure 5)

      22
      • Figure 5 QSFP+ to 4 SFP+ (4 x 10 GbE) direct attach copper breakout cable

        22
      • Figure 6 QSFP+ (MTP 1 x 8 or 1 x 12) optical breakout cable

        22
  • Chapter

    23
  • 2

    23
  • Installing the Brocade ICX 6650

    23
    • In this chapter

      23
      • The procedures in this manual are intended for qualified service personnel.

        23
      • Before beginning the installation, see the precautions in “Power precautions” on page 11.

        23
• Unpacking the device

  23
  • Package contents

    23
• Installation and safety considerations

  24
  • Electrical considerations

    24
  • Environmental considerations

    24
  • Location Considerations

    24
  • Cabinet considerations

    25
  • Recommendations for cable management

    25
• Installation tasks

  26
  • Table 1 Installation tasks

    26
• Installation precautions

  26
  • General precautions

    26
    • All fiber-optic interfaces use Class 1 lasers.

      26
    • Do not install the device in an environment where the operating ambient temperature might exceed 40o C (104o F).

      27
    • Make sure the air flow around the front and sides of the device is not restricted.

      27
    • Never leave tools inside the device.

      27
    • Risk of explosion if battery is replaced by an incorrect type. Dispose of used batteries according to the instructions.

      27
  • Lifting precautions

    27
    • Make sure the rack or cabinet housing the device is adequately secured to prevent it from becoming unstable or falling over.

      27
  • Power precautions

    27
    • Use a separate branch circuit for each AC power cord, which provides redundancy in case one of the circuits fails.

      27
    • To avoid high voltage shock, do not open the device while the power is on.

      27
    • Ensure that the device does not overload the power circuits, wiring, and over-current protection. To determine the possibility of overloading the supply circuits, add the ampere (amp) ratings of all devices installed on the same circuit as the device...

      28
    • Disconnect the power cord from all power sources to completely remove power from the device.

      28
    • If the installation requires a different power cord than the one supplied with the device, make sure you use a power cord displaying the mark of the safety agency that defines the regulations for power cords in your country. The mark is your assuranc...

      28
• Installing the device in a rack or cabinet

  28
  • Make sure the rack or cabinet housing the device is adequately secured to prevent it from becoming unstable or falling over.

    28
    • Before mounting the switch in a rack, pay particular attention to the following factors:

      28
  • 2-Post rack mount installation

    29
    • Figure 7 2-post screws and retainer nuts

      29
      • 1. Attach the mounting brackets to the sides of the device as illustrated in Figure 8 using the 8-32 x 5/16 in. screws.

        29
    • Figure 8 Attaching the brackets for Brocade ICX 6650 devices

      29
      • 2. Position the switch in the cabinet, providing temporary support under the switch until the rail kit is secured to the cabinet.

        30
      • 3. Attach the front right bracket to the rail rack using two 10-32 x 5/8 in. screws and the appropriate round or square retainer nuts.

        30
      • 4. Repeat step 3 to attach the left front bracket to the left front rack rail and tighten all 10-32 x 5/8 in. screws to a torque of 25 in-lb (29 cm-kg). See Figure 9.

        30
    • Figure 9 Installing the device in a 2-post rack

      30
      • 5. Proceed to “Attaching a PC or terminal” on page 17.

        30
  • 4-Post rack mount installation

    30
    • Kits for 4-post rack mounting are not included in the shipping carton and must be ordered separately.

      30
    • Remove the rack mount kit from the shipping carton. The kit contains the following:

      31
      • • Two L-shaped mounting brackets.

        31
      • • Four rack mount rails: two for side attach and two for rear attach racks.

        31
      • • Thirty-two 8-32 x 5/16 in., panhead Phillips screws with patchlocks.

        31
        • Figure 10 4-post screws and retainer nuts

          31
    • Do not use the hardware supplied in a 2-post rack mounting kit to mount a Brocade ICX 6650 device in a 4-post rack. Mounting the device in a 4-post rack requires additional hardware to prevent drooping from possible flexing and distortion of the 4-po...

      31
      • 1. Attach the mounting brackets to the sides of the device as illustrated in Figure 8 above using the 8-32 x 5/16 in. screws.

        31
        • 2. Attach the appropriate rails: either side attach or rear attach at determined by the type of rack in which you are installing the device.

          31
        • Figure 11 Optional 4-post Rack Mount Kit, Rear Attach

          32
        • Figure 12 Optional 4-post Rack Mount Kit, Side Attach

          32
          • 3. Position the switch in the cabinet, providing temporary support under the switch until the rail kit is secured to the cabinet.

            32
          • 4. Attach the front right bracket to the rail rack using two 10-32 x 5/8 in. screws and the appropriate round or square retainer nuts.

            32
          • 5. Repeat step 3 to attach the left front bracket to the left front rack rail and tighten all 10-32 x 5/8 in. screws to a torque of 25 in-lb (29 cm-kg). See Figure 9.

            32
          • 6. Attach the rear right bracket to the rail rack using two 10-32 x 5/8 in. screws and the appropriate round or square retainer nuts.

            33
          • 7. Repeat step 6 to attach the left front bracket to the left front rack rail and tighten all 10-32 x 5/8 in. screws to a torque of 25 in-lb (29 cm-kg).

            33
          • 8. Proceed to “Attaching a PC or terminal” on page 17.

            33
• Attaching a PC or terminal

  33
  • Use the following steps to attach a management station to the console port:

    33
  • 1. Connect a PC or terminal to the console management port on the back of the ICX 6650 device using the mini-USB serial console port cable (Part number 50-1000059-01.

    33
    • 2. Launch the terminal emulation program and set the following session parameters:

      33
• Powering on the system

  33
  • 1. Remove the power cable from the shipping package.

    33
    • 2. Attach the AC power cable to the AC connector on the rear panel.

      33
    • 3. Insert the power cable plug into a 100V-240V outlet.

      33
• Installing an SFP+ transceiver

  34
  • 1. Remove any protector plugs from the transceivers and the ports.

    34
    • 2. Making sure that the bail (wire handle) is in the unlocked position, place the SFP+ transceiver in the correctly oriented position on the port, as shown in Figure 13.

      34
    • 3. Slide the SFP+ transceiver into the port until you feel it click into place; then close the bail.

      34
    • Figure 13 Installing an SFP+ transceiver in a port slot

      34
  • Chapter

    35
  • 3

    35
  • Configuring the Brocade ICX 6650

    35
    • In this chapter

      35
• Brocade ICX 6650 slot and Ethernet port numbering

  35
  • • Slot 2 is located on the back of the ICX 6650 device and contains ports 1 through 3 on the top row and port 4 on the bottom row. These ports are 2x40 GbE QSFP+. Refer to the following figure.

    36
• Assigning permanent passwords

  36
  • Setting passwords

    37
    • 1. At the opening CLI prompt, enter the following command to change to the Privileged level of the EXEC mode:

      37
      • 2. Access the CONFIG level of the CLI by entering the following command:

        37
      • 3. Enter the following command to set the super user password:

        37
      • 4. Enter the following commands to set the port configuration and read-only passwords:

        37
  • Recovering from a lost password

    37
    • 1. Start a CLI session over the serial interface to the Brocade device.

      37
      • 2. Reboot the device.

        37
      • 3. While the system is booting, before the initial system prompt appears, enter b to enter the boot monitor mode.

        37
      • 4. Enter no password at the prompt. (You cannot abbreviate this command.)

        37
• Configuring IP addresses

  38
  • Devices running Layer 2 software

    38
    • 1. At the opening CLI prompt, enter enable.

      38
      • 2. Enter the following command at the CLI Privileged EXEC level prompt, then press Enter. This command erases the factory test configuration if still present:

        38
    • Use the erase startup-config command only for new systems. If you enter this command on a system you have already configured, the command erases the configuration. If you accidentally do erase the configuration on a configured system, enter the write...

      38
      • 3. Access the configuration level of the CLI by entering the following command:

        38
      • 4. Configure the IP addresses and mask for the switch.

        38
      • 5. Set a default gateway address for the switch.

        38
  • Devices running Layer 3 software

    39
    • 1. At the opening CLI prompt, enter enable.

      39
      • 2. Enter the following command at the CLI Privileged EXEC level prompt, then press Enter. This command erases the factory test configuration if still present:

        39
    • Use the erase startup-config command only for new systems. If you enter this command on a system you have already configured, the command erases the configuration. If you accidentally do erase the configuration on a configured system, enter the write...

      39
      • 3. Access the configuration level of the CLI by entering the following command:

        39
      • 4. Configure the IP addresses and mask addresses for the interfaces on the router.

        39
• Connecting network devices

  42
  • Connectors

    42
  • Connecting a network device to a fiber port

    42
    • All fiber optic interfaces use Class 1 lasers.

      43
      • 1. Put on the ESD wrist strap and ground yourself by attaching the clip end to a metal surface (such as an equipment rack) to act as ground.

        43
        • 2. Remove the new transceiver from the protective packaging.

          43
        • 3. Gently insert the transceiver into the slot until it clicks into place. Transceivers are keyed to prevent incorrect insertion.

          43
      • 1. Remove the protective covering from the fiber-optic port connectors and store the covering for future use.

        43
        • 2. Before cabling a fiber optic transceiver, Brocade strongly recommends cleaning the cable connectors and the port connectors. For more information, refer to “Cleaning the fiber optic connectors” on page 27.

          43
        • 3. Gently insert the cable connector (a tab on each connector should face upward) into the transceiver connector until the tabs lock into place.

          43
        • 4. Observe the link and active LEDs to determine if the network connections are functioning properly. For more information about the LED indicators, refer to “LED activity interpretation” on page 29.

          43
• Testing connectivity

  44
  • Test for connectivity by observing the LEDs related to network connection.

    44
  • Pinging an IP address

    44
  • Tracing a route

    44
• Troubleshooting network connections

  44
  • Chapter

    45
  • 4

    45
  • Brocade ICX 6650 Operation

    45
    • In this chapter

      45
• LED activity interpretation

  45
• Brocade ICX 6650 front panel LEDs

  45
  • Figure 14 Brocade ICX 6650 front panel LEDs and port numbering

    46
• Brocade ICX 6650 rear panel LEDs

  47
  • The Brocade ICX 6650 has the following LEDs on the rear panel:

    47
    • • Six 40 GbE QSFP+ port status LEDs (green).

      47
    • • One DIAG LED bicolor status LED (green and amber).

      47
    • • Two Management port status LEDs

      47
      • Figure 15 Brocade ICX 6650 rear panel LEDs and port number

        47
• LED patterns

  48
  • The following sections describe the Brocade ICX 6650 LED patterns.

    48
• Brocade ICX 6650 maintenance

  49
  • The ICX 6650 is designed for high availability and low failure; it does not require any regular physical maintenance. Supported transceivers and diagnostic tests are described in the following sections.

    49
• Diagnostic tests and monitoring

  49
  • Chapter

    51
  • 5

    51
  • Managing the Brocade ICX 6650

    51
    • In this chapter

      51
      • The procedures in this chapter are for qualified service personnel.

        51
• Managing temperature settings

  51
  • Displaying the temperature

    52
  • Displaying Syslog messages for temperature

    53
  • Changing the temperature warning level

    53
  • Changing the temperature poll time

    53
• Removing MAC address entries

  54
• Displaying Brocade ICX 6650 CPU usage

  54
• Hardware maintenance schedule

  54
• Replacing a copper or fiber optic module

  55
  • Removing a copper or fiber optic module

    55
    • For safety reasons, the ESD wrist strap should contain a series 1 megohm resistor.

      55
      • To remove a copper or fiber optic module from an SFP slot, do the following.

        55
      • 1. Put on the ESD wrist strap and ground yourself by attaching the clip end to a metal surface (such as an equipment rack).

        55
        • 2. Disconnect the copper or fiber cable connector from the port connector.

          55
        • 3. Unlock the copper or fiber optic module by pulling the bail latch forward, away from the front panel of the module.

          55
        • Figure 16 Unlocking the bail latch

          55
          • 4. Grasp the bail latch and pull the copper or fiber optic module out of the port.

            56
        • Figure 17 Remove fiber optic module

          56
          • 5. Store the copper or fiber optic module in a safe, static-free place or in an anti-static bag.

            56
          • 6. Install a new copper or fiber optic module in the port.

            56
  • Cabling a fiber optic module

    56
  • Cleaning the fiber optic connectors

    56
• FRU removal and replacement procedures

  56
  • This document describes how to change FRUs for units with either an air intake or air exhaust. You must replace a failed FRU with a FRU of the same type. This applies to both power supplies and fans. A new FRU must have the same part number (P/N) as ...

    56
    • Figure 18 Examples of airflow symbols

      57
• Replacing a power supply unit

  57
  • Remove the power cord from a power supply before you install it in or remove it from the device. Otherwise, the power supply or the device could be damaged as a result. (The device can be running while a power supply is being installed or removed, bu...

    57
  • For the Brocade ICX 6650 devices, be sure that the airflow direction of the power supply unit matches that of the installed fan tray. The power supplies and fan trays are clearly labeled with either a green arrow with an “E”, or an orange arrow w...

    57
  • Because the cooling system relies on pressurized air, do not leave any of the power supply and fan assembly slots empty longer than two minutes while the switch is operating. If a power supply or fan assembly fails, leave it in the switch until it ca...

    57
  • Disassembling any part of the power supply and fan assembly voids the warranty and regulatory certifications. There are no user-serviceable parts inside the power supply and fan assembly.

    58
    • Table 2 Power supply status LED behavior, description, and required actions

      58
  • Determining the need to replace a power supply

    58
  • Time and items required

    58
  • Replacing a power supply

    58
    • 1. To leave the Brocade ICX 6650 in service while replacing a power supply, verify that the other power supply (the one not being replaced) has been powered on for at least four seconds and has a steady green status LED.

      58
      • 2. Before opening the package that contains the power supply, touch the bag to the switch casing to discharge any potential static electricity. Brocade recommends using an ESD wrist strap during installation.

        58
      • 3. Remove the power supply from the anti-static shielded bag.

        58
      • 4. Ensure that the replacement power supply has the same part number and airflow label as the power supply being replaced.

        59
      • 5. Unplug the power cord from the power supply that is being replaced.

        59
      • 6. Using the Phillips screwdriver, unscrew the two captive screws on the power supply.

        59
      • 7. Remove the power supply from the chassis by pulling the handle on the power supply out and away from the chassis.

        59
      • 8. Holding the power supply level, guide it into the carrier rails on each side and gently push it all the way into the slot, ensuring that it firmly engages with the connector.

        59
      • 9. When you are sure the power supply has properly engaged the connector, tighten the retainer screws to secure the power supply in the slot.

        59
      • 10. Plug the power cord into the power supply to power on the unit.

        59
      • 11. Verify that the LED on the new power supply displays steady green while the Brocade ICX 6650 is operating (see Table 2). If the LED is not steady green, ensure that the power supply is securely installed and seated properly.

        59
    • Do not force the installation. If the power supply does not slide in easily, ensure that the power supply is correctly oriented before continuing.

      59
• Replacing fan trays

  59
  • For the Brocade ICX 6650 devices, be sure that the airflow direction of the fan tray matches that of the installed power supply unit. The power supplies and fan trays are clearly labeled with either a green arrow with an “E”, or an orange arrow w...

    59
  • Because the cooling system relies on pressurized air, do not leave any of the power supply and fan assembly slots empty longer than two minutes while the switch is operating. If a power supply or fan assembly fails, leave it in the switch until it ca...

    59
  • Disassembling any part of the power supply and fan assembly voids the warranty and regulatory certifications. There are no user-serviceable parts inside the power supply and fan assembly.

    60
  • Determining the need to replace a fan assembly

    60
  • Time and items required

    60
  • Replacing the fan assembly

    60
    • 1. Using the Phillips screwdriver, unscrew the captive screw on the fan assembly.

      60
      • 2. Before opening the package that contains the new fan tray, touch the bag to the switch casing to discharge any potential static electricity. It is recommended that you wear an ESD wrist strap during installation.

        60
      • 3. Remove the fan tray from the anti-static shielded bag.

        60
      • 4. Ensure that the replacement fan assembly has the same part number and airflow label as the fan assembly being replaced.

        60
      • 5. Remove the fan assembly from the chassis by pulling the handle on the fan assembly out and away from the chassis.

        60
      • 6. Holding the fan tray level, guide it into the carrier rails on each side and gently push it all the way into the slot, ensuring that it firmly engages with the connector.

        60
      • 7. When you are sure the fan tray has properly engaged the connector, tighten the retainer screws to secure the fan tray in the slot.

        60
    • Do not force the installation. If the fan assembly does not slide in easily, ensure that it is correctly oriented before continuing.

      60
    • Appendix

      61
    • A

      61
    • Brocade ICX 6650 Specifications

      61
      • In this appendix

        61
• Weight and physical dimensions

  61
  • Table 3 Physical specifications

    61
• Environmental considerations

  62
  • Table 4 Environmental requirements

    62
• Cooling system and fans

  62
  • Be sure that the airflow direction of the power supply unit matches that of the installed fan tray. The power supplies and fan trays are clearly labeled with either a green arrow with an “E” for exhaust, or an orange arrow with an “I” for intake

    62
    • Figure 19 Brocade ICX 6650 airflow — front to back (with E-labeled power supply and fan tray)

      63
    • Figure 20 Exhaust airflow label

      63
    • Figure 21 Brocade ICX 6650 airflow — back to front (with I-labeled power supply and fan tray)

      64
    • Figure 22 Intake airflow label

      64
• Power supply specifications

  65
  • Table 5 Power state definitions

    65
  • Table 6 System power specifications

    65
• General specifications

  65
  • Table 7 General specifications

    65
• Supported media types

  66
• Pinouts and signalling

  66
  • Table 8 Mini-USB serial RJ45 management port pinouts

    66
• Memory specifications

  66
  • The Brocade ICX 6650 has two types of memory devices: boot flash, and main memory. The size of each is listed in Table 9.

    66
  • Table 9 Brocade ICX 6650memory specifications

    66
  • Appendix

    67
  • B

    67
  • Brocade ICX 6650 Regulatory Statements

    67
    • In this appendix

      67
• USA (FCC CFR 47 Part 15 Warning)

  67
  • Changes or modifications made to this device which are not expressly approved by Brocade could void the user’s authority to operate the equipment.

    67
• Industry Canada statement

  67
• Europe and Australia (CISPR 22 Class A Warning)

  68
• Germany (Noise Warning)

  68
• Japan (VCCI)

  68
• Japan power cord

  69
• Korea

  69
• China

  70
• BSMI statement (Taiwan)

  71
• Regulatory compliance

  71
  • Table 10 Regulatory Compliance and Safety Approvals

    71
  • Appendix

    73
  • C

    73
  • Brocade ICX 6650 Cautions and Danger Notices

    73
    • In this appendix

      73
• Cautions

  73
• Danger notices

  78
  • Index

    83