Benutzerhandbuch für APC 15000 RAID

Inhaltsverzeichnis

• SGI® InfiniteStorage 15000 RAID User’s Guide

  1
  • Preface

    7
  • International Standards

    7
  • Potential for Radio Frequency Interference

    7
  • Note This equipment has been tested and found to comply with the limits for a class A digital device, pursuant to Part 15 of the...

    7
    • European Regulations

      8
    • Qualified Personnel

      8
    • Safe Handling

      8
    • Safety

      9
  • Important SGI InfiniteStorage 15000 drive enclosures must be always installed in SGI InfiniteStorage 15000 racks. SGI does not a...

    9
  • Warning The SGI InfiniteStorage 15000 MUST be grounded before applying power.

    9
    • Caution Plug-in modules are part of the fire enclosure and must only be removed when a replacement can be immediately added. The system must not be run without all units in place. Operate the system with the enclosure top cover closed.

      9
  • Warning To ensure protection against electric shock caused by HIGH LEAKAGE CURRENT (TOUCH CURRENT), the SGI InfiniteStorage 15000 must be connected to at least two separate and independent sources. This is to ensure a reliable earth connection.

    9
  • Warning To ensure your system has warning of a power failure please disconnect the power from the power supply, by either the switch (where present) or by physically removing the power source, prior to removing the PCM from the enclosure/shelf.

    10
  • Warning Do not remove covers from the PCM. Danger of electric shock inside. Return the PCM to your supplier for repair.

    10
  • Warning Operation of the Enclosure with ANY modules missing will disrupt the airflow and the drives will not receive sufficient cooling. It is ESSENTIAL that all apertures are filled before operating the unit.

    11
    • Recycling of Waste Electrical and Electronic Equipment (WEEE)

      11
  • Important Observe all applicable safety precautions, e.g. weight restrictions, handling batteries and lasers etc., detailed in the preceding paragraphs when dismantling and disposing of this equipment

    11
    • Rack System Precautions

      11
  • Important SGI InfiniteStorage 15000 drive enclosures should only be installed in SGI InfiniteStorage 15000 racks. Mounting and installing these drive enclosures in any other rack is not authorized or supported by SGI.

    11
  • Warning It is recommended that you do not slide more than one enclosure out of the rack at a time, to avoid danger of the rack tipping over.

    11
    • ESD Precautions

      12
    • Caution It is recommended that you fit and check a suitable anti-static wrist or ankle strap and observe all conventional ESD precautions when handling plug-in modules and components. Avoid contact with backplane components and module connectors, etc.

      12
      • Data Security

        12
        • Chapter 1

          15
      • Introduction

        15
• 1.1 Controller Features

  15
• 1.2 The Controller Hardware

  16
  • Figure 1-1 SGI InfiniteStorage 15000 IB - Front and Rear Views

    17
  • 1.2.1 Power Supply and Fan Modules

    18
    • Figure 1-2 Fan Module (front panel)

      18
  • 1.2.2 I/O Connectors and Status LED Indicators

    19
    • Figure 1-3 I/O Ports on the Rear Panel of the Controller

      19
    • Figure 1-4 Host Port LEDs

      20
    • Figure 1-5 LED Status Indicators - Rear Panel of the Controller

      21
    • Table 1-1 LED Indicators

      22
  • 1.2.3 Uninterruptible Power Supply (UPS)

    23
    • Chapter 2

      25
    • Controller Installation

      25
      • 1. Unpack the controller system.

        25
      • 2. If it is necessary to install the controller in the 19-inch cabinet(s), contact your service provider.

        25
      • 3. Set up and connect the drive enclosures to the controller.

        25
      • 4. Connect the controller to your Infiniband (IB) or Fibre Channel (FC) switch and host computer(s).

        25
      • 5. Connect your RS-232 terminal to the controller.

        25
      • 6. Power up the system.

        25
      • 7. Configure the storage array (create and format LUNs - Logical Units) via RS-232 interface, Telnet, or GUI.

        25
      • 8. Define and provide access rights for the clients in your SAN environment. Shared LUNs need to be managed by SAN management software. Individual dedicated LUNs appear to the client as local storage and do not require management software.

        25
      • 9. Initialize the system LUNs for use with your server/client systems. Partition disk space and create file systems as needed.

        25
• 2.1 Setting Up the Controller

  25
• 2.2 Unpacking the System

  26
  • 2.2.1 Rack-Mounting the Controller Chassis

    26
  • 2.2.2 Connecting the Controller in Dual Mode

    26
    • 1. Connect the LINK ports on the two controller units using the supplied cable.

      26
    • 2. Connect the COM ports on the two units using the supplied cable.

      26
  • 2.2.3 Connecting the Controller

    27
    • 1. There are 10 disk channels on the controller. They correspond with disk ports. The disk ports are labeled as follows (Figure ...

      27
    • Figure 2-1 I/O Connectors

      27
      • 2. Each controller supports up to four host connections. You may connect more than four client systems to the controller using switches and you can restrict user access to the LUNs (as described in Section 2.3 "Configuring the Controller" of this guide).

        27
  • 2.2.4 Selecting SAS- ID for Your Drives

    27
  • 2.2.5 Laying Out your Storage Drives

    27
  • 2.2.6 Connecting the RS-232 Terminal

    28
    • 1. Connect your terminal to the CLI port at the back of the controller using a standard DB-9 female- to-male null modem cable (Figure 2-2).

      28
    • Figure 2-2 Controller CLI Port

      28
      • 2. Open the terminal window.

        28
      • 3. Use the following settings for your serial port:

        28
    • 2.2.6.1 Basic Key Operations

      28
      • Table 2-1 Basic Key Assignments

        29
  • 2.2.7 Powering On the Controller

    29
    • 1. Verify that the power switches on the two (2) power supply module at the back of each controller are off.

      29
    • 2. Connect the two AC connectors, using the power cords provided at the back to the AC power source for each controller unit. For maximum redundancy, connect the two power connectors to two different AC power circuits for each unit.

      29
    • 3. Check that all your drive enclosures are powered up.

      29
    • 4. Check that the drives are spun up and ready.

      29
    • 5. Turn on the power supplies on the controller unit(s). The controller will undergo a series of system diagnostics and the bootup sequence is displayed on your terminal.

      29
    • 6. Wait until the bootup sequence is complete and the controller system prompt is displayed.

      29
• 2.3 Configuring the Controller

  30
  • 2.3.1 Planning Your Setup and Configuration

    30
    • Figure 2-3 Striping Across Tiers - RAID

      30
  • 2.3.2 Configuration Interface

    31
  • 2.3.3 Login as Administrator

    31
    • 1. At the login prompt, type: login admin<Enter>

      31
    • 2. At the password prompt, type: password<Enter>

      31
  • 2.3.4 Setting System Time & Date

    31
  • 2.3.5 Setting Tier Mapping Mode

    32
    • Figure 2-4 Tier Changemap Screen

      32
      • 1. Enter: tier changemap<Enter>

        32
      • 2. Enter the appropriate mapping mode.

        32
      • 3. For the changes to take effect, enter: restart<Enter>.

        32
  • 2.3.6 Checking Tier Status and Configuration

    33
    • Figure 2-5 Tier Status Screen

      33
      • 1. If a drive is not displayed at all (that is, it is “missing”), check to ensure that the drive is properly seated and in good condition. To search for the drive, enter:

        33
      • 2. If the same channel is missing on all tiers, check the cable connections for that channel.

        33
      • 3. If “automatic disk rebuilding” is not enabled, enable it by entering:

        33
      • 4. To display the detailed disk configuration information for all of the tiers (Figure 2-6) enter:

        33
    • Figure 2-6 Current Tier Configuration

      34
    • 2.3.6.1 Heading Definitions

      34
  • 2.3.7 Cache Coherency and Labeling in Dual Mode

    34
    • Figure 2-7 Dual Controller Configuration

      35
      • 1. To change the label, enter:

        35
      • 2. Select which unit you want to re-label (see Figure 2-8).

        35
      • 3. When prompted, type in the new label for the selected unit. The new name is displayed.

        35
    • Figure 2-8 Labeling a Controller Unit

      35
  • 2.3.8 Configuring the Storage Arrays

    35
    • 1. To display the current cache settings, type: cache<Enter>

      36
    • 2. Select a cache segment size for your array. For example, to set the segment size to 128 KBytes, type:

      36
    • 3. Type: lun<Enter>.

      36
    • 4. To create a new LUN, type: lun add=x<Enter>

      36
    • 5. You will be prompted to enter the parameter values for the LUN. In this example:

      36
    • 6. When you are asked to format the LUN, type: y<Enter>

      36
    • Figure 2-9 Logical Unit Status - Formatting

      37
      • 7. Enter the command LUN to check the status of the LUN, which should be “Ready” (see Figure 2- 10).

        37
    • Figure 2-10 LUN Status - Ready

      37
      • 8. To create the LUN 1, type:

        37
      • 9. Enter these parameters:

        37
  • 2.3.9 Setting Security Levels

    38
    • 2.3.9.1 User Authentication (Recommended for SAN Environment)

      38
      • 1. Enter: zoning<Enter>

        38
      • 2. Check to ensure that the LUN Zoning chart is empty (Figure 2-11).

        39
      • Figure 2-11 LUN Zoning Screen

        39
        • To add a user:

          39
          • 1. Type: user audit=on<Enter> The controller reports which users are connected.

            39
          • 2. Type: user add<Enter>.

            39
          • 3. Specify a new Host User’s world wide name, enter s.

            39
          • 4. Specify a 64-bit world wide name or GUID, taken from the list of available anonymous users.

            39
          • 5. Enter an alias name for the user. The name may contain up to 12 characters. Type in a name and press <Enter>.

            39
          • 6. Host users can have their port access zoned. Enter y to specify host port zoning.

            39
          • 7. For Unit 1, enter each active port on a new line and then exit. For this example, type: 1<Enter> 4<Enter> e<Enter>

            39
          • 8. For Unit 2, enter each active port on a new line and then exit. For this example, type: 1<Enter> 4<Enter> e<Enter>

            39
          • 9. Enter y to specify the unique LUN mapping (Table 2-2).

            39
          • 10. Enter a new unique LUN mapping for this user. Options are shown in Table 2-2 on page 26.

            40
      • Table 2-2 LUN Mapping Options.

        40
        • 11. Connect user 2 and repeat steps 2--10 to specify the host port zoning and LUN mappings with the following changes:

          40
        • 12. To display the new security settings, type:

          40
      • Figure 2-12 Security Settings Screen

        40
    • 2.3.9.2 Host Port Zoning (Anonymous Access)

      41
      • 1. To edit the default zoning on a host port, type: zoning edit<Enter>. The current settings are displayed.

        41
      • 2. Select a host port (1..4): 1<Enter>

        41
      • 3. Specify the internal LUN (0..1023) to be mapped to the external LUN. The new settings will display .

        41
      • 4. Repeat steps 1-3 to configure other host ports.

        41
      • Chapter 3

        43
      • Controller Management

        43
• 3.1 Managing the Controller

  43
  • 3.1.1 Management Interface

    43
• Locally - Serial Interface

  43
  • 1. Connect your terminal to the CLI port at the back of the controller using a standard DB-9 female- to-male null modem cable (Figure 3-1).

    43
  • Figure 3-1 Controller CLI Port

    43
    • 2. Open your terminal window and use these settings for your serial port:

      43
    • 3. With the controller ready, press <Enter> to get the controller prompt.

      44
• Remotely - Telnet

  44
  • 3.1.2 Available Commands

    44
  • 3.1.3 Administrator and User Logins

    44
    • 3.1.3.1 Login

      44
      • 1. To login (Figure 3-2), enter: login<Enter>

        44
      • 2. Enter a login name.

        44
      • 3. Enter a password (see Figure 3-2).

        44
      • Figure 3-2 Login Screen

        45
    • 3.1.3.2 Logout

      45
    • 3.1.3.3 Password

      45
      • Figure 3-3 Password Configuration Screen

        45
    • 3.1.3.4 Who Am I

      45
      • Figure 3-4 WHOAMI Screen

        46
  • 3.2 Configuration Management

    46
    • Table 3-1 Controller Limits

      46
    • 3.2.1 Configure and Monitor Status of Host Ports

      46
      • Figure 3-5 FC Host Ports Configuration Screen

        47
      • Figure 3-6 IB Host Ports Configuration Screen

        47
      • 3.2.1.1 Host ID

        47
• Host WWN

  47
  • 3.2.1.2 Host Status

    47
    • Figure 3-7 IB Host Ports Status Screen

      48
  • 3.2.1.3 Host IB Users

    48
    • Figure 3-8 Host IB Users Screen

      48
  • 3.2.1.4 Host Port Speed

    48
  • 3.2.2 Configure and Monitor Status of Storage Assets

    48
• Disk and Channel Information

  48
  • Figure 3-9 Disk Channel Screen

    49
  • Figure 3-10 Disk Status Screen

    49
  • Figure 3-11 Disk Defect List Screen

    50
  • Table 3-2 PHY Link Error Status Block Information

    51
  • Figure 3-12 Disk PLS Tier 1 Status Screen

    52
  • 3.2.2.1 Tier View

    52
  • 3.2.2.2 Tier Configuration

    53
    • Figure 3-13 Tier Configuration Screen

      53
      • These headings indicate the respective conditions on the tier.

        53
    • Figure 3-14 Tier Configuration ALL Screen

      54
  • 3.2.2.3 LUN View

    54
    • Figure 3-15 LUN Status Screen

      54
    • Figure 3-16 LUN List Screen

      55
  • 3.2.2.4 LUN Configuration

    55
    • Figure 3-17 LUN Configuration Screen

      55
  • 3.2.2.5 LUN Reservations

    55
    • Figure 3-18 LUN Reservations Screen

      55
  • 3.2.2.6 Adding/Removing Storage Assets

    55
  • 3.2.2.7 Status of Drive Enclosures

    56
    • Figure 3-19 Displaying the Current Disk Enclosure Failures

      56
  • 3.2.2.8 Display SES Devices Information

    56
  • 3.2.2.9 Visual Indication of Drive

    56
  • 3.2.2.10 Visual Indication of Tier

    56
  • 3.2.2.11 Visual Indication of Channel

    56
  • 3.2.3 Tier Mapping for Enclosures

    56
    • TIER CHANGEMAP changes the current tier mapping for the disks in the array. To change the current tier mapping, do the following:

      57
      • 1. Enter: tier changemap<Enter>

        57
      • 2. Select the appropriate mapping mode for your drive enclosures and press <Enter>.

        57
      • 3. For the changes to take effect, enter: restart<Enter>.

        57
  • 3.2.4 System Network Configuration

    57
    • 3.2.4.1 Telnet

      57
    • 3.2.4.2 SNMP & Syslog

      58
    • 3.2.4.3 API Server Connections

      58
    • 3.2.4.4 Displaying and Editing the Routing Table

      59
      • Figure 3-20 Routing Table

        59
  • 3.2.5 Restarting the Controller

    59
    • 3.2.5.1 System Restart

      59
    • 3.2.5.2 System Shutdown

      60
  • 3.2.6 Setting the System’s Date and Time

    60
    • 3.2.6.1 System Date

      60
    • 3.2.6.2 System Time

      61
  • 3.2.7 Saving the Controller’s Configuration

    61
    • Figure 3-21 Saving System Parameters Screen

      61
    • Figure 3-22 Current System Parameters Status Screen

      61
  • 3.2.8 Restoring the System’s Default Configuration

    61
  • 3.2.9 LUN Management

    62
    • 3.2.9.1 Configuring the Storage Array

      62
      • Figure 3-23 Logical Unit Status Screen

        62
    • 3.2.9.2 Creating a LUN

      62
      • The required LUN information includes:

        63
    • 3.2.9.3 Formatting a LUN

      63
    • 3.2.9.4 Interrupting a LUN Format Operation

      63
    • 3.2.9.5 Changing a LUN Label

      63
      • 1. Type:

        63
      • 2. Select the LUN to change <0..1023> and press Enter.

        63
      • 3. Type in the new label and press Enter. A LUN label may contain up to 12 characters (Figure 3-24).

        63
      • Figure 3-24 Changing a LUN Label Screen

        64
    • 3.2.9.6 Moving a LUN (Dual Mode Only)

      64
      • Figure 3-25 Moving a LUN

        64
    • 3.2.9.7 Deleting a LUN

      64
• SCSI Reservations

  64
  • 3.2.10 Automatic Drive Rebuild

    64
    • Figure 3-26 Automatic Disk Rebuilding Parameter

      65
    • 3.2.10.1 Manual Drive Rebuild

      65
    • 3.2.10.2 Drive Rebuild Verify

      65
    • 3.2.10.3 Manual Drive Replace

      65
    • 3.2.10.4 Interrupting a Rebuild Operation

      65
  • 3.2.11 SMART Command

    65
  • 3.2.12 Couplet Controller Configuration (Cache/Non-Cache Coherent)

    67
    • Figure 3-27 Couplet Controller Configuration

      67
    • 3.2.12.1 Cache Coherent

      67
• Non-Cache Coherent

  67
  • 3.2.12.2 Fail / Restore the Other Controller Unit in the Couplet Pair

    68
  • 3.2.12.3 Labeling the Controller Unit(s)

    68
    • 1. Type: dual label=1|2 <Enter>.

      68
    • 2. Select which unit you want to rename (Figure 3-28).

      68
    • 3. When prompted, type in the new label for the selected unit. The new name is displayed.

      68
    • Figure 3-28 Labeling a Controller Unit

      69
  • 3.2.12.4 Singlet

    69
  • 3.3 Performance Management

    69
    • 3.3.1 Optimizing I/O Request Patterns

      69
• Display Current Cache Settings

  69
  • Figure 3-29 Cache Setting Screen

    70
  • 3.3.1.1 Cache Segment Size

    70
  • 3.3.1.2 Writeback Cache Settings

    70
  • 3.3.1.3 Prefetch Settings

    70
  • 3.3.1.4 Cache Settings Reset

    71
• Disk Configuration Settings

  71
  • Figure 3-30 Disk Configuration Setting Screen

    71
  • 3.3.2 Audio/Visual Settings of the System

    72
    • Figure 3-31 Current Audio/Visual Settings

      72
  • 3.3.3 Locking LUN in Cache

    73
    • 3.3.3.1 Locking / Unlocking a LUN

      74
      • Figure 3-32 Logical Unit Status - LUN Locked in Cache

        74
    • 3.3.3.2 System Performance Statistics

      74
      • Figure 3-33 System Performance Statistics Screen

        75
      • Figure 3-34 Command Delay Statistics Screen

        76
      • Figure 3-35 Host Delay Statistics Screen

        77
        • STATS TIERDELAY=<tier> displays a histogram of the time it takes for the disk I/O request to complete for all the disks in the specified tier (Figure 3-36). If no tier is specified, all valid tiers will be displayed.

          77
      • Figure 3-36 Tier Delay Statistics Screen

        77
      • Figure 3-37 Host Command Offsets Screen

        78
      • Figure 3-38 Dual Message Statistics Screen

        79
        • STATS LENGTH displays a histogram of the length of the host I/O requests in 16 kb intervals (Figure 3-39).

          79
      • Figure 3-39 Command Length Statistics Screen

        79
      • Figure 3-40 Host Command Offsets Screen

        80
  • 3.3.4 Resources Allocation

    80
• Background Format/Rebuild Operations

  80
  • Figure 3-41 Displaying the Current Rebuild Parameters

    80
  • 3.3.4.1 Background LUN Verify Operations

    81
  • 3.3.4.2 Background TIER Verify Operations

    81
    • 1. At the prompt, type TIER VERIFY=ON <Enter>.

      82
    • 2. The system will ask which tier you wish to verify. Enter the tier number or type a for “All.”

      82
    • 3. The system will ask if you want run the Tier Verify operation continuously or not. Type y to run continuously or N to run just once. The default is N.

      82
    • Figure 3-42 Tier Verify ON Screen

      82
      • 1. At the prompt, type TIER VERIFY=OFF <Enter>.

        82
      • 2. The system will ask which tier you wish to verify. Enter the tier number or type a for “All.”

        82
    • Figure 3-43 Tier Verify OFF Screen

      83
  • 3.3.4.3 Rebuild Journaling

    83
    • Figure 3-44 Sample Tier Journal Command Screen

      85
  • 3.3.4.4 SES Device Monitoring Rate

    85
    • Figure 3-45 SES Device Monitoring Rate

      85
  • 3.3.4.5 Host Command Timeout

    86
  • 3.4 Security Administration

    86
    • Figure 3-46 Mapping Internal LUNs to External LUNs

      86
    • 3.4.1 Monitoring User Logins

      87
      • Figure 3-47 User Login Messages

        87
      • Figure 3-48 User Connections Screen

        87
    • 3.4.2 Zoning (Anonymous Access)

      87
      • Figure 3-49 Current Zoning Configuration Screen

        87
      • Figure 3-50 Edit Zoning Configuration Screen

        88
    • 3.4.3 User Authentication

      88
      • Figure 3-51 User Settings Screen

        88
  • 3.5 Firmware Update Management

    89
    • 3.5.1 Displaying Current Firmware Version

      89
      • Figure 3-52 Version Information Screen

        89
    • 3.5.2 Firmware Update Procedure

      89
      • 1. Collect and save the output of the following commands before you update the firmware: VERSION AV CACHE DISK DISK LIST DUAL HOST HOST STATUS LOG LUN LUN CONFIG NETWORK STATS STATS DELAY STATS TIER DELAY TIER TIER CONFIG

        89
      • 2. Copy the new firmware file to your TFTP server.

        89
      • 3. Connect to the controller via Telnet or serial (CLI port).

        89
      • 4. Enter TFTP

        89
      • 5. You will be asked to confirm action (Figure 3-53). Enter y to continue.

        89
      • Figure 3-53 Downloading Controller Firmware

        90
        • 6. Enter the TFTP server’s IP address: TFTP <IP_address>

          90
        • 7. Enter the firmware path and filename: TFTP <filename>

          90
        • 8. For the couplet controller configuration, connect and log into the other controller. Repeat Steps 4- 7 above to update the firmware.

          90
        • 9. Enter RESTART to restart the unit(s).

          90
        • 10. (For dual mode only): After both controllers are back on-line, use the DUAL command to verify that both controller units are healthy. If either controller shows failed, login to the healthy controller and issue the DUAL HEAL command.

          90
  • 3.6 Remote Login Management

    90
    • Figure 3-54 Telnet Statistics

      91
    • 3.6.1 When a Telnet Session is Active

      91
      • Figure 3-55 Telnet Session Initiated

        91
      • Figure 3-56 Telnet Session Information

        92
      • Figure 3-57 Terminating a Telnet Session

        92
      • Figure 3-58 Telnet Session Being Terminated

        92
  • 3.7 System Logs

    93
    • 3.7.1 Message Log

      93
    • 3.7.2 System and Drive Enclosure Faults

      93
      • Figure 3-59 Current System Faults

        93
        • To display the current SDRAM memory faults (ECC- error controller counters), use FAULTS MEMORY command. To clear the values in the memory faults (ECC) statistics, use FAULTS MEMCLEAR command.

          93
        • To display the current status of the host and disk SFPs, use the FAULTS SFP command.

          93
        • To display the number of LUN array parity errors detected by the system, use the FAULTS ARRAYPARITY command. The system saves th...

          94
        • FAULTS BUSPARITY displays the number of bus parity and data path errors detected by the system.

          94
        • FAULTS BUSPARITYCLEAR clears the count of errors.

          94
        • You may set a parameter (ECCSHUTDOWN) that allows the system to automatically shutdown if it encounters an unrecoverable error. ...

          94
        • The EXCEPTIONSHUTDOWN command parameter allows the system to automatically shutdown if it encounters a task exception.

          94
        • FAULTS EXCEPTIONSHUTDOWN=ON enables automatic shutdown for task exceptions. This is the default setting.

          94
        • The FAULTS EXCEPTIONSHUTDOWN=OFF disables automatic shutdown and allows the system to continue to run in spite of task exceptions.

          94
    • 3.7.3 Displaying System Uptime

      94
      • Figure 3-60 Display System Uptime

        94
    • 3.7.4 Saving a Comment to the Log

      94
  • 3.8 Other Utilities

    95
    • 3.8.1 APC UPS SNMP Trap Monitor

      95
      • Figure 3-61 APC UPS SNMP Trap Monitor Status

        95
    • 3.8.2 API Server Connections

      95
      • Figure 3-62 Displaying Status of API Connections

        95
      • Figure 3-63 API Server Connection Statistics

        95
    • 3.8.3 Changing Baud Rate for the CLI Interface

      95
      • Figure 3-64 Displaying the Serial Console Setting

        96
      • Figure 3-65 Changing the Baud Rate

        96
    • 3.8.4 CLI/Telnet Session Control Settings

      96
      • Figure 3-66 Current Session Control Settings

        96
    • 3.8.5 Disk Diagnostics

      96
    • 3.8.6 Disk Reassignment and Miscellaneous Disk Commands

      97
    • 3.8.7 SPARE Commands

      97
      • Chapter 4

        99
      • Controller Remote Management and Troubleshooting

        99
  • 4.1 Remote Management of the Controller

    99
    • 4.1.1 Network Connection

      99
      • Figure 4-1 Telnet Port on the Controller

        99
    • 4.1.2 Network Interface Set Up

      99
      • 1. Use the NETWORK command to display the current settings (Figure 4-2).

        99
      • 2. Change the controller’s IP address for your network environment: network IP=<new IP address>.

        99
      • 3. Change the netmask of the controller (if needed): network netmask=<new netmask>.

        99
      • 4. Enable the Telnet capability (if needed): network telnet=ON.

        99
      • 5. Decide whether the SNMP functionality should be enabled.

        100
      • Figure 4-2 Current Network Configuration Screen

        100
        • 6. If the SNMP function is enabled, enter the IP address of the computer to be used to monitor the SNMP traps: network trapip=<computer’s IP address>

          100
        • 7. Decide whether the Syslog capability should be enabled. To enable (ON) or disable (OFF) the Syslog, enter: network syslog=on|off

          100
        • 8. If the SYSLOG function is enabled, enter the destination IP address for the Syslog packets: network SYSLOGIP=<destination IP address>

          100
        • 9. The default destination port number for Syslog packets is 514. To change it, enter: network SYSLOGPORT=<port number>

          100
        • 10. Set up the routing table. This table describes how the controller communicates with the hosts on other networks. Use the ROUTE command to display the current settings (Figure 4-3).

          100
      • Figure 4-3 Current Controller Routing Table

        101
        • 11. On boot up, verify the network connections, enter NETWORK PING=<IP address of a network system>.

          101
        • a) Ping a host on the same subnet as the controller.

          101
        • b) Ping another host on a different subnet.

          101
          • 12. Make sure your firewall is running (which will block traffic and keep hosts from talking to each other), ensure it is set up to allow the controller to pass information on Port 23 (for Telnet), Port 161 (for SNMP), and Port 162 (for SNMP traps).

            101
    • 4.1.3 Login Names and Passwords

      101
    • 4.1.4 SNMP Set Up on Host Computer

      102
      • 1. Ensure the host computer, which will receive the traps, has an SNMP browser (such as HP OpenView) properly installed and configured. Refer to your browser’s documentation for instructions on how to load the MIB files.

        102
      • 2. Set up the host computer to listen to Ports 161 and 162.

        102
      • 3. Load the following controller MIB. Note these MIB files:

        102
      • 4. Start a query. You should be able to see various controller information such as tempLevel, powerNumber, fanNumber, powerTable, tierNumber, and tierTable.

        102
      • 5. To verify that the SNMP function has been set up correctly:

        102
      • a) Unplug one of the power supplies.

        102
      • b) Check that a power failure message appears in your SNMP browser.

        102
      • 4.1.4.1 Controller Implementation of SNMP

        102
• InfiniteStorage 15000 MIB (The InfiniteStorage 15000 MIB is read only.)

  102
  • 4.1.4.2 Traps

    103
  • 4.2 Troubleshooting the Controller

    103
    • 4.2.1 Component Failure Recovery

      103
      • 4.2.1.1 Power Supply Failure

        103
        • Figure 4-4 Power Modules - Front View

          103
          • 1. Remove the cover panel (if the panel is installed).

            103
          • 2. Locate the failed power supply module (indicated by an off Status LED).

            103
          • 3. Turn off module’s power switch (found on back of unit).

            103
          • 4. Remove the module’s thumbscrews, then slide the module out of the bay.

            104
          • 5. Slide the module into the bay making sure it is fully inserted. Install the two thumbscrews to secure it.

            104
          • 6. Turn on the power switch. Check that the Status LED is green, indicating that the module is operating normally.

            104
          • 7. Replace the cover panel (if necessary).

            104
      • 4.2.1.2 Fan Failure

        104
        • 1. If a cover panel has been installed, take it off by removing its two thumbscrews.

          104
        • 2. Remove the two thumbscrews from the fan module (Figure 4-5).

          104
        • 3. Slide the module out of its bay.

          104
        • Figure 4-5 Fan Module

          104
          • 4. Slide the new module into the bay, making sure it is fully inserted.

            104
          • 5. Install the thumbscrews to secure it.

            104
          • 6. Replace the cover panel (if necessary).

            104
    • 4.2.2 Recovering from Drive Failures

      104
      • 4.2.2.1 Single Drive Failures

        105
        • Figure 4-6 Obtaining Disk Information

          106
      • 4.2.2.2 Returning the System to a Fault-Tolerant State

        106
        • 1. Enter: diskscan

          106
        • 2. Enter: disk rebuild=<tier><channel>.

          106
      • 4.2.2.3 Manually Replacing a Failed Disk with Spare Disk

        106
      • 4.2.2.4 Changing the Rate of Rebuild

        107
      • 4.2.2.5 Interrupting the Rebuild Operation

        107
      • 4.2.2.6 Multiple Drive and Channel Failures

        107
        • 1. Use the TIER command to check the current disk status and see if the drives failed are all on the same channel.

          107
        • 2. Use the DISK command to check the status of the channel.

          107
        • 1. Contact SGI technical support to determine the cause of error and what steps may need to be taken to recover form the error.

          107
        • 2. Isolate the cause of channel failure (for example, loose cable connections).

          107
        • 3. Rebuild all the drives on that channel individually by issuing the command:

          107
    • 4.2.3 Component Failure on Enclosures

      108
      • Figure 4-7 Example of SES Message

        108
        • If your enclosures provide redundant SES communication paths, the message will be reported twice. “EncID” is the Enclosure Ident...

          108
          • Chapter 5

            109
      • Drive Enclosure System

        109
  • 5.1 The SGI InfiniteStorage 15000 Drive Enclosure

    109
    • Figure 5-1 The Drive Enclosure System - front open view

      109
    • Figure 5-2 The Drive Enclosure System - rear isometric and rear views

      109
    • Figure 5-3 Drive Enclosure Module Locations

      110
  • 5.2 Enclosure Core Product

    110
    • 5.2.1 Enclosure Chassis

      111
  • 5.3 The Plug-in Modules

    111
    • 5.3.1 Power Cooling Module (PCM)

      111
      • Figure 5-4 Power Cooling Module (1)

        111
      • Table 5-1 PCM LEDs

        112
    • 5.3.2 Input/Output (I/O) Module

      112
      • Figure 5-5 I/O Module

        113
      • Table 5-2 I/O Module LEDs

        113
    • 5.3.3 Drive Carrier Module and Status Indicator

      114
      • Note The enclosure system design allows for drive bays to be left empty without the need for fitting dummy drive carriers.

        114
        • Figure 5-6 Drive Carrier Module: Closed and Opened

          114
    • 5.3.4 DEM Card

      114
      • Figure 5-7 DEM

        115
      • Note The DEM is a serviceable PCB which may be replaced by trained personnel.

        115
        • Figure 5-8 Drive Carrier and DEM Locations

          115
  • 5.4 Indicators

    115
    • Note In some components, the failure LED is internal to the enclosure and visible only when the cover is open.

      115
    • 5.4.1 Front Panel Drive Activity Indicators

      115
      • Figure 5-9 Front Panel Drive Activity Indicators Panel

        116
      • Table 5-3 Display Panel LEDs

        116
    • 5.4.2 Internal Indicators

      118
      • Note In some components, the failure LED is internal to the enclosure and visible only when the cover is open. The Internal LED indicators are explained in Table 5-4.

        118
        • Table 5-4 INTERNAL LED Indicators

          118
    • 5.4.3 Rear of Enclosure Activity Indicators

      118
      • Table 5-5 LEDs on the Rear of the Enclosure

        118
  • 5.5 Visible and Audible Alarms

    119
    • Note The Display Panel also incorporates an Audible Alarm. The only time the enclosure will sound an alarm is when the top cover...

      119
    • Warning The Display Panel is an integral part of the enclosure chassis assembly and is not field replaceable.

      119
  • 5.6 Drive Enclosure Technical Specification

    119
    • 5.6.1 Dimensions

      119
    • 5.6.2 Weight

      120
    • 5.6.3 AC INPUT PCM

      120
    • 5.6.4 DC INPUT PCM

      120
    • 5.6.5 DC OUTPUT PCM

      121
    • 5.6.6 PCM Safety and EMC Compliance

      121
    • 5.6.7 Power Cord

      121
      • Note Power cord is not included in the standard drive enclosure package.

        121
  • 5.7 Environment

    121
    • Chapter 6

      123
    • Drive Enclosure Installation

      123
  • 6.1 Introduction

    123
    • Caution When connecting up the drive enclosure subsystem, use only the cables supplied.

      123
  • 6.2 Planning Your Installation

    123
    • Before you begin installation, you should become familiar with the configuration requirements of your drive enclosure system and the correct positions of each of the optional plug-in modules (Table 6-1).

      123
    • Table 6-1 Drive Enclosure Configuration

      123
    • Figure 6-1 DEM Pair Locations

      124
    • 6.2.1 Enclosure Bay Numbering Convention

      124
      • Warning Operation of the Enclosure with ANY of the plug-in modules missing from the rear of the enclosure will disrupt the airfl...

        124
        • Note Drive 61 is optional drive.

          124
          • Figure 6-2 1X60 Drive Numbering Table.

            125
          • Figure 6-3 2x30 Drive Numbering Table

            125
  • 6.3 Enclosure Installation Procedures

    126
    • Important SGI InfiniteStorage 15000 drive enclosures should only be installed in SGI InfiniteStorage 15000 racks. Mounting and installing these drive enclosures in any other rack is not authorized or supported by SGI.

      126
    • Warning The drive enclosure with all its component parts installed is too heavy for a single person to easily install into a Rack cabinet.

      126
      • Caution Ensure that you have fitted and checked a suitable anti-static wrist or ankle strap and observe all conventional ESD pre...

        126
      • Note Drive enclosures are supplied and delivered populated with Backplane, Baseplane, Front Panel, DEMs, and with PCMs installed. The Drive Carrier Modules are supplied as a separate package.

        126
        • Figure 6-4 Full Rack without Controllers.

          126
  • 6.4 I/O Module Configurations

    126
    • 6.4.1 Controller Options

      126
  • 6.5 SAS DEM

    127
  • 6.6 SATA Interposer Features

    127
  • 6.7 Drive Enclosure Device Addressing

    127
  • 6.8 Grounding Checks

    127
    • Warning If more than one product is fitted in a rack, the earth connection to the rack is even more important, because the rack will then have a high “EARTH LEAKAGE CURRENT” (“TOUCH CURRENT”).

      127
      • Chapter 7

        129
      • Drive Enclosure Operation

        129
  • 7.1 Before You Begin

    129
  • 7.2 Power On / Power Down

    129
    • Caution Do not operate the subsystem until the ambient temperature is within the specified operating range. If the drives have been recently installed, ensure they have had time to acclimatize before operating them.

      129
    • Important If AC power is lost for any reason, on restoration of power the enclosure will re-start automatically.

      129
    • 7.2.1 PCM LEDs

      129
    • 7.2.2 I/O Panel LEDs

      130
      • Figure 7-1 I/O Panel LEDs

        130
      • Table 7-1 I/O Module LEDs

        130
        • Chapter 8

          131
      • Drive Enclosure Troubleshooting

        131
  • 8.1 Overview

    131
  • 8.2 Initial Start-up Problems

    131
    • 8.2.1 Faulty Cords

      131
    • 8.2.2 Alarm Sounds On Power Up

      131
    • 8.2.3 Green “Signal Good” LED on I/O Module Not Lit

      131
    • 8.2.4 Computer Doesn’t Recognize the Drive Enclosure Subsystem

      131
      • 1 Check that the SAS interface cables from the drive enclosure to the host computer, or I/O controller, are fitted correctly.

        131
      • 2 Check that all drive carrier modules have been correctly installed.

        131
      • 3 Check that there is a valid SAS signal present at the I/O connector. If there is no signal present, ensure the cable has been properly inserted.

        132
      • 4 Check the I/O module setup as follows:

        132
  • 8.3 LEDs

    132
    • 8.3.1 HDD (Hard Disk Drive)

      132
      • Table 8-1 HDD LEDs

        132
    • 8.3.2 PCM (Power Cooling Module)

      132
      • Table 8-2 PCM LEDs

        132
    • 8.3.3 DEM (Drive Expander Module)

      132
      • Table 8-3 DEM LEDs

        133
    • 8.3.4 I/O Module

      133
      • Table 8-4 I/O LEDs

        133
    • 8.3.5 Front Panel Drive Activity Indicators

      134
      • Figure 8-1 Front Panel Drive Activity Indicators Panel

        134
      • Table 8-5 Display Panel LEDs

        134
  • 8.4 Audible Alarm

    135
    • 8.4.1 Top Cover Open

      135
    • 8.4.2 SES Command

      135
  • 8.5 Troubleshooting

    135
    • 8.5.1 Thermal Control

      135
      • 1 Check the installation for any airflow restrictions at either the front or rear of the enclosure. A minimum gap of 25mm at the front and 50mm at the rear is recommended.

        136
      • 2 Check for restrictions due to dust build-up; clean as appropriate.

        136
      • 3 Check for excessive re-circulation of heated air from rear to the front. Use in a fully enclosed rack installation is not recommended.

        136
      • 4 Check that all Blank modules are in place.

        136
      • 5 Reduce the ambient temperature.

        136
    • 8.5.2 Thermal Alarm

      137
      • 1 Check local ambient environment temperature is below the upper 40C specification.

        137
      • 2 Check the installation for any airflow restrictions at either the front or rear of the enclosure. A minimum gap of 25mm at the front and 50mm at the rear is recommended.

        137
      • 3 Check for restrictions due to dust build-up. Clean as appropriate.

        137
      • 4 Check for excessive re-circulation of heated air from rear to the front. Use in a fully enclosed rack installation is not recommended.

        137
      • 5 If possible, shutdown the enclosure and investigate the problem before continuing.

        137
    • 8.5.3 Thermal Shutdown

      137
      • Important An enclosure will shut down when a critical temperature threshold is exceeded in order to prevent permanent damage to the disk drives.

        137
  • 8.6 Dealing with Hardware Faults

    137
    • Warning If the drive enclosure subsystem is powered up and you remove any module, replace it immediately. If the subsystem is us...

      137
  • 8.7 Continuous Operation During Replacement

    138
  • 8.8 Replacing a Module

    138
    • Warning Whenever replacing a module NEVER leave an EMPTY bay in the rear of the enclosure, obtain a replacement before removing the problem part.

      138
    • Warning Observe all conventional ESD precautions when handling drive enclosure modules and components. Avoid contact with Backplane components and module connectors, etc.

      138
    • 8.8.1 Power Cooling Modules

      138
      • Warning Do not remove covers from the Power Cooling module (PCM). There is a danger of electric shock. Return the PCM to your supplier for repair.

        138
      • Warning To ensure your system has warning of a power failure please disconnect the power from the power supply, by either the sw...

        138
      • Warning Do not remove the faulty PCM/Cooling module unless you have a replacement unit of the correct type ready for insertion.

        138
      • 1 Make sure you identify the faulty PCM correctly from the two modules installed.

        138
      • 2 Lift latch which secures the power supply cord.

        138
      • 3 Switch off and disconnect the power supply cord.

        138
      • 4 Lift the PCM handle to the open position to cam the PCM out of the enclosure.

        138
      • 5 Grip the handle and withdraw the PCM.

        138
        • Warning Do not remove the faulty PCM unless you have a replacement unit of the correct type ready for insertion.

          139
      • 1 Make sure you identify the faulty PCM correctly from the two modules installed.

        139
      • 2 Lift latch which secures the power supply cord.

        139
      • 3 Switch off and disconnect the power supply cord.

        139
      • 4 Remove the two thumbscrews on the right and left sides of the unit.

        139
      • 5 Firmly grip the handle on the bottom of the unit and withdraw the PCM.

        139
      • 6 Check for damage, especially to the rear connector on the PCM.

        139
        • Caution Handle the module carefully and avoid damaging the connector pins. Do not install the module if any pins appear to be bent.

          139
      • 7 With the PCM handle in the open position, slide the module into the enclosure.

        139
      • 8 Cam the module home by manually closing the PCM handle. A click should be heard as the handle latches engage.

        139
      • 9 Connect the power supply cord to the power source, secure the latch over the cord, and switch the power supply ON.

        139
        • Note The alarm will sound until the new PCM is operating correctly.

          139
      • 1 Check for damage, especially to the rear connector on the PCM.

        139
        • Caution Handle the module carefully and avoid damaging the connector pins. Do not install the module if any pins appear to be bent.

          139
      • 2 Slide the module into the enclosure and push unit you hear a click as the latch is engaged.

        139
      • 3 Secure the two thumbscrews on the left and right sides of the unit.

        139
      • 4 Connect the power supply cord to the power source; secure latch, and switch the power supply ON.

        139
        • Note The alarm will sound until the new PCM is operating correctly.

          139
    • 8.8.2 I/O Module

      140
      • Warning Do not remove this module unless a replacement can be immediately added. The system must not be run without all units in place.

        140
      • 1 Release the two latches on the bottom of the unit by simply pulling each latch out and away from unit.

        140
      • 2 Pull the latches forward to cam the module out of the enclosure.

        140
      • 3 Grip the unit securely and withdraw the module.

        140
      • 4 With the latches in the open position, slide the EBOD module into the enclosure until the latch engages automatically.

        140
      • 5 Cam the module home by manually closing the latches. A click should be heard as the latch engages.

        140
    • 8.8.3 Replacing the Drive Carrier Module

      140
      • Warning Observe all conventional ESD precautions when handling drive enclosure modules and components. Avoid contact with backplane components and module connectors, etc.

        140
        • Figure 8-2 Drive Carrier - Handle Released

          140
        • Caution Drive spin down Damage can occur to a drive if it is removed while still spinning. If possible, use the operating system...

          140
      • 1 Release the carrier handle by sliding the latch backwards.

        141
      • 2 Insert the carrier into the enclosure.

        141
      • 3 Slide the drive carrier, gently, all the way into the enclosure.

        141
      • 4 Cam the drive carrier home. The camming foot on the base of the carrier will engage into a slot in the enclosure.

        141
      • 5 When the carrier is fully home, close the handle. You should hear a click as the latch engages and holds the handle closed.

        141
      • 6 Close the enclosure.

        141
  • 8.9 Replacing the DEM

    141
    • Important The DEM card should only be replaced by trained personnel.

      141
• A

  143
  • Controller Technical Specifications

    143
• B

  145
  • Drive Addressing

    145
• C

  149
  • Cabling Controllers and Drive Enclosures

    149