User ManualTable of ContentsTable of Contents111 Introduction17Who Should Read this Guide17How this Guide is Organized18Overview19Interoperability19Conventions Used in this Guide20Table 1-1. Typographical Conventions20Documentation21Contact Information212 Feature Overview23Features23Other Changes24Continued Support24Table 2-1. QLogic Adapter Model Numbers25Software Components263 Step-by-Step Installation Checklist27Hardware Installation27Software Installation284 Hardware Installation31Hardware Installation Requirements31Hardware31Table 4-1. Adapter Models and Related Platforms31Form Factors32Cabling and Switches33Table 4-2. QLogic InfiniBand Cables33Optical Fibre Option34Configuring the BIOS34Safety with Electricity35Unpacking Information35Verify the Package Contents35List of the Package Contents35Figure 4-1. QLogic QLE7280 with IBA7220 ASIC37Figure 4-2. QLogic QLE7140 Card with Riser, Top View37Figure 4-3. QLogic QHT7040/QHT7140 Full and Low Profile Cards with Riser, Top View38Unpacking the QLogic Adapter38Hardware Installation39Hardware Installation for QLE7240, QLE7280, or QLE7140 with PCI Express Riser39Dual Adapter Installation39Installation Steps39Figure 4-4. PCIe Slot in a Typical Motherboard40Figure 4-5. QLogic PCIe Host Channel Adapter Assembly with Riser Card41Figure 4-6. Assembled PCIe Host Channel Adapter with Riser42Hardware Installation for QHT7140 with HTX Riser42Figure 4-7. HTX Slot43Figure 4-8. QLogic QHT7140 Adapter with Riser Card44Figure 4-9. Assembled QHT7140 with Riser45Hardware Installation for QLE7240, QLE7280, and QLE7140 Without a PCI Express Riser45Hardware Installation for the QHT7140 Without an HTX Riser46Figure 4-10. QHT7140 Without Riser Installed in a 3U Chassis47Switch Configuration and Monitoring47Cabling the Adapter to the InfiniBand Switch47Completing the Installation485 Software Installation49Cluster Setup49Types of Nodes in a Cluster Environment49Supported Linux Distributions50Table 5-1. InfiniPath/OpenFabrics Supported Distributions and Kernels50Distribution Identifiers51Table 5-2. Distribution Identifiers51Compiler Support51Set Up Your Environment51Table 5-3. Required Operating System Packages52Table 5-4. Specific Component Requirements52Choose the Appropriate Download Files53Table 5-5. Available Packages for QLogic OFED 1.4 Release53Install QLogicIB-Basic with the Installer Tool56Table 5-6. INSTALL Options61About rpm Installation62Using rpm to Install InfiniPath and OpenFabrics63RPM Organization65Install QLogic OFED User-level Software with the rpm Command66Rebuild or Reinstall the kernel-ib Driver with rpm After a Kernel Upgrade68Rebuild the kernel-ib Driver on an Unsupported Distribution or an Unsupported Distribution/Kernel Pair68Install QLogic OFED Using Rocks69Install Frontend and Compute Nodes69Rocks Installation on an Existing Frontend Node70Install QLogic OFED Using a Platform OCS Kit71Install the QLogic InfiniBand Fabric Suite Software72Install Lustre Software72Installed Layout72Remove Software Packages74Uninstall Using the Installer Tool74Uninstall InfiniPath and OpenFabrics RPMs74Uninstall Software with Rocks or Platform OCS74Install a Previous Version of QLogicIB-Basic75Downgrading RPMs756 Configuring Drivers and Services77InfiniPath and OpenFabrics Driver Overview77OpenFabrics Drivers and Services Configuration and Startup77Configure the IPoIB Network Interface78OpenSM79SRP80Using QLogic SRP80Using OFED SRP80Configuring and Administering the VNIC Interface82MPI over uDAPL89Other Configuration: Changing the MTU Size90Managing the InfiniPath Driver90Configure the InfiniPath Driver State91Start, Stop, or Restart InfiniPath91Unloading the Driver/Modules Manually92Further Information on Configuring and Loading Drivers937 Installation Verification and Additional Settings95LED Link and Data Indicators95Table 7-1. LED Link and Data Indicators95Adapter and Other Settings96Customer Acceptance Utility97Table 7-2. ipath_checkout Options98A Installation Troubleshooting99Hardware Issues99Node Spontaneously Reboots99Some HTX Motherboards May Need Two or More CPUs in Use99BIOS Settings100Enable Advanced Configuration and Power Interface (ACPI)100Issue with Supermicro® H8DCE-HTe and the QHT7040100Software Installation Issues100Missing Kernel RPM Errors100Resolving Conflicts101openmpi_gcc Fails to Install Because of Dependency on gfortran (RHEL 4)102mpirun Installation Requires 32-bit Support102Lockable Memory Error on Initial Installation of InfiniPath102Configuration Issues103ibsrpdm Command Hangs when Two Adapters are Installed but only Unit 1 is Connected to the Switch103Outdated ipath_ether Configuration Setup Generates Error103B Write Combining105Introduction105Verify Write Combining is Working105PAT and Write Combining106MTRR Mapping and Write Combining106Edit BIOS Settings to Fix MTRR Issues106Use the ipath_mtrr Script to Fix MTRR Issues107C Configuration Files109Table C-1. Configuration Files109D Package Descriptions111Package Names with the QLogicIB-Basic Download111Different Nodes May Use Different RPMs112InfiniPath RPM Version Numbers and Identifiers112OpenFabrics RPM Names112InfiniPath and OpenFabrics RPMs113Documentation RPMs113Table D-1. Documentation RPMs113InfiniPath RPMs113Table D-2. InfiniPath RPMs113Table D-3. InfiniPath-Devel/RPMs114Table D-4. InfiniPath-MPI/RPMs114OpenFabrics RPMs115Table D-5. OpenFabrics/RPMs115Table D-6. OpenFabrics-Devel/RPMs118Table D-7. OpenSM/RPM119Table D-8. OpenSM-Devel/RPM119Other Adapters119Table D-9. Other Host Channel Adapters/RPMs119Table D-10. Other Host Channel Adapters-Devel/RPMs120Other MPIs120Table D-11. OtherMPIs/RPMs120Index123Symbols123A123B123C123D123E124F124H124I124K125L125M125N125O125P125Q126R126S126T126U127V127W127Size: 1.59 MBPages: 130Language: EnglishOpen manual