Benutzerhandbuch für Escali 4.4

Inhaltsverzeichnis

• Chapter 1 Introduction

  17
  • 1.1 Scali MPI Connect product context

    17
  • 1.2 Support

    18
    • 1.2.1 Scali mailing lists

      18
    • 1.2.2 SMC FAQ

      18
    • 1.2.3 SMC release documents

      18
    • 1.2.4 Problem reports

      18
    • 1.2.5 Platforms supported

      18
    • 1.2.6 Licensing

      19
    • 1.2.7 Feedback

      19
  • 1.3 How to read this guide

    19
  • 1.4 Acronyms and abbreviations

    19
  • 1.5 Terms and conventions

    21
  • 1.6 Typographic conventions

    21
• Chapter 2 Description of Scali MPI Connect

  23
  • 2.1 Scali MPI Connect components

    23
  • 2.2 SMC network devices

    24
    • 2.2.1 Network devices

      25
    • 2.2.2 Shared Memory Device

      25
    • 2.2.3 Ethernet Devices

      25
    • 2.2.4 Myrinet

      27
    • 2.2.5 Infiniband

      27
    • 2.2.6 SCI

      28
  • 2.3 Communication protocols on DAT-devices

    28
    • 2.3.1 Channel buffer

      28
    • 2.3.2 Inlining protocol

      29
    • 2.3.3 Eagerbuffering protocol

      29
    • 2.3.4 Transporter protocol

      29
    • 2.3.5 Zerocopy protocol

      30
  • 2.4 Support for other interconnects

    30
  • 2.5 MPI-2 Features

    30
• Chapter 3 Using Scali MPI Connect

  33
  • 3.1 Setting up a Scali MPI Connect environment

    33
    • 3.1.1 Scali MPI Connect environment variables

      33
  • 3.2 Compiling and linking

    33
    • 3.2.1 Running

      33
    • 3.2.2 Compiler support

      34
    • 3.2.3 Linker flags

      34
    • 3.2.4 Notes on Compiling and linking on AMD64 and EM64T

      34
    • 3.2.5 Notes on Compiling and linking on Power series

      35
    • 3.2.6 Notes on compiling with MPI-2 features

      35
  • 3.3 Running Scali MPI Connect programs

    35
    • 3.3.1 Naming conventions

      35
    • 3.3.2 mpimon - monitor program

      36
    • 3.3.3 mpirun - wrapper script

      39
  • 3.4 Suspending and resuming jobs

    40
  • 3.5 Running with dynamic interconnect failover capabilities

    40
  • 3.6 Running with tcp error detection - TFDR

    40
  • 3.7 Debugging and profiling

    41
    • 3.7.1 Debugging with a sequential debugger

      41
    • 3.7.2 Built-in-tools for debugging

      42
    • 3.7.3 Assistance for external profiling

      42
    • 3.7.4 Debugging with Etnus Totalview

      42
  • 3.8 Controlling communication resources

    43
    • 3.8.1 Communication resources on DAT-devices

      43
  • 3.9 Good programming practice with SMC

    44
    • 3.9.1 Matching MPI_Recv() with MPI_Probe()

      44
    • 3.9.2 Using MPI_Isend(), MPI_Irecv()

      44
    • 3.9.3 Using MPI_Bsend()

      44
    • 3.9.4 Avoid starving MPI-processes - fairness

      44
    • 3.9.5 Unsafe MPI programs

      45
    • 3.9.6 Name space pollution

      45
  • 3.10 Error and warning messages

    45
    • 3.10.1 User interface errors and warnings

      45
    • 3.10.2 Fatal errors

      45
  • 3.11 Mpimon options

    46
    • 3.11.1 Giving numeric values to mpimon

      47
• Chapter 4 Profiling with Scali MPI Connect

  49
  • 4.1 Example

    49
  • 4.2 Tracing

    50
    • 4.2.1 Using Scali MPI Connect built-in trace

      50
    • 4.2.2 Features

      52
  • 4.3 Timing

    53
    • 4.3.1 Using Scali MPI Connect built-in timing

      53
  • 4.4 Using the scanalyze

    55
    • 4.4.1 Analysing all2all

      55
  • 4.5 Using SMC's built-in CPU-usage functionality

    57
• Chapter 5 Tuning SMC to your application

  59
  • 5.1 Tuning communication resources

    59
    • 5.1.1 Automatic buffer management

      59
  • 5.2 How to optimize MPI performance

    60
    • 5.2.1 Performance analysis

      60
    • 5.2.2 Using processor-power to poll

      60
    • 5.2.3 Reorder network traffic to avoid conflicts

      60
  • 5.3 Benchmarking

    60
    • 5.3.1 How to get expected performance

      60
    • 5.3.2 Memory consumption increase after warm-up

      61
  • 5.4 Collective operations

    61
    • 5.4.1 Finding the best algorithm

      62
• Appendix A Example MPI code

  63
  • A-1 Programs in the ScaMPItst package

    63
  • A-2 Image contrast enhancement

    63
• Appendix B Troubleshooting

  66
  • B-1 When things do not work - troubleshooting

    66
• Appendix C Install Scali MPI Connect

  68
  • C-1 Per node installation of Scali MPI Connect

    68
  • C-2 Install Scali MPI Connect for TCP/IP

    69
  • C-3 Install Scali MPI Connect for Direct Ethernet

    69
  • C-4 Install Scali MPI Connect for Myrinet

    69
  • C-5 Install Scali MPI Connect for Infiniband

    70
  • C-6 Install Scali MPI Connect for SCI

    70
  • C-7 Install and configure SCI management software

    70
  • C-8 License options

    70
  • C-9 Scali kernel drivers

    71
  • C-10 Uninstalling SMC

    71
  • C-11 Troubleshooting Network providers

    71
• Appendix D Bracket expansion and grouping

  74
  • D-1 Bracket expansion

    74
  • D-2 Grouping

    74
• Appendix E Related documentation

  76