Numba for CUDA GPUs

• Overview
  • Terminology
  • Programming model
  • Requirements
    • Supported GPUs
    • Software
      • Setting CUDA Installation Path
  • Missing CUDA Features
• Writing CUDA Kernels
  • Introduction
  • Kernel declaration
  • Kernel invocation
    • Choosing the block size
    • Multi-dimensional blocks and grids
  • Thread positioning
    • Absolute positions
    • Further Reading
• Memory management
  • Data transfer
    • Device arrays
  • Pinned memory
  • Mapped memory
  • Managed memory
  • Streams
  • Shared memory and thread synchronization
  • Local memory
  • Constant memory
  • Deallocation Behavior
• Writing Device Functions
• Supported Python features in CUDA Python
  • Language
    • Execution Model
    • Constructs
  • Built-in types
  • Built-in functions
  • Standard library modules
    • cmath
    • math
    • operator
  • Numpy support
• Supported Atomic Operations
  • Example
• Cooperative Groups
  • Supported features
  • Using Grid Groups
  • Cooperative Launches
  • Applications and Example
• Random Number Generation
  • Example
• Device management
  • Device Selection
• The Device List
• Examples
  • Matrix multiplication
• Debugging CUDA Python with the the CUDA Simulator
  • Using the simulator
  • Supported features
• GPU Reduction
  • The Reduce class
• CUDA Ufuncs and Generalized Ufuncs
  • Example: Basic Example
  • Example: Calling Device Functions
  • Generalized CUDA ufuncs
• Sharing CUDA Memory
  • Sharing between process
    • Export device array to another process
    • Import IPC memory from another process
• CUDA Array Interface (Version 3)
  • Python Interface Specification
    • Synchronization
      • Definitions
      • Design Motivations
      • Interface Requirements
      • Synchronization in Numba
      • An example launching on an array’s non-default stream
    • Lifetime management
      • Data
      • Streams
    • Lifetime management in Numba
      • Producing Arrays
      • Consuming Arrays
    • Pointer Attributes
    • Differences with CUDA Array Interface (Version 0)
    • Differences with CUDA Array Interface (Version 1)
    • Differences with CUDA Array Interface (Version 2)
    • Interoperability
• External Memory Management (EMM) Plugin interface
  • Overview of External Memory Management
    • Effects on Deallocation Strategies
    • Management of other objects
    • Asynchronous allocation and deallocation
  • Implementing an EMM Plugin
    • The Host-Only CUDA Memory Manager
    • The IPC Handle Mixin
  • Classes and structures of returned objects
    • Memory Pointers
    • Memory Info
    • IPC
  • Setting the EMM Plugin
    • Environment variable
    • Function
      • Resetting the memory manager
• CUDA Frequently Asked Questions
  • nvprof reports “No kernels were profiled”