Environment Object

The Environment object (Env) is used to maintain references to python objects that are needed to support compiled functions for both object-mode and nopython-mode.

In nopython-mode, the Env is used for:

  • Storing pyobjects for reconstruction from native values, such as:

    • for printing native values of NumPy arrays;

    • for returning or yielding native values back to the interpreter.

In object-mode, the Env is used for:

  • storing constant values referenced in the code.

  • storing a reference to the function’s global dictionary to load global values.

The Implementation

The Env is implemented in two parts. In _dynfunc.c, the Env is defined as EnvironmentObject as a Python C-extension type. In lowering.py, the EnvironmentObject` (exported as _dynfunc.Environment) is extended to support necessary operations needed at lowering.

Serialization

The Env supports being pickled. Compilation cache files and ahead-of-time compiled modules serialize all the used Envs for recreation at the runtime.

Usage

At the start of the lowering for a function or a generator, an Env is created. Throughout the compilation, the Env is mutated to attach additional information. The compiled code references an Env via a global variable in the emitted LLVM IR. The global variable is zero-initialized with “common” linkage, which is the default linkage for C global values. The use of this linkage allows multiple definitions of the global variable to be merged into a single definition when the modules are linked together. The name of the global variable is computed from the name of the function (see FunctionDescriptor.env_name and .get_env_name() of the target context).

The Env is initialized when the compiled-function is loaded. The JIT engine finds the address of the associated global variable for the Env and stores the address of the Env into it. For cached functions, the same process applies. For ahead-of-time compiled functions, the module initializer in the generated library is responsible for initializing the global variables of all the Envs in the module.