Library Setup, Exit, and Query Routines#

The library setup, exit, and query interfaces initialize and monitor the parallel environment of the PEs.

ISHMEM_INIT#

void ishmem_init()#

Callable from the host.

Description: Initializes the ishmem library. ishmem_init and ishmemx_init_attr are collective operations that all PEs must call before any other ishmem routine may be called.

At the end of the ishmem program which it initialized, the call to ishmem_init must be matched with a call to ishmem_finalize. After the first call to ishmem_init, a subsequent call to ishmem_init or ishmemx_init_attr in the same program results in undefined behavior.

ISHMEMX_INIT_ATTR#

enum ishmemx_runtime_type_t#
ISHMEM_RUNTIME_OPENSHMEM#
ISHMEM_RUNTIME_MPI#
ISHMEM_RUNTIME_PMI#

Callable from the host.

Description: Indicates which runtime is used to initialize Intel® SHMEM: either OpenSHMEM, MPI, or PMI.

Important

As of Intel® SHMEM version 1.0.0 only ISHMEM_RUNTIME_OPENSHMEM is supported.

struct ishmemx_attr_t#
ishmemx_runtime_type_t runtime#
bool initialize_runtime = true#
bool gpu = true#

Description: A struct declaration describing attributes for initialization. A valid runtime enumeration value must be set by the user and must correspond to a runtime that is enabled within the build of the ishmem library. By default, the parallel runtime is assumed to be initialized by the user (initialize_runtime default is false). The gpu boolean indicates whether to use GPU memory for the symmetric heap (default is false).

void ishmemx_init_attr(ishmemx_attr_t *attr)#
Parameters:

attr – a struct of type ishmemx_attr_t specifying initialization attributes

Callable from the host.

Description: Initializes the ishmem library. ishmem_init and ishmemx_init_attr are collective operations that all PEs must call before any other ishmem routine may be called. At the end of the ishmem program which it initialized, the call to ishmem_init must be matched with a call to ishmem_finalize. After the first call to ishmemx_init_attr, a subsequent call to ishmemx_init_attr or ishmem_init in the same program results in undefined behavior.

ISHMEM_MY_PE#

int ishmem_my_pe()#
Returns:

the PE number

Callable from the host and device.

Description: This routine returns the PE number of the calling PE. The result is an integer between 0 and npes - 1, where npes is the total number of PEs executing the current program.

ISHMEM_N_PES#

int ishmem_n_pes()#
Returns:

the number of total PEs running in the program

Callable from the host and device.

Description: The routine returns the number of PEs running in the program.

ISHMEM_FINALIZE#

void ishmem_finalize()#

Callable from the host.

Description: ishmem_finalize is a collective operation that ends the ishmem portion of a program previously initialized by ishmem_init or ishmemx_init_attr and releases all resources used by the ishmem library. This collective operation requires all PEs to participate in the call. There is an implicit global barrier in ishmem_finalize to ensure that pending communications are completed and that no resources are released until all PEs have entered ishmem_finalize. ishmem_finalize must be the last ishmem library call encountered in the ishmem portion of a program. A call to ishmem_finalize will release all resources initialized by a corresponding call to ishmem_init or ishmemx_init_attr. All processes that represent the PEs will still exist after the call to ishmem_finalize returns, but they will no longer have access to resources that have been released.

Note

Because SYCL kernel execution is non-blocking on the host, all kernels performing ishmem calls must first complete (for example, by calling wait or wait_and_throw on the SYCL queue) before calling ishmem_finalize.

ISHMEM_PTR#

void *ishmem_ptr(const void *dest, int pe)#
Parameters:
  • dest – The symmetric address of the remotely accessible data object to be referenced

  • pe – An integer that indicates the PE number on which dest is to be accessed.

Returns:

A local pointer to the remotely accessible dest data object is returned when it can be accessed using memory loads and stores. Otherwise, a null pointer is returned.

Callable from the host and device.

Description: ishmem_ptr returns a device address that may be used to directly reference dest on the specified PE. This address can be assigned to a pointer. After that, ordinary loads and stores to dest may be performed from within the device kernel. The address returned by ishmem_ptr is a local address to a remotely accessible data object. Providing this address to an argument of a ishmem routine that requires a symmetric address results in undefined behavior.

The ishmem_ptr routine can provide an efficient means to accomplish communication, for example when a sequence of reads and writes to a data object on a remote PE does not match the access pattern provided in a ishmem data transfer routine like ishmem_put or ishmem_iget.

ISHMEM_INFO_GET_VERSION#

void ishmem_info_get_version(int *major, int *minor)#
Parameters:
  • major – The major version of the ishmem specification in use.

  • minor – The minor version of the ishmem specification in use.

Callable from the host and device.

Description: Returns the major and minor version of the ishmem specification in use. For a given library implementation, the major and minor version returned by these calls are consistent with the library constants ISHMEM_MAJOR_VERSION and ISHMEM_MINOR_VERSION.

ISHMEM_INFO_GET_NAME#

void ishmem_info_get_name(char *name)#
Parameters:

name – The vendor defined string.

Callable from the host and device.

Description: This routine returns the vendor defined name string of size defined by the library constant ISHMEM_MAX_NAME_LEN. The program calling this function provides the name memory buffer of at least size ISHMEM_MAX_NAME_LEN. The implementation copies the vendor defined string of size at most ISHMEM_MAX_NAME_LEN to name. The string is terminated by a null character. If the name memory buffer is provided with size less than ISHMEM_MAX_NAME_LEN, behavior is undefined. For a given library implementation, the vendor string returned is consistent with the library constant ISHMEM_VENDOR_STRING.