Atomic Memory Operations (AMO)

An AMO is a one-sided communication mechanism that combines memory read, update, or write operations with atomicity guarantees described in Atomicity Guarantees. Similar to the RMA routines, described in Remote Memory Access (RMA), the AMOs are performed only on symmetric data objects. Intel® SHMEM defines two types of AMO routines:

#. The fetching routines return the original value of, and optionally update, the remote data object in a single atomic operation. The routines return after the data has been fetched from the target PE and delivered to the calling PE. The data type of the returned value is the same as the type of the remote data object.

The fetching routines include: ishmem_atomic_{fetch,compare_swap,swap}[_nbi] and ishmem_atomic_fetch_{inc,add,and,or,xor}[_nbi].

#. The non-fetching routines update the remote data object in a single atomic operation. A call to a non-fetching atomic routine issues the atomic operation and may return before the operation executes on the target PE. The ishmem_quiet, ishmem_barrier, or ishmem_barrier_all routines can be used to force completion for these non-fetching atomic routines.

The non-fetching routines include: ishmem_atomic_{set,inc,add,and,or,xor}[_nbi].

The standard, extended, and bitwise AMO types include some of the exact-width integer types defined in the C++11 language library header <cstdint>.

Standard AMO Types:

TYPE	TYPENAME
int	int
long	long
long long	longlong
unsigned int	uint
unsigned long	ulong
unsigned long long	ulonglong
int32_t	int32
int64_t	int64
uint32_t	uint32
uint64_t	uint64
size_t	size
ptrdiff_t	ptrdiff

Extended AMO Types:

TYPE	TYPENAME
float	float
double	double
int	int
long	long
long long	longlong
unsigned int	uint
unsigned long	ulong
unsigned long long	ulonglong
int32_t	int32
int64_t	int64
uint32_t	uint32
uint64_t	uint64
size_t	size
ptrdiff_t	ptrdiff

Bitwise AMO Types:

TYPE	TYPENAME
unsigned int	uint
unsigned long	ulong
unsigned long long	ulonglong
int32_t	int32
int64_t	int64
uint32_t	uint32
uint64_t	uint64

Blocking Atomic Memory Operations

ISHMEM_ATOMIC_FETCH

Atomically fetches the value of a remote data object.

Below, TYPE is one of the extended AMO types and has a corresponding TYPENAME specified by the Extended AMO Types table.

template<typename TYPE>
TYPE ishmem_atomic_fetch(const TYPE *source, int pe)

TYPE ishmem_TYPENAME_atomic_fetch(const TYPE *source, int pe)

Parameters:

• source – Symmetric address of the source data object. The type of source should match the TYPE and TYPENAME according to the table of Extended AMO Types.

• pe – An integer that indicates the PE number from which source is to be fetched.

Returns:

The contents at the source address on the remote PE. The data type of the return value is the same as the type of the remote data object.

Callable from the host and device.

Description: ishmem_atomic_fetch performs an atomic fetch operation. It returns the contents of the source as an atomic operation.

ISHMEM_ATOMIC_SET

Atomically sets the value of a remote data object.

Below, TYPE is one of the extended AMO types and has a corresponding TYPENAME specified by the Extended AMO Types table.

template<typename TYPE>
void ishmem_atomic_set(TYPE *dest, TYPE value, int pe)

void ishmem_TYPENAME_atomic_set(TYPE *dest, TYPE value, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Extended AMO Types.

• value – The operand to the atomic set operation. The type of value should match TYPE and TYPENAME according to the table of Extended AMO Types.

• pe – An integer that indicates the PE number on which dest is to be updated.

Returns:

None.

Callable from the host and device.

Description: ishmem_atomic_set performs an atomic set operation. It writes the value into dest on pe as an atomic operation.

ISHMEM_ATOMIC_COMPARE_SWAP

Performs an atomic conditional swap on a remote data object.

Below, TYPE is one of the standard AMO types and has a corresponding TYPENAME specified by the Standard AMO Types table.

template<typename TYPE>
TYPE ishmem_atomic_compare_swap(TYPE *dest, TYPE cond, TYPE value, int pe)

TYPE ishmem_TYPENAME_atomic_compare_swap(TYPE *dest, TYPE cond, TYPE value, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• cond – cond is compared to the remote dest value. If cond and the remote dest are equal, then value is swapped into the remote dest; otherwise, the remote dest is unchanged. In either case, the old value of the remote dest is returned as the routine return value. cond must be of the same data type as dest.

• value – The value to be atomically written to the remote PE. The type of value should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• pe – An integer that indicates the PE number from which dest is to be fetched.

Returns:

The contents that had been in the dest data object on the remote PE prior to the conditional swap. Data type is the same as the dest data type.

Callable from the host and device.

Description: The conditional swap routines conditionally update a dest data object on the specified PE and return the prior contents of the data object in one atomic operation.

ISHMEM_ATOMIC_SWAP

Performs an atomic swap to a remote data object.

Below, TYPE is one of the extended AMO types and has a corresponding TYPENAME specified by the Extended AMO Types table.

template<typename TYPE>
TYPE ishmem_atomic_swap(TYPE *dest, TYPE value, int pe)

TYPE ishmem_TYPENAME_atomic_swap(TYPE *dest, TYPE value, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Extended AMO Types.

• value – The value to be atomically written to the remote PE. The type of value should match the TYPE and TYPENAME according to the table of Extended AMO Types.

• pe – An integer that indicates the PE number from which dest is to be fetched.

Returns:

The content that had been at the dest address on the remote PE prior to the swap.

Callable from the host and device.

Description: ishmem_atomic_swap performs an atomic swap operation. It writes value into dest on pe and returns the previous contents of dest as an atomic operation.

ISHMEM_ATOMIC_FETCH_INC

Performs an atomic fetch-and-increment operation on a remote data object.

Below, TYPE is one of the standard AMO types and has a corresponding TYPENAME specified by the Standard AMO Types table.

template<typename TYPE>
TYPE ishmem_atomic_fetch_inc(TYPE *dest, int pe)

TYPE ishmem_TYPENAME_atomic_fetch_inc(TYPE *dest, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• pe – An integer that indicates the PE number from which dest is to be fetched.

Returns:

The content that had been at the dest address on the remote PE prior to the increment. The datatype of the return value is the same as dest.

Callable from the host and device.

Description: These routines perform a fetch-and-increment operation. The dest on PE pe is increased by one and the routine returns the previous contents of dest as an atomic operation.

ISHMEM_ATOMIC_INC

Performs an atomic increment operation on a remote data object.

Below, TYPE is one of the standard AMO types and has a corresponding TYPENAME specified by the Standard AMO Types table.

template<typename TYPE>
void ishmem_atomic_inc(TYPE *dest, int pe)

void ishmem_TYPENAME_atomic_inc(TYPE *dest, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

None.

Callable from the host and device.

Description: These routines perform an atomic increment operation on the dest data object on PE pe.

ISHMEM_ATOMIC_FETCH_ADD

Performs an atomic fetch-and-add operation on a remote data object.

Below, TYPE is one of the standard AMO types and has a corresponding TYPENAME specified by the Standard AMO Types table.

template<typename TYPE>
TYPE ishmem_atomic_fetch_add(TYPE *dest, TYPE value, int pe)

TYPE ishmem_TYPENAME_atomic_fetch_add(TYPE *dest, TYPE value, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• value – The operand to the atomic fetch-and-add operation. The type of value should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

The contents that had been at the dest address on the remote PE prior to the atomic addition operation. The data type of the return value is the same as dest.

Callable from the host and device.

Description: ishmem_atomic_fetch_add routine performs an atomic fetch-and-add operation. An atomic fetch-and-add operation fetches the old dest and adds value to dest without the possibility of another atomic operation on the dest between the time of the fetch and the update. These routines add value to dest on pe and return the previous contents of dest as an atomic operation.

ISHMEM_ATOMIC_ADD

Performs an atomic add operation on a remote symmetric data object.

Below, TYPE is one of the standard AMO types and has a corresponding TYPENAME specified by the Standard AMO Types table.

template<typename TYPE>
void ishmem_atomic_add(TYPE *dest, TYPE value, int pe)

void ishmem_TYPENAME_atomic_add(TYPE *dest, TYPE value, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• value – The operand to the atomic add operation. The type of value should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

None.

Callable from the host and device.

Description: The ishmem_atomic_add routine performs an atomic add operation. It adds value to dest on PE pe and atomically updates the dest without returning the value.

ISHMEM_ATOMIC_FETCH_AND

Atomically perform a fetching bitwise AND operation on a remote data object.

Below, TYPE is one of the bitwise AMO types and has a corresponding TYPENAME specified by the Bitwise AMO Types table.

template<typename TYPE>
TYPE ishmem_atomic_fetch_and(TYPE *dest, TYPE value, int pe)

TYPE ishmem_TYPENAME_atomic_fetch_and(TYPE *dest, TYPE value, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• value – The operand to the atomic add operation. The type of value should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

The value pointed to by dest on PE pe immediately before the operation is performed.

Callable from the host and device.

Description: ishmem_atomic_fetch_and atomically performs a fetching bitwise AND on the remotely accessible data object pointed to by dest at PE pe with the operand value.

ISHMEM_ATOMIC_AND

Atomically perform a non-fetching bitwise AND operation on a remote data object.

Below, TYPE is one of the bitwise AMO types and has a corresponding TYPENAME specified by the Bitwise AMO Types table.

template<typename TYPE>
void ishmem_atomic_and(TYPE *dest, TYPE value, int pe)

void ishmem_TYPENAME_atomic_and(TYPE *dest, TYPE value, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• value – The operand to the atomic AND operation. The type of value should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

None.

Callable from the host and device.

Description: ishmem_atomic_and atomically performs a non-fetching bitwise AND on the remotely accessible data object pointed to by dest at PE pe with the operand value.

ISHMEM_ATOMIC_FETCH_OR

Atomically perform a fetching bitwise OR operation on a remote data object.

Below, TYPE is one of the bitwise AMO types and has a corresponding TYPENAME specified by the Bitwise AMO Types table.

template<typename TYPE>
TYPE ishmem_atomic_fetch_or(TYPE *dest, TYPE value, int pe)

TYPE ishmem_TYPENAME_atomic_fetch_or(TYPE *dest, TYPE value, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• value – The operand to the atomic OR operation. The type of value should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

The value pointed to by dest on PE pe immediately before the operation is performed.

Callable from the host and device.

Description: ishmem_atomic_fetch_or atomically performs a fetching bitwise OR on the remotely accessible data object pointed to by dest at PE pe with the operand value.

ISHMEM_ATOMIC_OR

Atomically perform a non-fetching bitwise OR operation on a remote data object.

Below, TYPE is one of the bitwise AMO types and has a corresponding TYPENAME specified by the Bitwise AMO Types table.

template<typename TYPE>
void ishmem_atomic_or(TYPE *dest, TYPE value, int pe)

void ishmem_TYPENAME_atomic_or(TYPE *dest, TYPE value, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• value – The operand to the bitwise OR operation. The type of value should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

None.

Callable from the host and device.

Description: ishmem_atomic_or atomically performs a non-fetching bitwise OR on the remotely accessible data object pointed to by dest at PE pe with the operand value.

ISHMEM_ATOMIC_FETCH_XOR

Atomically perform a fetching bitwise exclusive OR (XOR) operation on a remote data object.

Below, TYPE is one of the bitwise AMO types and has a corresponding TYPENAME specified by the Bitwise AMO Types table.

template<typename TYPE>
TYPE ishmem_atomic_fetch_xor(TYPE *dest, TYPE value, int pe)

TYPE ishmem_TYPENAME_atomic_fetch_xor(TYPE *dest, TYPE value, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• value – The operand to the atomic XOR operation. The type of value should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

The value pointed to by dest on PE pe immediately before the operation is performed.

Callable from the host and device.

Description: ishmem_atomic_fetch_xor atomically performs a fetching bitwise XOR on the remotely accessible data object pointed to by dest at PE pe with the operand value.

ISHMEM_ATOMIC_XOR

Atomically perform a non-fetching bitwise exclusive OR (XOR) operation on a remote data object.

Below, TYPE is one of the bitwise AMO types and has a corresponding TYPENAME specified by the Bitwise AMO Types table.

template<typename TYPE>
void ishmem_atomic_xor(TYPE *dest, TYPE value, int pe)

void ishmem_TYPENAME_atomic_xor(TYPE *dest, TYPE value, int pe)

Parameters:

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• value – The operand to the bitwise XOR operation. The type of value should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

None.

Callable from the host and device.

Description: ishmem_atomic_XOR atomically performs a non-fetching bitwise XOR on the remotely accessible data object pointed to by dest at PE pe with the operand value.

Non-blocking Atomic Memory Operations

ISHMEM_ATOMIC_FETCH_NBI

The nonblocking atomic fetch routine provides a method for atomically fetching the value of a remote data object.

Below, TYPE is one of the extended AMO types and has a corresponding TYPENAME specified by the Extended AMO Types table.

void ishmem_atomic_fetch_nbi(TYPE *fetch, const TYPE *source, int pe)

void ishmem_TYPENAME_atomic_fetch_nbi(TYPE *fetch, const TYPE *source, int pe)

Parameters:

• fetch – Local address of the data object to be updated. The type of fetch should match the TYPE and TYPENAME according to the table of Extended AMO Types.

• source – Symmetric address of the source data object. The type of source should match the TYPE and TYPENAME according to the table of Extended AMO Types.

• pe – An integer that indicates the PE number from which source is to be fetched.

Returns:

None.

Callable from the host and device.

Description:

ishmem_atomic_fetch_nbi performs a nonblocking fetch of a value atomically from a remote data object. This routine returns after initiating the operation. The operation is considered complete after a subsequent call to ishmem_quiet or ishmemx_quiet_work_group. At the completion of ishmem_quiet or ishmemx_quiet_work_group, contents of the source data object from PE pe has been fetched into the fetch local data object.

ISHMEM_ATOMIC_COMPARE_SWAP_NBI

The nonblocking atomic routine provides a method for performing an atomic conditional swap on a remote data object.

Below, TYPE is one of the standard AMO types and has a corresponding TYPENAME specified by the Standard AMO Types table.

void ishmem_atomic_compare_swap_nbi(TYPE *fetch, TYPE *dest, TYPE cond, TYPE value, int pe)

void ishmem_TYPENAME_atomic_compare_swap_nbi(TYPE *fetch, TYPE *dest, TYPE cond, TYPE value, int pe)

Parameters:

• fetch – Local address of the data object to be updated. The type of fetch should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• cond – cond is compared to the remote dest value. If cond and the remote dest are equal, then value is swapped into the remote dest; otherwise, the remote dest is unchanged. In either case, the old value of the remote dest is transferred to fetch. cond must be of the same data type as dest.

• value – The value to be atomically written to the remote PE. The type of value should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• pe – An integer that indicates the PE number from which dest is to be fetched.

Returns:

None.

Callable from the host and device.

Description:

ishmem_atomic_compare_swap_nbi conditionally updates dest data object on the specified PE as an atomic operation and fetches the prior contents of the dest data object into the fetch local data object. This routine returns after initiating the operation. The operation is considered complete after a subsequent call to ishmem_quiet or ishmemx_quiet_work_group. At the completion of ishmem_quiet or ishmemx_quiet_work_group, prior contents of the dest data object have been fetched into fetch local data object and the contents of value have been conditionally updated into dest on the remote PE pe.

ISHMEM_ATOMIC_SWAP_NBI

This nonblocking atomic operation performs an atomic swap to a remote data object.

Below, TYPE is one of the extended AMO types and has a corresponding TYPENAME specified by the Extended AMO Types table.

void ishmem_atomic_swap_nbi(TYPE *fetch, TYPE *dest, TYPE value, int pe)

void ishmem_TYPENAME_atomic_swap_nbi(TYPE *fetch, TYPE *dest, TYPE value, int pe)

Parameters:

• fetch – Local address of the data object to be updated. The type of fetch should match the TYPE and TYPENAME according to the table of Extended AMO Types.

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Extended AMO Types.

• value – The value to be atomically written to the remote PE. The type of value should match the TYPE and TYPENAME according to the table of Extended AMO Types.

• pe – An integer that indicates the PE number from which dest is to be fetched.

Returns:

None.

Callable from the host and device.

Description:

ishmem_atomic_swap_nbi performs an atomic swap operation. This routine returns after initiating the operation. The operation is considered complete after a subsequent call to ishmem_quiet or ishmemx_quiet_work_group. At the completion of ishmem_quiet or ishmemx_quiet_work_group, it has written value into dest on PE pe and fetched the prior contents of dest into fetch local data object.

ISHMEM_ATOMIC_FETCH_INC_NBI

This nonblocking atomic routine performs an atomic fetch-and-increment operation on a remote data object.

Below, TYPE is one of the standard AMO types and has a corresponding TYPENAME specified by the Standard AMO Types table.

void ishmem_atomic_fetch_inc_nbi(TYPE *fetch, TYPE *dest, int pe)

void ishmem_TYPENAME_atomic_fetch_inc_nbi(TYPE *fetch, TYPE *dest, int pe)

Parameters:

• fetch – Local address of the data object to be updated. The type of fetch should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• pe – An integer that indicates the PE number from which dest is to be fetched.

Returns:

None.

Callable from the host and device.

Description:

ishmem_atomic_fetch_inc_nbi performs an atomic fetch-and-increment operation. This routine returns after initiating the operation. The operation is considered complete after a subsequent call to ishmem_quiet or ishmemx_quiet_work_group. At the completion of ishmem_quiet or ishmemx_quiet_work_group, dest on PE pe has been increased by one and the previous contents of dest fetched into the fetch local data object.

ISHMEM_ATOMIC_FETCH_ADD_NBI

This nonblocking atomic routine performs an atomic fetch-and-add operation on a remote data object.

Below, TYPE is one of the standard AMO types and has a corresponding TYPENAME specified by the Standard AMO Types table.

void ishmem_atomic_fetch_add_nbi(TYPE *fetch, TYPE *dest, TYPE value, int pe)

void ishmem_TYPENAME_atomic_fetch_add_nbi(TYPE *fetch, TYPE *dest, TYPE value, int pe)

Parameters:

• fetch – Local address of the data object to be updated. The type of fetch should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• value – The operand to the atomic fetch-and-add operation. The type of value should match the TYPE and TYPENAME according to the table of Standard AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

None.

Callable from the host and device.

Description:

ishmem_atomic_fetch_add_nbi performs an atomic fetch-and-add operation. An atomic fetch-and-add operation fetches the old dest and adds value to dest without the possibility of another atomic operation on the dest between the time of the fetch and the update. This routine returns after initiating the operation. The operation is considered complete after a subsequent call to ishmem_quiet or ishmemx_quiet_work_group. At the completion of ishmem_quiet or ishmemx_quiet_work_group, value has been added to dest on PE pe and the prior contents of dest fetched into the fetch local data object.

ISHMEM_ATOMIC_FETCH_AND_NBI

This nonblocking atomic operation performs an atomic fetching bitwise AND operation on a remote data object.

Below, TYPE is one of the bitwise AMO types and has a corresponding TYPENAME specified by the Bitwise AMO Types table.

void ishmem_atomic_fetch_and_nbi(TYPE *fetch, TYPE *dest, TYPE value, int pe)

void ishmem_TYPENAME_atomic_fetch_and_nbi(TYPE *fetch, TYPE *dest, TYPE value, int pe)

Parameters:

• fetch – Local address of the data object to be updated. The type of fetch should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• value – The operand to the atomic bitwise AND operation. The type of value should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

None.

Callable from the host and device.

Description:

ishmem_atomic_fetch_and_nbi performs an atomic fetching bitwise AND on the remotely accessible data object pointed by dest at PE pe with the operand value. This routine returns after initiating the operation. The operation is considered complete after a subsequent call to ishmem_quiet or ishmemx_quiet_work_group. At the completion of ishmem_quiet or ishmemx_quiet_work_group, these routines have performed a fetching bitwise AND on dest at PE pe with the operand value and fetched the prior contents of dest into the fetch local data object.

ISHMEM_ATOMIC_FETCH_OR_NBI

This nonblocking atomic operation performs an atomic fetching bitwise OR operation on a remote data object.

Below, TYPE is one of the bitwise AMO types and has a corresponding TYPENAME specified by the Bitwise AMO Types table.

void ishmem_atomic_fetch_or_nbi(TYPE *fetch, TYPE *dest, TYPE value, int pe)

void ishmem_TYPENAME_atomic_fetch_or_nbi(TYPE *fetch, TYPE *dest, TYPE value, int pe)

Parameters:

• fetch – Local address of the data object to be updated. The type of fetch should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• value – The operand to the atomic bitwise OR operation. The type of value should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

None.

Callable from the host and device.

Description:

ishmem_atomic_fetch_or_nbi performs an atomic fetching bitwise OR on the remotely accessible data object pointed by dest at PE pe with the operand value. This routine returns after initiating the operation. The operation is considered complete after a subsequent call to ishmem_quiet or ishmemx_quiet_work_group. At the completion of ishmem_quiet or ishmemx_quiet_work_group, these routines have performed a fetching bitwise OR on dest at PE pe with the operand value and fetched the prior contents of dest into the fetch local data object.

ISHMEM_ATOMIC_FETCH_XOR_NBI

This nonblocking atomic operation performs an atomic fetching bitwise XOR operation on a remote data object.

Below, TYPE is one of the bitwise AMO types and has a corresponding TYPENAME specified by the Bitwise AMO Types table.

void ishmem_atomic_fetch_xor_nbi(TYPE *fetch, TYPE *dest, TYPE value, int pe)

void ishmem_TYPENAME_atomic_fetch_xor_nbi(TYPE *fetch, TYPE *dest, TYPE value, int pe)

Parameters:

• fetch – Local address of the data object to be updated. The type of fetch should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• dest – Symmetric address of the destination data object. The type of dest should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• value – The operand to the atomic bitwise XOR operation. The type of value should match the TYPE and TYPENAME according to the table of Bitwise AMO Types.

• pe – An integer that indicates the PE number from which dest is to be updated.

Returns:

None.

Callable from the host and device.

Description:

ishmem_atomic_fetch_xor_nbi performs an atomic fetching bitwise XOR on the remotely accessible data object pointed by dest at PE pe with the operand value. This routine returns after initiating the operation. The operation is considered complete after a subsequent call to ishmem_quiet or ishmemx_quiet_work_group. At the completion of ishmem_quiet or ishmemx_quiet_work_group, these routines have performed a fetching bitwise XOR on dest at PE pe with the operand value and fetched the prior contents of dest into the fetch local data object.