Async Allocation Functions#

Warning

Experimental features:

  • May be replaced, updated, or removed at any time.

  • Do not require maintaining API/ABI stability of their own additions over time.

  • Do not require conformance testing of their own additions.

Motivation#

Asynchronous allocations can allow queues to allocate and free memory between UR command enqueues without forcing synchronization points in the asynchronous command DAG associated with a queue. Through the enqueue-ordering semantics, memory allocated within a pool can be reused so as to avoid expensive and redundant calls into the OS, which can improve performance.

Changelog#

Revision

Changes

1.0

Initial Draft

1.1

Fix typos/warnings/descriptions Change enum values Add missing properties/enums/funcs to API list

1.2

Rename DEVICE_INFO_ASYNC_USM_ALLOCATIONS_EXP to DEVICE_INFO_ASYNC_USM_ALLOCATIONS_SUPPORT_EXP for better consistency with other UR enums

1.3

Remove USMPoolSetThresholdExp Replace with USMPoolSetInfoExp

1.4

Introduce usm_pool_buffer_desc_t to enable pool creation from a USM memory object

Support#

Adapters which support this experimental feature must return true for the new :ref:`UR_DEVICE_INFO_ASYNC_USM_ALLOCATIONS_SUPPORT_EXP <ur-device-info-t>`\ device info query.

Contributors#