streaming.base.shared#

Objects that live in shared memory.

For when using threading or multiprocessing from the python standard library wonโ€™t do, because we are coordinating separately instantiated pytorch worker processes.

Functions

get_shm_prefix

Register or lookup our shared memory prefix.

Classes

SharedArray

A numpy array of predetermined shape and dtype that lives in shared memory.

SharedBarrier

A barrier that works inter-process using a filelock and shared memory.

SharedMemory

Improved quiet implementation of shared memory.

SharedScalar

A numpy scalar of predetermined dtype that lives in shared memory.