streaming.base.util

Utility and helper functions for datasets.

Functions

bytes_to_int	Convert human readable byte format to an integer.
clean_stale_shared_memory	Clean up all the leaked shared memory.
get_import_exception_message	Get import exception message.
get_list_arg	Pass a list as a command-line flag.
merge_index	Merge index.json from partitions to form a global index.json.
number_abbrev_to_int	Convert human readable number abbreviations to an integer.
retry	Decorator to retry a function with backoff and jitter.
wait_for_file_to_exist	Wait for the file to exist till timeout seconds.