osmo data#

usage: osmo data [-h] {upload,download,list,delete} ...

Positional Arguments#

command#: Possible choices: upload, download, list, delete

Sub-commands#

upload#

Upload data to a backend URI

osmo data upload [-h] [--regex REGEX] [--processes PROCESSES]
                 [--threads THREADS] [--benchmark-out BENCHMARK_OUT]
                 remote_uri local_path [local_path ...]

Positional Arguments#

remote_uri#: Location where data will be uploaded to.
local_path#: Path(s) where the data lies.

Named Arguments#

--regex, -x#

Regex to filter which types of files to upload

--processes, -p#

Number of processes. Defaults to 4

Default: 4

--threads, -T#

Number of threads per process. Defaults to 20

Default: 20

--benchmark-out, -b#

Path to folder where benchmark data will be written to.

Ex. osmo data upload s3://bucket/ /path/to/file

download#

Download a data from a backend URI

osmo data download [-h] [--regex REGEX] [--resume] [--processes PROCESSES]
                   [--threads THREADS] [--benchmark-out BENCHMARK_OUT]
                   remote_uri local_path

Positional Arguments#

remote_uri#: URI where data will be downloaded from.
local_path#: Path where data will be downloaded to.

Named Arguments#

--regex, -x#

Regex to filter which types of files to download

--resume, -r#

Resume a download.

Default: False

--processes, -p#

Number of processes. Defaults to 4

Default: 4

--threads, -T#

Number of threads per process. Defaults to 20

Default: 20

--benchmark-out, -b#

Path to folder where benchmark data will be written to.

Ex. osmo data download s3://bucket/ /path/to/folder

list#

List a data from a backend URI

osmo data list [-h] [--regex REGEX] [--prefix PREFIX] [--recursive]
               [--no-pager]
               remote_uri [local_path]

Positional Arguments#

remote_uri#: URI where data will be listed for.
local_path#: Path where list data will be written to.

Named Arguments#

--regex, -x#

Regex to filter which types of files to list

--prefix, -p#

Prefix/directory to list from the remote URI.

Default: ''

--recursive, -r#

List recursively.

Default: False

--no-pager#

Do not use a pager to display the list results, print directly to stdout.

Default: False

Ex. osmo data list s3://bucket/ /path/with/file_name

delete#

Delete a data from a backend URI

osmo data delete [-h] [--regex REGEX] remote_uri

Positional Arguments#

remote_uri#: URI where data will be delete from.

Named Arguments#

--regex, -x#: Regex to filter which types of files to delete

Ex. osmo data delete s3://bucket/