Executable¶

class tripy.Executable(executable, arg_names, output_devices)[source]¶

Bases: object

Represents a compiled executable generated by the compiler.

See also

compile()

static load(path: str) → Executable[source]¶

Loads a executable from the provided path.

Parameters:: path (str) – The path from which to load the exectuable.
Returns:: The executable object loaded from the file.
Return type:: Executable

Example: Save and load executable

Save and load executable¶

import os

def add(a, b):
    return a + b

compiled_add = tp.compile(
    add,
    args=[
        tp.InputInfo(([1, 2, 3],), dtype=tp.float32),
        tp.InputInfo(([1, 2, 3],), dtype=tp.float32),
    ],
)


# Assuming `out_dir` is the directory containing the executable:
executable_file = os.path.join(out_dir, "executable.json")
loaded_executable = tp.Executable.load(executable_file)

>>> loaded_executable
Executable(a: Tensor, b: Tensor) -> Tensor

Output:¶

[I] /tmp/tmpnynvez0q does not exist, creating now.

__call__(*args, **kwargs) → Tensor | Sequence[Tensor][source]¶

Invokes the executable with the specified tensor arguments.

Parameters:

*args – Positional arguments. Must be of type Tensor .
**kwargs – Keyword arguments. Must be of type Tensor .

Returns:

The output Tensor s of the compiled function.

Return type:

Tensor | Sequence[Tensor]

Example

Example¶

def add(a, b):
    return a + b

compiled_add = tp.compile(
    add,
    args=[
        tp.InputInfo((1,), dtype=tp.float32),
        tp.InputInfo((1,), dtype=tp.float32),
    ],
)

a = tp.ones((1,), dtype=tp.float32)
b = tp.ones((1,), dtype=tp.float32)

out = compiled_add(a, b)

>>> a
tensor([1.0000], dtype=float32, loc=gpu:0, shape=(1,))
>>> b
tensor([1.0000], dtype=float32, loc=gpu:0, shape=(1,))
>>> out
tensor([2.0000], dtype=float32, loc=gpu:0, shape=(1,))

save(path: str) → None[source]¶

Saves this executable to the provided path.

Parameters:: path (str) – The path at which to save the executable.
Return type:: None

Example: Save executable

Save executable¶

import os

def add(a, b):
    return a + b

compiled_add = tp.compile(
    add,
    args=[
        tp.InputInfo(([1, 2, 3],), dtype=tp.float32),
        tp.InputInfo(([1, 2, 3],), dtype=tp.float32),
    ],
)

# Assuming `out_dir` is the desired output directory:
executable_file = os.path.join(out_dir, "executable.json")
compiled_add.save(executable_file)

Output:¶

[I] /tmp/tmpnkonb_g_ does not exist, creating now.