SentenceTransformer#

class sdm.processing.text.SentenceTransformer(model_name: str, *, batch_size: int = 32)#

Bases: Processor

Transform text columns with a sentence_transformers.SentenceTransformer model.

Parameters:

  • model_name (str) – Model name or local path passed to sentence_transformers.SentenceTransformer

  • batch_size (int) – Batch size passed to sentence_transformers.SentenceTransformer.encode(). Adjusting the batch size can significantly improve processing speed. The optimal value depends on your hardware, model size, precision, and input length.

Capabilities#

Handled Semantic Types

text

Requires Fitting

❌