data_juicer.format.empty_formatter module

class data_juicer.format.empty_formatter.EmptyFormatter(length, feature_keys: List[str] = [], *args, **kwargs)

基类：BaseFormatter

The class is used to create empty data.

SUFFIXES = []

__init__(length, feature_keys: List[str] = [], *args, **kwargs)

Initialization method.

参数:

• length -- The empty dataset length.

• feature_keys -- feature key name list.

property null_value

load_dataset(*args, **kwargs)

class data_juicer.format.empty_formatter.RayEmptyFormatter(length, feature_keys: List[str] = [], *args, **kwargs)

基类：BaseFormatter

The class is used to create empty data for ray.

SUFFIXES = []

__init__(length, feature_keys: List[str] = [], *args, **kwargs)

Initialization method.

参数:

• length -- The empty dataset length.

• feature_keys -- feature key name list.

property null_value

load_dataset(*args, **kwargs)