data_juicer.format.empty_formatter module#

class data_juicer.format.empty_formatter.EmptyFormatter(length, feature_keys: List[str] = [], *args, **kwargs)[source]#

Bases: BaseFormatter

The class is used to create empty data.

SUFFIXES = []#
__init__(length, feature_keys: List[str] = [], *args, **kwargs)[source]#

Initialization method.

Parameters:

  • length – The empty dataset length.

  • feature_keys – feature key name list.

property null_value#
load_dataset(*args, **kwargs)[source]#
class data_juicer.format.empty_formatter.RayEmptyFormatter(length, feature_keys: List[str] = [], *args, **kwargs)[source]#

Bases: BaseFormatter

The class is used to create empty data for ray.

SUFFIXES = []#
__init__(length, feature_keys: List[str] = [], *args, **kwargs)[source]#

Initialization method.

Parameters:

  • length – The empty dataset length.

  • feature_keys – feature key name list.

property null_value#
load_dataset(*args, **kwargs)[source]#