data_juicer.ops.grouper.naive_grouper module#

class data_juicer.ops.grouper.naive_grouper.NaiveGrouper(*args, **kwargs)[source]#

Bases: Grouper

Group all samples to one batched sample.

__init__(*args, **kwargs)[source]#

Initialization method.

Parameters:

  • args – extra args

  • kwargs – extra args

process(dataset)[source]#

Dataset –> dataset.

Parameters:

dataset – input dataset

Returns:

dataset of batched samples.