data_juicer.ops.mapper.dialog_non_repetition_mapper module

LLM: new info vs prior assistant turns (1–5).

Inspired by OpenJudge-style repetition checks; DJ: same prompt window only.

Reference: https://agentscope-ai.github.io/OpenJudge/built_in_graders/multi_turn/ #responserepetitiongrader

class data_juicer.ops.mapper.dialog_non_repetition_mapper.DialogNonRepetitionMapper(*args, **kwargs)

Bases: _DialogTurnQualityMapper

New information vs prior assistant turns in the same prompt window.

OP_NAME = 'dialog_non_repetition_mapper'

META_KEY = 'dialog_non_repetition'