data_juicer.ops.mapper.agent_trace_coherence_mapper module#
LLM: session trace coherence on text field (1–5).
Inspired by OpenJudge trajectory-style eval; DJ: unified 1–5, capped excerpt.
Reference: https://agentscope-ai.github.io/OpenJudge/built_in_graders/agent_graders/ #trajectoryaccuracygrader
- class data_juicer.ops.mapper.agent_trace_coherence_mapper.AgentTraceCoherenceMapper(*args, **kwargs)[source]#
Bases:
_DialogQualityLLMMapperBaseCoherence of the flattened session
text(goal focus, few detours).- OP_NAME = 'agent_trace_coherence_mapper'#
- META_KEY = 'agent_trace_coherence'#
- EVAL_KIND = 'agent_trace'#