data_juicer_agents.tools.plan.build_system_spec.logic module

Pure logic for build_system_spec.

data_juicer_agents.tools.plan.build_system_spec.logic.build_system_spec(*, custom_operator_paths: Iterable[Any] | None = None, np: int | None = None, executor_type: str | None = None, **kwargs: Any) → Dict[str, Any]

Build system spec with complete config dynamically loaded from Data-Juicer.

This function now loads ALL system configuration fields from Data-Juicer, ensuring automatic sync with any upstream changes.

Parameters:

• custom_operator_paths – Optional list of custom operator paths

• np – Optional number of processes

• executor_type – Optional executor type

• **kwargs – Any additional system config options (must be valid DJ system config fields — unknown keys will raise ValueError)

Returns:

Dict containing the built system spec and validation results