data_juicer.ops.mapper.video_camera_calibration_droidcalib_mapper module

class data_juicer.ops.mapper.video_camera_calibration_droidcalib_mapper.VideoCameraCalibrationDroidCalibMapper(*args, **kwargs)

Bases: Mapper

Extract camera intrinsics from videos using DroidCalib.

Notice: This operator will download the DroidCalib component from GitHub at runtime. This component follows the AGPL-3.0 license, please be aware for commercial use.

__init__(weights_path: str | None = None, image_size: list = [384, 512], stride: int = 2, max_frames: int = 300, buffer: int = 1024, beta: float = 0.3, filter_thresh: float = 2.4, warmup: int = 8, keyframe_thresh: float = 4.0, frontend_thresh: float = 16.0, frontend_window: int = 25, frontend_radius: int = 2, frontend_nms: int = 1, backend_thresh: float = 22.0, backend_radius: int = 2, backend_nms: int = 3, upsample: bool = False, disable_vis: bool = True, verbose: bool = False, tag_field_name: str = 'camera_calibration_droidcalib_tags', *args, **kwargs)

Initialization method.

Parameters:

• weights_path – Path to the model weights.

• image_size – Target image size [height, width].

• stride – Frame stride.

• max_frames – Maximum number of frames to process.

• buffer – Buffer size for Droid.

• beta – Weight for translation / rotation components of flow.

• filter_thresh – Motion threshold before considering new keyframe.

• warmup – Number of warmup frames.

• keyframe_thresh – Threshold to create a new keyframe.

• frontend_thresh – Add edges between frames within this distance.

• frontend_window – Frontend optimization window.

• frontend_radius – Force edges between frames within radius.

• frontend_nms – Non-maximal suppression of edges.

• backend_thresh – Backend threshold.

• backend_radius – Backend radius.

• backend_nms – Backend NMS.

• upsample – Whether to upsample.

• disable_vis – Whether to disable visualization.

process_single(sample, rank=None)

For sample level, sample –> sample

Parameters:

sample – sample to process

Returns:

processed sample