data_juicer.ops.mapper.video_camera_calibration_droidcalib_mapper module

class data_juicer.ops.mapper.video_camera_calibration_droidcalib_mapper.VideoCameraCalibrationDroidCalibMapper(*args, **kwargs)

基类：Mapper

Extract camera intrinsics from videos using DroidCalib.

Notice: This operator will download the DroidCalib component from GitHub at runtime. This component follows the AGPL-3.0 license, please be aware for commercial use.

__init__(weights_path: str | None = None, image_size: list = [384, 512], stride: int = 2, max_frames: int = 300, buffer: int = 1024, beta: float = 0.3, filter_thresh: float = 2.4, warmup: int = 8, keyframe_thresh: float = 4.0, frontend_thresh: float = 16.0, frontend_window: int = 25, frontend_radius: int = 2, frontend_nms: int = 1, backend_thresh: float = 22.0, backend_radius: int = 2, backend_nms: int = 3, upsample: bool = False, disable_vis: bool = True, verbose: bool = False, tag_field_name: str = 'camera_calibration_droidcalib_tags', *args, **kwargs)

Initialization method.

参数:

• weights_path -- Path to the model weights.

• image_size -- Target image size [height, width].

• stride -- Frame stride.

• max_frames -- Maximum number of frames to process.

• buffer -- Buffer size for Droid.

• beta -- Weight for translation / rotation components of flow.

• filter_thresh -- Motion threshold before considering new keyframe.

• warmup -- Number of warmup frames.

• keyframe_thresh -- Threshold to create a new keyframe.

• frontend_thresh -- Add edges between frames within this distance.

• frontend_window -- Frontend optimization window.

• frontend_radius -- Force edges between frames within radius.

• frontend_nms -- Non-maximal suppression of edges.

• backend_thresh -- Backend threshold.

• backend_radius -- Backend radius.

• backend_nms -- Backend NMS.

• upsample -- Whether to upsample.

• disable_vis -- Whether to disable visualization.

process_single(sample, rank=None)

For sample level, sample --> sample

参数:

sample -- sample to process

返回:

processed sample