HumanVBench Models Setup¶

This directory manages the external models and adapters required for HumanVBench. Please follow the instructions below to ensure all components are correctly initialized and patched.

1. Environment Initialization¶

These models are managed as Git submodules. To clone the contents, run the following command from the project root:

git submodule update --init --recursive

2. Applying Custom Patches¶

We maintain custom modifications for these models via .diff files. You must apply these patches after initializing the submodules to ensure the pipeline functions correctly:

# Navigate to this directory
cd thirdparty/humanvbench_models

# Apply patch to YOLOv8-human
cd YOLOv8_human && git apply ../YOLOv8_human_changes.diff && cd ..

# Apply patch to Light-ASD
cd Light-ASD && git apply ../Light-ASD_changes.diff && cd ..

# Apply patch to SenseVoice
cd SenseVoice && git apply ../SenseVoice_changes.diff && cd ..

3. External Weights Download¶

The following weight file must be downloaded manually and placed in the specific directory:

Model	File	Target Path	Download Source
Light-ASD	`sfd_face.pth`	`./Light-ASD/model/faceDetector/s3fd/`	HuggingFace - SyncNet