HumanVBench Models Setup#

This directory manages the external models and adapters required for HumanVBench. Please follow the instructions below to ensure all components are correctly initialized and patched.

1. Environment Initialization#

These models are managed as Git submodules. To clone the contents, run the following command from the project root:

git submodule update --init --recursive

2. Applying Custom Patches#

We maintain custom modifications for these models via .diff files. You must apply these patches after initializing the submodules to ensure the pipeline functions correctly:

# Navigate to this directory
cd thirdparty/humanvbench_models

# Apply patch to YOLOv8-human
cd YOLOv8_human && git apply ../YOLOv8_human_changes.diff && cd ..

# Apply patch to Light-ASD
cd Light-ASD && git apply ../Light-ASD_changes.diff && cd ..

# Apply patch to SenseVoice
cd SenseVoice && git apply ../SenseVoice_changes.diff && cd ..

3. External Weights Download#

The following weight file must be downloaded manually and placed in the specific directory:

Model	File	Target Path	Download Source
Light-ASD	`sfd_face.pth`	`./Light-ASD/model/faceDetector/s3fd/`	HuggingFace - SyncNet