Batch Video Duplicate Removal Tool

Batch process video materials, supporting multiple deduplication methods such as mirroring, picture-in-picture, scaling, speed changes, and frame extraction, and automatically skipping duplicate files

Bug report

Loading tool, please wait...

If the online tool fails to load or run, try the desktop tool.https://tools.yikeaigc.com/

Tool Usage

Return to old version

A desktop version is available with more powerful, stable features. Open desktop version

Instructions

Software Usage Instructions

Select the media folder: Click the "Browse" button or drag a folder directly into the input box to select the media directory containing the videos to be processed. Supports more than ten video formats, including MP4, MOV, AVI, MKV, FLV, and WMV.
Set traversal options:
- Traverse subdirectories: When checked, video files in all subdirectories will be processed recursively
- Preserve original path structure: When checked, subdirectories will be created in the save directory according to the original folder hierarchy
Select save directory: Set the save location for the processed videos and optionally choose the output format. When duplicate file names are encountered, a sequence number will be automatically appended to the file name.
Set picture-in-picture media (optional): If you need to use the picture-in-picture feature, select the folder containing the picture-in-picture media videos.
Configure deduplication parameters:
- Mirror: Horizontally flip the video
- Picture-in-picture: Randomly select and overlay picture-in-picture media; the opacity range can be set (recommended 1%-2%)
- Zoom: Randomly scale and then center-crop back to the original resolution; the percentage range can be set (recommended 110%-120%)
- Speed change: Randomly adjust playback speed with synchronized audio processing; the speed range can be set (recommended 0.9x-1.1x)
- Frame extraction: Drop one frame at the set interval in seconds and restore the original frame rate to change inter-frame characteristics
Start processing: Click the "Start" button, and the tool will automatically process all videos. During processing, duplicate media will be automatically identified and skipped using SHA256 hashes.
View progress: During processing, you can view the progress bar and log information in real time, and stop processing at any time.

FAQ

A: The tool supports more than ten mainstream video formats, including MP4, MOV, AVI, MKV, FLV, WMV, M4V, WebM, TS, MPEG, MPG, 3GP, and M2TS. The output format can be selected in the save directory section.

A: The picture-in-picture feature randomly selects a video from the specified picture-in-picture media folder and overlays it on the original video at the set opacity (such as 1%-2%). This method can change the frame characteristics of the video without noticeably affecting the visual experience, achieving a deduplication effect. Before using it, you need to prepare picture-in-picture media and select the corresponding folder.

A: No. When performing speed adjustment, the tool also uses FFmpeg's atempo filter to synchronously adjust the audio speed, ensuring that audio and video always stay in sync. It is recommended to set the speed range between 0.9x and 1.1x to ensure a good viewing experience.

A: The frame dropping feature discards one frame at the set time interval (such as every 3 seconds), then restores the video to the original frame rate. This processing method can change the inter-frame characteristics of the video, making the processed video differ from the original at the frame level, thereby achieving deduplication.

A: The tool uses the SHA256 hash algorithm to calculate a content fingerprint for each video file. During processing, if a video is detected with the same hash value as one processed before, the file is automatically skipped to avoid repeatedly processing materials with the same content.

A: The following measures are recommended: 1) Process videos in batches, handling only some videos each time; 2) Close other programs that use a lot of memory; 3) For particularly large video files, split them first and then process them; 4) Ensure the system has enough disk space for temporary file storage.

A: Yes. The tool supports enabling multiple features at the same time, such as mirroring, picture-in-picture, zoom, speed adjustment, and frame extraction. Each feature will be applied to the video in sequence. The more features you enable, the greater the difference between the processed video and the original, but the processing time will also increase accordingly. We recommend choosing the appropriate combination of features based on your actual needs.