At work We have this massive storage of media (images and videos)
Size is like 4TB over 1 million files

Because of data lost and recovery effort we now have additional 1TB of recovered files, most are duplicate with different names and timestamps.

I tried multiple software to detect duplicates but they simply crash because of the volume.

I need it to point out the copy and its origin based on content.
And do it relatively fast (3 hours?); I was waiting hours (8+ ) on other software before they crashed.

Is there any software that can handle such task?

Operating system is Windows 10

HDD is RAID 1 8TB NTFS Computer has 8 core i7 CPU With 16GB memory

At this point. I am not sure about the price constraints something I need to check after I get a quote.

  • 2
    Welcome! How do you define "relatively fast"? What operating system(s)? How is the volume formatted? Any price considerations? Please update your question with more details. Thanks! Commented Feb 17, 2020 at 8:01
  • 2
    Thank you! I added Operating system details and more info, let me know what else is missing. Commented Feb 17, 2020 at 14:48
  • 2
    Thank you for the updates! I added a Windows tag, to indicate that the software is to be for Windows. Do you have any price constraints? Also, given that you have a target time duration, you may want to note the hardware specifications of the system on which the software will run. Commented Feb 18, 2020 at 12:32
  • 1
    Its a win10 that we use for storage, it has 8 core i7 with 16GB memory , i am not sure about the price constraints something i need to check after i get some kind of a price. Commented Feb 18, 2020 at 15:26
  • 1
    Both current answers are misleading because the talk is about data recovery so OP needs to find duplicate files, not duplicate photos. He does not need a software to compare the images.
    – Nakilon
    Commented Feb 19, 2020 at 21:24

2 Answers 2


I don't have a 4TB set of photos at my disposal for testing, but in case you haven't tried the following programs, give them a shot, as they have worked well for me to find duplicate photos:


Both free and will compare similar images:

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.