1

At work We have this massive storage of media (images and videos)
Size is like 4TB over 1 million files

Because of data lost and recovery effort we now have additional 1TB of recovered files, most are duplicate with different names and timestamps.

I tried multiple software to detect duplicates but they simply crash because of the volume.

I need it to point out the copy and its origin based on content.
And do it relatively fast (3 hours?); I was waiting hours (8+ ) on other software before they crashed.

Is there any software that can handle such task?

Operating system is Windows 10

HDD is RAID 1 8TB NTFS Computer has 8 core i7 CPU With 16GB memory

At this point. I am not sure about the price constraints something I need to check after I get a quote.

Improve this question
6
  • 2
    Welcome! How do you define "relatively fast"? What operating system(s)? How is the volume formatted? Any price considerations? Please update your question with more details. Thanks! – RockPaperLz- Mask it or Casket♦ Feb 17 '20 at 8:01
  • 2
    Thank you! I added Operating system details and more info, let me know what else is missing. – JavaSheriff Feb 17 '20 at 14:48
  • 2
    Thank you for the updates! I added a Windows tag, to indicate that the software is to be for Windows. Do you have any price constraints? Also, given that you have a target time duration, you may want to note the hardware specifications of the system on which the software will run. – RockPaperLz- Mask it or Casket♦ Feb 18 '20 at 12:32
  • 1
    Its a win10 that we use for storage, it has 8 core i7 with 16GB memory , i am not sure about the price constraints something i need to check after i get some kind of a price. – JavaSheriff Feb 18 '20 at 15:26
  • 1
    Both current answers are misleading because the talk is about data recovery so OP needs to find duplicate files, not duplicate photos. He does not need a software to compare the images. – Nakilon Feb 19 '20 at 21:24
2

I don't have a 4TB set of photos at my disposal for testing, but in case you haven't tried the following programs, give them a shot, as they have worked well for me to find duplicate photos:

Improve this answer
1

Both free and will compare similar images:

Improve this answer

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.