Duplicate file finder

[Blizzforte]

Hi,

 

I need software that can find duplicate files like images and videos. Just finding files with the same name isn't enough. It need to only find files that have the same and the same size. Because I have lots of images that are named like 

 

1_p

1_p (1)

1_p (2)

 

Now if for example 1_p and 1_p (1) have the same size but 1_p (2) doesn't, I need the program to only find 1_p (1), because that's the one that is the only duplicate with almost the same name. As for videos, some videos that are duplicates have different sizes although they're the same video. But maybe some MBs are missing due to an download error, so those files are also needed and shouldn't be deleted, so I have the full sized file and the file with the missing MBs, but not the complete duplicate of those three files.

 

[Eigenvektor]

To find identical files, you'd compare e.g. their hash code (MD5, SHA1, …). If the hash code is different, the files are different. If the hash code is identical, there's a high probability the files are identical. In this case you'd then have to compare them bit by bit. This could be automated with a script or program.

 

12 minutes ago, Blizzforte said:

As for videos, some videos that are duplicates have different sizes although they're the same video.

No trivial way to identify that, since you'd have to actually look at the videos and compare them visually to determine how similar they are.

[Rugg]

The first part of this could probably be done pretty fast in some code. I'm a little confused on your second part about videos with different file sizes though.