![]() |
MS-DEFCON 2:
Patch reliability is unclear. Unless you have an immediate, pressing need to install a specific patch, don't do it.
|
-
A confused mass of images needs sorting out, any recommendations?
Home › Forums › AskWoody support › Windows › Windows 10 › Questions: Win10 › A confused mass of images needs sorting out, any recommendations?
Topic Resolution: ResolvedTagged: deduplication
- This topic has 14 replies, 13 voices, and was last updated 10 months, 3 weeks ago.
Viewing 8 reply threads-
AuthorPosts
-
-
February 2, 2020 at 11:03 am #2124625
aquatarkus
AskWoody PlusMy wife’s laptop failed and I replaced it, using what I thought was a full backup of her previous laptop to recover her data. While working through her photo archives she found many missing images so I have gone through several older backups retrieving folders of photos. In the process I learned that (a) she is an inveterate tinkerer with her file names and folder names and structures, and (b) import of images from phone to device isn’t always performed consistently. The net result is we have a lot of duplicated images in different locations and need to go through them identifying and eliminating duplicates.
I’m guessing this is not a problem that is unique to us and some members here will have had some experience in this field; can you recommend anything that would make this task more manageable?
At the moment there are approx 40,000 images and short videos in her Pictures library and I’d estimate that up to 25% of these are duplicates.
Thanks for any suggestions
Cheers
T -
February 2, 2020 at 12:20 pm #2124650
Kirsty
ManagerThe net result is we have a lot of duplicated images in different locations and need to go through them identifying and eliminating duplicates.
@Oldergeeks-com have a freeware program that can highlight duplicated files, that might be worth having a look at – usual proviso, do a backup before making such wholesale changes 🙂
AllDup v4.4.10 (last updated Nov. 20, 2019)3 users thanked author for this post.
-
March 2, 2020 at 8:32 am #2174905
chaloots
AskWoody PlusMore often than not I’ve downloaded/installed apps for a specific purpose, all the while being oblivious to or forgetting that an already existing installed app was capable of performing that very same function.
While I’m also aware of the dubious reputation Ccleaner has created for themselves over the past year or so, I use an older portable version, 5.46, which has a built-in duplicate finder, with options to fine tune the search. Point being: you too may already have a dupe finder feature tucked away in an app you may typically use for a different purpose.
The duration of a minute depends on which side of the bathroom door you're on.
-
March 4, 2020 at 12:27 pm #2176351
EP
AskWoody_MVPSpeaking of CCleaner, avast just released version 5.64.7613 of CCleaner recently, which they declare this new version the last one to support Windows XP & Vista:
https://www.ccleaner.com/news/release-announcements/2020/03/03/ccleaner-v5647613
– Version 5.64.7577 is the final planned build for Windows XP and Vista
-
This reply was modified 10 months, 3 weeks ago by
EP.
-
March 4, 2020 at 4:14 pm #2176489
JohnW
AskWoody LoungerThat XP & Vista final version of CCleaner should be fine for a good long while, considering that they no longer have to keep pace with changes in those old operating systems… 🙂
But the worst case is that you might miss out on some new CCleaner features developed down the road, but as a mature application that’s probably not likely to be a deal breaker, and it should remain quite useful.
-
This reply was modified 10 months, 3 weeks ago by
-
-
-
February 2, 2020 at 12:22 pm #2124651
Microfix
AskWoody MVPI was initially thinking of using some sort of exif (metadata) duplicate finder but to no avail 🙁
Upon this search I came across https://www.auslogics.com/en/software/duplicate-file-finder/
which may be of some use in sorting the image duplication out.
No problem can be solved from the same level of consciousness that created IT- AE1 user thanked author for this post.
-
February 2, 2020 at 1:05 pm #2124669
Alex5723
AskWoody PlusAt the moment there are approx 40,000 images and short videos in her Pictures library and I’d estimate that up to 25% of these are duplicates.
Visual Similarity Duplicate Image Finder :
“will find all similar and duplicate images, pictures and photos in a folder and its subfolders, computer or network in order to organize photos.
The duplicate image finder uses advanced algorithms to find duplicate photos in a way that a human does. Due to that fact it can find duplicate images even if they are in different image formats, different bit depths, and image sizes.”..https://www.mindgems.com/products/VS-Duplicate-Image-Finder/VSDIF-About.htm
-
February 2, 2020 at 1:33 pm #2124700
bbearren
AskWoody MVPI use NameEXIF for all my digital photos. The only renaming options are by date taken, which is taken from the file metadata. I use yyyy-mm-dd-time, then use the date to sort into folders named by year/sub-folders named by month.
It will rename large batches in a single run. For duplicates it adds a number.
Create a fresh drive image before making system changes/Windows updates, in case you need to start over!"When you're troubleshooting, start with the simple and proceed to the complex."—M.O. Johns"Experience is what you get when you're looking for something else."—Sir Thomas Robert Deware-
This reply was modified 11 months, 3 weeks ago by
bbearren.
-
This reply was modified 11 months, 3 weeks ago by
-
February 3, 2020 at 12:09 am #2124926
aquatarkus
AskWoody Plus -
March 2, 2020 at 5:56 am #2174801
hhodges
AskWoody LoungerIt’s remarkable how such a seeming easy task it ought to be to identify duplicates, but it’s not. Various schemes are used and the tools rarely tell you how they work. Each can use a different method, CRC, Hash Values, etc to compare but the actual calculation can be complex. I’ve learned to rely on CloneMaster. It’s quite reliable at finding exact duplicates and after checking often to be sure, I allow the tool to be automatic. But it’s somewhat slow on a large collection because it’s single threaded. For a muti-threaded, faster tool I use DupDetectorPro which is multi-threaded and can even work across a network. For the average user, CloneMaster would be fine. If you have a bunch of de-duping work particularly across a network DupDetector is solid.
-
March 2, 2020 at 8:34 am #2174908
-
-
March 2, 2020 at 11:32 am #2175050
DaxPagan
AskWoody PlusRecently, there was a discussion on software for finding near-duplicate images. (https://www.askwoody.com/forums/topic/a-confused-mass-of-images-needs-sorting-out-any-recommendations/) I’m interested in finding near-duplicate video files.
I have a lot of videos downloaded from YouTube, Vimeo, or acquired from others over time. I know there are “near duplicates” – videos that differ by resolution or size differences because they were downloaded at different times, downloaded by different people, uploaded by different people, trimmed/edited slightly differently, etc.
General duplicate-finding software can find exact matches for size or title of video files. Is there software that can search the content of the file to find “near duplicates” of video files like there is for image files?
-
March 2, 2020 at 1:51 pm #2175136
Alex5723
AskWoody PlusTry Video Duplicates Finder : https://www.visioforge.com/video-duplicates-finder-sample
The SDK can detect a video even if it is integrated into another clip, or if only a piece of it is available…
-
March 4, 2020 at 3:45 pm #2176469
-
-
-
March 2, 2020 at 12:05 pm #2175088
Gingermum
AskWoody LoungerFor many years I have used “Duplicate File Finder” by Rashid Hoda and I admit I am still using an old version. It’s free and allows me to select which folders to search and what type of file to search for or if I want to find any type. All duplicate files are shown with their path and by default nothing is ticked for deletion. I can then select one by one which to delete. (I do find this useful) or just opt to delete all duplicates. I can also see a preview of the file I have currently selected. Really happy with it. My old version doesn’t work across a network but possibly the newer one does. As it’s free, give it a try.
-
-
AuthorPosts
Viewing 8 reply threads -
Welcome to our unique respite from the madness.
It's easy to post questions about Windows 10, Win8.1, Win7, Surface, Office, or browse through our Forums. Post anonymously or register for greater privileges. Keep it civil, please: Decorous Lounge rules strictly enforced. Questions? Contact Customer Support.

Plus Membership
Donations from Plus members keep this site going. You can identify the people who support AskWoody by the Plus badge on their avatars.
AskWoody Plus members not only get access to all of the contents of this site -- including Susan Bradley's frequently updated Patch Watch listing -- they also receive weekly AskWoody Plus Newsletters (formerly Windows Secrets Newsletter) and AskWoody Plus Alerts, emails when there are important breaking developments. Click here for details and to sign up.
Search The Lounge
Recent Replies
b on Outlook 2019 send and receive
26 minutes agoglnz on Comments on Abbodi86’s Win7 ESU Installer Script (2020 Archive)
32 minutes agoDriftyDonN on Find the cable modem that’s just right for your ISP
55 minutes agoOscarCP on Do we need Java?
1 hour, 5 minutes agoDriftyDonN on Find the cable modem that’s just right for your ISP
1 hour, 6 minutes agoSusan Bradley on Giving you the choice
1 hour, 11 minutes agoanonymous on So I opened up an HP and where’s the hard drive?
1 hour, 13 minutes agoOscarCP on Giving you the choice
1 hour, 17 minutes agoDriftyDonN on Giving you the choice
1 hour, 28 minutes agoBundaburra on Can’t install any programs since Win 2004 update
1 hour, 30 minutes agoDonald Crossman on Can’t add, or remove, any bluetooth device
2 hours, 28 minutes ago941071 on Need inexpensive domain
2 hours, 41 minutes agoKirsty on Need inexpensive domain
2 hours, 49 minutes agoanonymous on Need inexpensive domain
2 hours, 53 minutes agolikescats on Files don’t copy from Win7 HDD to Win10 computer
3 hours, Just nowStill Anonymous on This should be the best patching experience
3 hours, 47 minutes agocellsee6 on Hasta la vista, TeamViewer Free
4 hours, 1 minute agotpbrownec on SFC errors not repairable, upgrade to 2004?
4 hours, 9 minutes agoPaul T on Google threatens to remove search engine from Australia
4 hours, 19 minutes agoPaul T on Do we need Java?
4 hours, 24 minutes agoOscarCP on Google threatens to remove search engine from Australia
4 hours, 25 minutes agoPaul T on Can’t add, or remove, any bluetooth device
4 hours, 32 minutes agoOscarCP on Do we need Java?
4 hours, 33 minutes agoanonymous on Can’t add, or remove, any bluetooth device
4 hours, 36 minutes agoanonymous on Can’t add, or remove, any bluetooth device
4 hours, 37 minutes agoPaul T on Windows Defender – yes or no?
4 hours, 48 minutes agoPaul T on Can’t install any programs since Win 2004 update
4 hours, 55 minutes agoPaul T on Can’t add, or remove, any bluetooth device
5 hours, 21 minutes agoPaul T on SFC errors not repairable, upgrade to 2004?
5 hours, 25 minutes agoanonymous on Can’t add, or remove, any bluetooth device
5 hours, 28 minutes ago
Recent Topics
-
Need inexpensive domain
2 hours, 41 minutes ago
-
Outlook 2019 send and receive
26 minutes ago
-
Can’t add, or remove, any bluetooth device
2 hours, 28 minutes ago
-
Customize the mouse w10 2004–19041.746
7 hours, 19 minutes ago
-
Can’t install any programs since Win 2004 update
1 hour, 30 minutes ago
-
SFC errors not repairable, upgrade to 2004?
4 hours, 9 minutes ago
-
Slow file copy
7 hours, 42 minutes ago
-
Do we need Java?
1 hour, 6 minutes ago
-
Windows 10 version changes
6 hours, 33 minutes ago
-
Lost Post
12 hours, 27 minutes ago
-
Hasta la vista, TeamViewer Free
4 hours, 1 minute ago
-
Files don’t copy from Win7 HDD to Win10 computer
3 hours ago
-
Does the HP Spectre Notebook (2016 model) have a removable wireless LAN Card?
21 hours, 44 minutes ago
-
Windows 10 2004 and Intel Ethernet Problem Solving
8 hours, 46 minutes ago
-
KB4023057 while on Win10-2004
9 hours, 53 minutes ago
-
MS Shared Experience warning
1 day, 3 hours ago
-
Google threatens to remove search engine from Australia
4 hours, 20 minutes ago
-
macOS Catalina running on iPad Pro 2020
1 day, 7 hours ago
-
How to check if someone else accessed your Google account
1 day, 19 hours ago
-
This should be the best patching experience
3 hours, 48 minutes ago
-
Windows 10 Insider build 19042.782 (20H2) released to Beta & Release Preview
2 days ago
-
Browser Settings Block Linux Mint Downloads
2 days ago
-
Windows 10 Insider Preview build 20296 released to DEV Channel
2 days, 8 hours ago
-
Google Analytics Notice
2 days, 8 hours ago
-
Beeper combines 15 chatting apps
2 days, 4 hours ago
-
File Explorer cannot see external 2Tb drive in full
2 days, 11 hours ago
-
Office 2010 updates.
1 day, 11 hours ago
-
What is ‘Meet Now’
2 days, 11 hours ago
-
Linux is now completely usable on the Mac mini M1
3 days, 7 hours ago
-
User Feed Synchronization – Disable/Delete Task?
2 days, 8 hours ago
Search for Topics
Recent blog posts
Key Links
Copyright © 2004 – 2021 AskWoody Tech LLC. All rights reserved.