ISSUE 18.32 • 2021-08-23 BEST UTILITIES By Deanna McElveen Yes, those seashell pictures you took from the ocean were great, and that recipe for Frito
[See the full post at: Freeware Spotlight — Anti-Twin]
![]() |
Patch reliability is unclear. Unless you have an immediate, pressing need to install a specific patch, don't do it. |
SIGN IN | Not a member? | REGISTER | PLUS MEMBERSHIP |
-
Freeware Spotlight — Anti-Twin
Home » Forums » Newsletter and Homepage topics » Freeware Spotlight — Anti-Twin
- This topic has 11 replies, 10 voices, and was last updated 1 year, 9 months ago.
AuthorTopicDeanna McElveen
AskWoody_MVPViewing 6 reply threadsAuthorReplies-
Alex5723
AskWoody Plus -
Chris Greaves
AskWoody PlusInteresting product, and I favour the configurations.
I note the note about shortcut links towards the end , reminiscent of Sun Microsystem’s triple-tier data storage system.
I have spent some time looking at content matching, and am currently at the stage of optimizing the “binary compare” mechanism. This gets tricky with specific file types. MP3 content can be broken into chunks by the meta-data tags, but I hadn’t started on image files so “pixels” is a good hit.
Back to links: Vitally important and a principle cause of failure of any system where deleting duplicates can leave hard-coded links (say, to an image file) hanging, basically destroying a word-processing document which wakes up to find all its hard-coded image files gone!
A great deal hinges on an individual user’s definition of the term “DUPLICATE”.
One version of “Jingle Bells” in my T:\Music\ folder is enough, but I will never have enough versions of “Charles-Marie Widor Toccata from Symphony No. 5 for Organ & Orchestra”; preferably at amplified volume! For me, any version of Jingle Bells is a duplicate to be tossed out of the nest, but Widor? No!
Cheers
Chris
Unless you're in a hurry, just wait.
-
Ascaris
AskWoody MVPI’ve been using the Linux utility FSLint (file system lint) to de-duplicate files, but the devs of that program have recommended Czkawka, a reimplementation of the FSLint (which is written in Python) in Rust, with additional features (including picture deduplication when there is no checksum match). It has Windows, Linux, and Mac versions, and is free and open source.
Dell XPS 13/9310, i5-1135G7/16GB, KDE Neon
XPG Xenia 15, i7-9750H/16GB & GTX1660ti, KDE Neon
Acer Swift Go 14, i5-1335U/16GB, KDE Neon -
Microfix
AskWoody MVPfslint isn’t present in the ubuntu 20.04 LTS repos as it uses the depreciated Python 2.6 and some now, obsolete dependancies 🙁
Have used it in the past on 18.04 LTS and previous to skim off excess and duplication to good effect. Hope the author updates it to conform.Keeping IT Lean, Clean and Mean!
-
anonymous
GuestI need and want those duplicates. It is easier to find the file when I need it when it is filed under alternate categories/topics. And it is safer in case one of them gets corrupted.
YMMV
What windoze needs is a better way to tag files for finding them so I dont have to add tags into the name of the file when I save it.
-
access-mdb
AskWoody MVPIt does – two ways. When you save a new file, there’s an option under the name “more options”. this allows you to enter a tag (amongst other things). You can save as an existing file and save the tagged file over the old.
The second is File Explorer. Right click on the file name and right click. Choose properties and click the tag line. You can enter a tag this way. You can also select a number of files and tag them all.
To find files with a particular tag, type tag:string and it will find all files with a tag with that string.
Note that only files with a tag option can be tagged e.g. all office files. If there’s no tag option in properties, this can’t be done. I’ve only just discovered this so they may be other options – searching with other keywords is possible in File Explorer
Eliminate spare time: start programming PowerShell
dkv98446
AskWoody LoungerThank you for a well written, and informative article.
Over the years I have used Anti-Twin to help control my obsession for backing up my photos. I have found it to be easy to use and very accurate.
There is one peculiarity, I have accepted, but do not understand. Occasionally I will run the program looking for 100% duplicates in a directory, and get zero records found. But when I rerun against the same directory looking for less than 100%, the results show files with 100%.
Do you have any suggestions for a similar program, which works with files in the cloud?
Dave. v.
-
Ascaris
AskWoody MVPMy guess is that it’s rounding error.
If you search for 100% duplicates, it could be looking for the highest level of similarity it is capable of detecting, which it defines as 100%. The photos it finds in a lower match level search, and reports as 100%, might be just below that threshold, at say 99.5%, which it rounds up to 100% for the display, but is still below the threshold when you set it to 100%. Just a guess; I have never used the program, so I don’t have any direct experience.
Dell XPS 13/9310, i5-1135G7/16GB, KDE Neon
XPG Xenia 15, i7-9750H/16GB & GTX1660ti, KDE Neon
Acer Swift Go 14, i5-1335U/16GB, KDE Neon
DavidW
AskWoody PlusThere are many utilities to find duplicate files. But, for some unexplainable reasons I can’t find a utility to find the ‘comlementary’ of duplicate files or call it the list of all mutually exclusive files between two (and ideally more) paths, A and B. To put it in other words if not clear, list all files that exist in path A and NOT in path B and vice versa.
(Notes: I am surprise because it takes adding/changing few lines of code of a ‘find duplicates’ utility to accomplish its complementary).As usual, there should be filters for at least file types, both for included and excluded files.
Also as usual, comparison method options should be: 1. File’s name+time-stamp(of last change)+size, 2. File’s MD5, 3. File’s SHA.
I don’t mind to pay for a good professional application.
Thanks,
David-
tabletguy
AskWoody Plus
WSMajorSteve
AskWoody PlusI’ve just taken Anti-Twin for a spin, and it’s amazing. I have had two iPhones, separated by a brief return to Android. Using iCloud, the older one placed photos on my PC in Pictures\iCloud\Downloads, whilst the newer one separates them by year Pictures\iCloud\Downloads\2019. Where a picture had been transferred to the Android phone and back to the new iPhone, I ended up with a copy in both locations. In addition, when I got O365, I started using my 1TB OneDrive to back up my photos, so they also appeared in Camera Uploads. Then I would gradually move them from there to named folders under My Photo Library. (See the attached photo if this doesn’t make sense)
This tool has made it a doddle to trim the excess fat. Its next challenge will be to help reduce the multiple copies of files due to my keeping backups of a sequence of computers on my NAS, and potentially multiple File History copies as I have sorted my photos and other files.
Happy Days!
Steven
Viewing 6 reply threads -

Plus Membership
Donations from Plus members keep this site going. You can identify the people who support AskWoody by the Plus badge on their avatars.
AskWoody Plus members not only get access to all of the contents of this site -- including Susan Bradley's frequently updated Patch Watch listing -- they also receive weekly AskWoody Plus Newsletters (formerly Windows Secrets Newsletter) and AskWoody Plus Alerts, emails when there are important breaking developments.
Get Plus!
Welcome to our unique respite from the madness.
It's easy to post questions about Windows 11, Windows 10, Win8.1, Win7, Surface, Office, or browse through our Forums. Post anonymously or register for greater privileges. Keep it civil, please: Decorous Lounge rules strictly enforced. Questions? Contact Customer Support.
Search Newsletters
Search Forums
View the Forum
Search for Topics
Recent Topics
-
1Password and passkeys
by
Alex5723
3 hours, 46 minutes ago -
Macrium user error:selected volume guid?
by
Deo
7 hours, 25 minutes ago -
Windows 11 Insider Preview Build 22621.1835 and 22624.1835 released to BETA
by
joep517
18 hours, 24 minutes ago -
Unexpected HP Install Request anfter removal of Norton AV
by
MikeAL8
14 hours, 32 minutes ago -
Will Incontrol stop Windows 11 22H2 update, if used after update is paused?
by
sdanr
20 hours, 3 minutes ago -
Restoring a Bitlockered System Image with Macrium Reflect Free
by
sdanr
23 hours, 26 minutes ago -
Prevent emails from ever being seen in Outlook 2013
by
West Swan
18 hours, 56 minutes ago -
Windows Update
by
Richard Mitnick
52 minutes ago -
Vivaldi 6.1 with Bing chat , browsers mimic
by
Alex5723
1 day, 3 hours ago -
MS-DEFCON 2: Are you still on Windows 10 21H2?
by
Susan Bradley
16 hours, 29 minutes ago -
Word 2021 – Print View problems
by
WSjrasnic
1 day ago -
Windows 11 Insider Preview build 25387 released to Canary
by
joep517
1 day, 17 hours ago -
Windows 11 Insider Preview build 23475 released to DEV
by
joep517
1 day, 18 hours ago -
WordPress added AI – Jetpack
by
Alex5723
1 day, 16 hours ago -
PXE Boot and Hyper-V virtual machines and other strange things
by
Simon_Weel
1 day, 20 hours ago -
Testing for adding table to post
by
alejr
1 day, 18 hours ago -
I honestly can’t tell if this is a scam or not
by
Susan Bradley
15 hours, 34 minutes ago -
New Life For Ten Year Old DIY NAS Hardware
by
bbearren
1 day, 8 hours ago -
June 2023 Office non-Security updates have been released
by
PKCano
2 days, 16 hours ago -
Web Apps from Brave Browser
by
Gale
1 day, 15 hours ago -
Firefox 114 offering Secure DNS Options – does AT&T ISP Support?
by
Tex265
1 day, 18 hours ago -
macOS 14 Sonoma
by
Alex5723
1 day, 20 hours ago -
Just a fyi – I think I’ll skip on an Apple Vision Pro hardware section
by
Susan Bradley
2 days, 19 hours ago -
What’s wrong with Windows 11?
by
Ascaris
9 hours, 50 minutes ago -
Streaming an iPad to a standard TV
by
MrJimPhelps
2 days, 11 hours ago -
clone to make backup laptop
by
greenbergman
23 hours, 18 minutes ago -
Problems with sound and USB ports
by
StavRoss
3 days, 1 hour ago -
Can you use WUShowHide on Windows 11 version 21H2?
by
southieguy
3 days, 8 hours ago -
Can we control the changes to our operating systems?
by
Susan Bradley
16 hours, 47 minutes ago -
Watch out for fake ‘Windows Defender’ scare
by
B. Livingston
18 hours, 40 minutes ago
Recent blog posts
- MS-DEFCON 2: Are you still on Windows 10 21H2?
- June 2023 Office non-Security updates have been released
- Can we control the changes to our operating systems?
- Watch out for fake ‘Windows Defender’ scare
- Diagnostics and testing? Get it all done in a flash.
- Dip your toe into Visio Online
- Desktop or Laptop? What’s your choice?
- Beware of Google’s .ZIP domain and password-embedded URLs
Key Links
Want to Advertise in the free newsletter? How about a gift subscription in honor of a birthday? Send an email to sb@askwoody.com to ask how.
Mastodon profile for DefConPatch
Mastodon profile for AskWoody
Home • About • FAQ • Posts & Privacy • Forums • My Account
Register • Free Newsletter • Plus Membership • Gift Certificates • MS-DEFCON Alerts
Copyright ©2004-2023 by AskWoody Tech LLC. All Rights Reserved.