ISSUE 18.32 • 2021-08-23 BEST UTILITIES By Deanna McElveen Yes, those seashell pictures you took from the ocean were great, and that recipe for Frito
[See the full post at: Freeware Spotlight — Anti-Twin]
![]() |
Patch reliability is unclear, but widespread attacks make patching prudent. Go ahead and patch, but watch out for potential problems. |
SIGN IN | Not a member? | REGISTER | PLUS MEMBERSHIP |
-
Freeware Spotlight — Anti-Twin
Home » Forums » Newsletter and Homepage topics » Freeware Spotlight — Anti-Twin
- This topic has 11 replies, 11 voices, and was last updated 2 years, 2 months ago.
AuthorTopicDeanna McElveen
AskWoody PlusViewing 6 reply threadsAuthorReplies-
Alex5723
AskWoody Plus -
Chris Greaves
AskWoody PlusInteresting product, and I favour the configurations.
I note the note about shortcut links towards the end , reminiscent of Sun Microsystem’s triple-tier data storage system.
I have spent some time looking at content matching, and am currently at the stage of optimizing the “binary compare” mechanism. This gets tricky with specific file types. MP3 content can be broken into chunks by the meta-data tags, but I hadn’t started on image files so “pixels” is a good hit.
Back to links: Vitally important and a principle cause of failure of any system where deleting duplicates can leave hard-coded links (say, to an image file) hanging, basically destroying a word-processing document which wakes up to find all its hard-coded image files gone!
A great deal hinges on an individual user’s definition of the term “DUPLICATE”.
One version of “Jingle Bells” in my T:\Music\ folder is enough, but I will never have enough versions of “Charles-Marie Widor Toccata from Symphony No. 5 for Organ & Orchestra”; preferably at amplified volume! For me, any version of Jingle Bells is a duplicate to be tossed out of the nest, but Widor? No!
Cheers
Chris
Unless you're in a hurry, just wait.
-
Ascaris
AskWoody MVPI’ve been using the Linux utility FSLint (file system lint) to de-duplicate files, but the devs of that program have recommended Czkawka, a reimplementation of the FSLint (which is written in Python) in Rust, with additional features (including picture deduplication when there is no checksum match). It has Windows, Linux, and Mac versions, and is free and open source.
Dell XPS 13/9310, i5-1135G7/16GB, KDE Neon
XPG Xenia 15, i7-9750H/16GB & GTX1660ti, KDE Neon
Acer Swift Go 14, i5-1335U/16GB, KDE Neon (and Win 11 for maintenance) -
Microfix
AskWoody MVPfslint isn’t present in the ubuntu 20.04 LTS repos as it uses the depreciated Python 2.6 and some now, obsolete dependancies 🙁
Have used it in the past on 18.04 LTS and previous to skim off excess and duplication to good effect. Hope the author updates it to conform.Win8.1/R2 Hybrid lives on..
-
anonymous
GuestI need and want those duplicates. It is easier to find the file when I need it when it is filed under alternate categories/topics. And it is safer in case one of them gets corrupted.
YMMV
What windoze needs is a better way to tag files for finding them so I dont have to add tags into the name of the file when I save it.
-
access-mdb
AskWoody MVPIt does – two ways. When you save a new file, there’s an option under the name “more options”. this allows you to enter a tag (amongst other things). You can save as an existing file and save the tagged file over the old.
The second is File Explorer. Right click on the file name and right click. Choose properties and click the tag line. You can enter a tag this way. You can also select a number of files and tag them all.
To find files with a particular tag, type tag:string and it will find all files with a tag with that string.
Note that only files with a tag option can be tagged e.g. all office files. If there’s no tag option in properties, this can’t be done. I’ve only just discovered this so they may be other options – searching with other keywords is possible in File Explorer
Eliminate spare time: start programming PowerShell
dkv98446
AskWoody LoungerThank you for a well written, and informative article.
Over the years I have used Anti-Twin to help control my obsession for backing up my photos. I have found it to be easy to use and very accurate.
There is one peculiarity, I have accepted, but do not understand. Occasionally I will run the program looking for 100% duplicates in a directory, and get zero records found. But when I rerun against the same directory looking for less than 100%, the results show files with 100%.
Do you have any suggestions for a similar program, which works with files in the cloud?
Dave. v.
-
Ascaris
AskWoody MVPMy guess is that it’s rounding error.
If you search for 100% duplicates, it could be looking for the highest level of similarity it is capable of detecting, which it defines as 100%. The photos it finds in a lower match level search, and reports as 100%, might be just below that threshold, at say 99.5%, which it rounds up to 100% for the display, but is still below the threshold when you set it to 100%. Just a guess; I have never used the program, so I don’t have any direct experience.
Dell XPS 13/9310, i5-1135G7/16GB, KDE Neon
XPG Xenia 15, i7-9750H/16GB & GTX1660ti, KDE Neon
Acer Swift Go 14, i5-1335U/16GB, KDE Neon (and Win 11 for maintenance)
DavidW
AskWoody PlusThere are many utilities to find duplicate files. But, for some unexplainable reasons I can’t find a utility to find the ‘comlementary’ of duplicate files or call it the list of all mutually exclusive files between two (and ideally more) paths, A and B. To put it in other words if not clear, list all files that exist in path A and NOT in path B and vice versa.
(Notes: I am surprise because it takes adding/changing few lines of code of a ‘find duplicates’ utility to accomplish its complementary).As usual, there should be filters for at least file types, both for included and excluded files.
Also as usual, comparison method options should be: 1. File’s name+time-stamp(of last change)+size, 2. File’s MD5, 3. File’s SHA.
I don’t mind to pay for a good professional application.
Thanks,
David-
tabletguy
AskWoody Plus
WSMajorSteve
AskWoody PlusI’ve just taken Anti-Twin for a spin, and it’s amazing. I have had two iPhones, separated by a brief return to Android. Using iCloud, the older one placed photos on my PC in Pictures\iCloud\Downloads, whilst the newer one separates them by year Pictures\iCloud\Downloads\2019. Where a picture had been transferred to the Android phone and back to the new iPhone, I ended up with a copy in both locations. In addition, when I got O365, I started using my 1TB OneDrive to back up my photos, so they also appeared in Camera Uploads. Then I would gradually move them from there to named folders under My Photo Library. (See the attached photo if this doesn’t make sense)
This tool has made it a doddle to trim the excess fat. Its next challenge will be to help reduce the multiple copies of files due to my keeping backups of a sequence of computers on my NAS, and potentially multiple File History copies as I have sorted my photos and other files.
Happy Days!
Steven
Viewing 6 reply threads -

Plus Membership
Donations from Plus members keep this site going. You can identify the people who support AskWoody by the Plus badge on their avatars.
AskWoody Plus members not only get access to all of the contents of this site -- including Susan Bradley's frequently updated Patch Watch listing -- they also receive weekly AskWoody Plus Newsletters (formerly Windows Secrets Newsletter) and AskWoody Plus Alerts, emails when there are important breaking developments.
Get Plus!
Welcome to our unique respite from the madness.
It's easy to post questions about Windows 11, Windows 10, Win8.1, Win7, Surface, Office, or browse through our Forums. Post anonymously or register for greater privileges. Keep it civil, please: Decorous Lounge rules strictly enforced. Questions? Contact Customer Support.
Search Newsletters
Search Forums
View the Forum
Search for Topics
Recent Topics
-
Steam drops macOS Mojave support, effectively ending life for many 32-bit games
by
Alex5723
1 hour, 52 minutes ago -
Requiring Bit-Locker key when it isnt activated after Win 11 update
by
BradH
32 minutes ago -
KB5032189 Not installing on either of my PCs
by
WSPseudoGeek
2 hours, 17 minutes ago -
Outlook.com – is there a way to delete all contacts in bulk?
by
Everard Tarascio
6 hours, 31 minutes ago -
Apple zero days fixed – November 30, 2023
by
Susan Bradley
6 hours, 17 minutes ago -
found a skneaky way to get windows 11 free still.
by
tjm1963
11 hours, 10 minutes ago -
Quickbooks – no new desktop subscriptions to be sold
by
Susan Bradley
13 hours, 41 minutes ago -
Does updating to Win10 from Win7 Retain your applications successfully?
by
WSMrKnobs
11 hours, 55 minutes ago -
Using Dropbox source data for a Connection in Excel with different machines
by
WSGfamily
15 hours, 15 minutes ago -
Microsoft installing HP Smart secretly on non HP PCs
by
Alex5723
14 hours, 10 minutes ago -
Fun Stuff – Mystery Zone
by
Lars220
1 day, 4 hours ago -
How to make sure GMAIL does not delete my account since they are not letting ..?
by
Gmail
2 hours, 35 minutes ago -
Windows Explorer – search for files that are not shortcuts?
by
edsel1924
23 hours, 11 minutes ago -
Windows 11 Insider Preview build 23595 released to DEV
by
joep517
1 day, 11 hours ago -
Windows 11 Insider Preview build 26002 released to Canary
by
joep517
13 hours, 7 minutes ago -
Windows 11 Insider Preview Build 22635.2776 released to BETA
by
joep517
1 day, 11 hours ago -
Getting ‘not genuine Windows’ after replacing HDD
by
opti1
16 hours, 39 minutes ago -
Amazon Alexa Echo Hunches
by
Richard C Algeni
1 day, 12 hours ago -
Microsoft Defender Application Guard for Office is being deprecated
by
Alex5723
1 day, 13 hours ago -
New BLUFFS attack lets attackers hijack Bluetooth connections
by
Alex5723
1 day, 13 hours ago -
Don’t have your online identity in just one account
by
Susan Bradley
11 hours, 32 minutes ago -
Sports Illustrated Published Articles by Fake, AI-Generated Writers
by
Cybertooth
1 day, 8 hours ago -
Windows 32bit to 64bit.
by
David Rennie
15 hours, 51 minutes ago -
Lost icons in notification area, Windows 10
by
Botswana12
8 hours, 53 minutes ago -
Test Apps in vm(?) so that I don’t break my current install
by
ruffhi
10 hours, 23 minutes ago -
Removing Copilot
by
cmar6
4 hours, 37 minutes ago -
How do I disable CoPilot
by
Rush2112
1 day, 12 hours ago -
MS-DEFCON 3: A slightly bumpy November
by
Susan Bradley
1 hour, 12 minutes ago -
End of support for the Microsoft 365 Browser Extension
by
Alex5723
3 days, 1 hour ago -
InPrivate Light mode
by
CWBillow
2 days, 10 hours ago
Recent blog posts
Key Links
S | M | T | W | T | F | S |
---|---|---|---|---|---|---|
1 | 2 | |||||
3 | 4 | 5 | 6 | 7 | 8 | 9 |
10 | 11 | 12 | 13 | 14 | 15 | 16 |
17 | 18 | 19 | 20 | 21 | 22 | 23 |
24 | 25 | 26 | 27 | 28 | 29 | 30 |
31 |
Want to Advertise in the free newsletter? How about a gift subscription in honor of a birthday? Send an email to sb@askwoody.com to ask how.
Mastodon profile for DefConPatch
Mastodon profile for AskWoody
Home • About • FAQ • Posts & Privacy • Forums • My Account
Register • Free Newsletter • Plus Membership • Gift Certificates • MS-DEFCON Alerts
Copyright ©2004-2023 by AskWoody Tech LLC. All Rights Reserved.