Please note, this is a STATIC archive of website hashcat.net from 08 Oct 2020, cach3.com does not collect or store any user information, there is no "phishing" involved.

hashcat Forum

Full Version: best duplicate removal tool for wordlists
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Can anyone recommend one for a windows user?

ULM chokes on large lists.  I've also been using the tool found here, but it seems to get stuck in the same place on lists, I'm not sure if it is certain characters or what is causing it.

Thank you.
Have you tried the command line ULM tools?
I have not. I assumed it used the same engine as the GUI. Can it handle large files?
The command line tools are 64-bit executables, and more powerful than the GUI ULM.
I had troubles using the ULM command line tools.
I am using sort -u on 20 gb files without issues.