Fast and Powerful duplicate remover!

[98]

this is nice

[135]

Not trying to rag, but why would you check to see if the line is in your storehouse variable before adding it?  A set() collection doesn't allow duplicates.

You could do this and get the same result...faster, less complex, and less working memory.  The only downside I can see is that the line order isn't preserved.

thanks

[191]

thank you for sharing

[36]

thnxxx

[44]

Its very fast and it can handle big files.
I hope you enjoy, if you do leave a LIKE <3


Save to a python file.
run the file trough CMD or IDLE.
Filenames should be written without ".txt"

lets see

[499]

Thank you very much