Fast and Powerful duplicate remover!

[86]

Its very fast and it can handle big files.
I hope you enjoy, if you do leave a LIKE <3


Save to a python file.
run the file trough CMD or IDLE.
Filenames should be written without ".txt"

Hidden Content

You must register or login to view this content.

Making Openbullet configs and Python scripts.

[1.557]

Not trying to rag, but why would you check to see if the line is in your storehouse variable before adding it?  A set() collection doesn't allow duplicates.

You could do this and get the same result...faster, less complex, and less working memory.  The only downside I can see is that the line order isn't preserved.

Hidden Content

You must register or login to view this content.

Edit...the below preserves the order and is actually faster than what I first posted.

Hidden Content

You must register or login to view this content.

[190]

Gotta take a look thanks.

LEECHERS WILL BE REPORTED  :pepegun:

[75]

thanks man!

[86]

Not trying to rag, but why would you check to see if the line is in your storehouse variable before adding it?  A set() collection doesn't allow duplicates.

You could do this and get the same result...faster, less complex, and less working memory.  The only downside I can see is that the line order isn't preserved.

Appreciate your reply!
I'm always happy to learn stuff and well your example just seems better.

Making Openbullet configs and Python scripts.

[64]

Not trying to rag, but why would you check to see if the line is in your storehouse variable before adding it?  A set() collection doesn't allow duplicates.

You could do this and get the same result...faster, less complex, and less working memory.  The only downside I can see is that the line order isn't preserved.

Thanks for the  knowledge

[137]

hope it work well , thank you

[142]

Ty brooooo