need help with dupes

[1.983]

Like i dont know how to explain but :
I have combo
10k lines
i have 3k dupes
so i want to remove dupes AND i also want to remove accounts that were dupe yk
so i will remove 6k accs
and have my 4k from that combo
What should i do 
Ill rep person who help ty

 

 

[5.587]

Use a combo editor

[ 30/06/2024 ]
@vyactor


 [ 03/06/2024 ]

[1.983]

Use a combo editor

ye but which one

 

 

[3.467]

use emeditor.

 

Cheap - HQ - Paypal Enabled - 6 Months Warranty | https://bit.ly/308uGoQ

[1.428]

Like i dont know how to explain but :
I have combo
10k lines
i have 3k dupes
so i want to remove dupes AND i also want to remove accounts that were dupe yk
so i will remove 6k accs
and have my 4k from that combo
What should i do 
Ill rep person who help ty

if you want to use python...
 

Code:

import collections
 
def remove_duplicates(inputPath:str, outputPath:str):
    values = collections.Counter(open(inputPath,'r').readlines())
    with open(outputPath, 'w') as f:
        f.writelines([k for k,v in values.items() if v == 1])
       
infile = 'yourFile.txt'
outfile = 'dedupedFile.txt'
remove_duplicates(infile, outfile)