Navigation X
ALERT
Click here to register with a few steps and explore all our cool stuff we have to offer!



 14221

Python - Extract domain from large files

by theriddler - 24 December, 2019 - 04:05 PM
This post is by a banned member (theriddler) - Unhide
86
Posts
27
Threads
5 Years of service
#1
(This post was last modified: 07 January, 2020 - 06:50 PM by theriddler.)
extract combos with .com / .co.uk / .dk / .se or any other domain extention with this python script.
tested on 20 million combolist, took a few seconds.

Code:

Hidden Content
You must register or login to view this content.

Making Openbullet configs and Python scripts.
This post is by a banned member (theriddler) - Unhide
86
Posts
27
Threads
5 Years of service
#2
This is a bump
Making Openbullet configs and Python scripts.
This post is by a banned member (0x000000FF) - Unhide
208
Posts
15
Threads
4 Years of service
#3
If you put all lines into list eventually it will raise MemoryError (: You need to use generators instead, will be slow but you can load unlimited size of file without fucking ram.
ha
This post is by a banned member (cyberpunk1337) - Unhide
29
Posts
0
Threads
4 Years of service
#4
nice i will tri it
This post is by a banned member (s1ke) - Unhide
s1ke  
Registered
138
Posts
3
Threads
5 Years of service
#5
awesome i hope this can help me with my coding.
This post is by a banned member (theriddler) - Unhide
86
Posts
27
Threads
5 Years of service
#6
(27 December, 2019 - 05:21 PM)SunEater Wrote: Show More
If you put all lines into list eventually it will raise MemoryError (: You need to use generators instead, will be slow but you can load unlimited size of file without fucking ram.

You are right, but so far I did 1.2GB file and it only took around 10-15 seconds, I don't need any bigger files than that.
Making Openbullet configs and Python scripts.
This post is by a banned member (KXLIx) - Unhide
KXLIx  
Registered
12
Posts
0
Threads
5 Years of service
#7
Thanks for posting! I may expand on my knowledge for python now. Will leave a like.
This post is by a banned member (theriddler) - Unhide
86
Posts
27
Threads
5 Years of service
#8
Added threading to the script, its now much faster.
Making Openbullet configs and Python scripts.

Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
or
Sign in
Already have an account? Sign in here.


Forum Jump:


Users browsing this thread: 2 Guest(s)