Hello, I am looking for a developer to complete the following task.
Below is the full detail of the script and what it should do.
The script is a proof of concept that you will be making, you will only be tasked to print certain data, and prove it can handle millions lines of data without being slow.
There should be this list of files for data:
Links.txt - Just a simple link variable to be able to be used in the code
SentLinks.txt - Every Links.txt visited from above will be put here, so that the link is not revisited from other runs, or from the same run with a different thread
Accounts.txt - This is another variable to be used in the code
Proxies.txt - Another variable to be used in the code
So a code example can be written below by you with an efficient threading system that supports million lines of data and doesnt repeat:
```py
def link_visit():
print(account + ' Visited ' + link + ' With ' + proxy)
```
Thats all I want the code to be able to do, is print that variable information, but all work together in threads. The threading should be fast and efficient.
For example links would look like
```
link1
link2
link3
... up to millions of links
```
As well there will be a sentlinks.txt
This is where the optimization needs to be coded.
Normally, when you append lines on python- it freezes the program (because it is reading every line to make sure it is not in links.txt) and then executes the code.
I want a very fast way to organize sentlinks.txt from links.txt
The sentlinks are links that basically loop to be removed from links.txt. To ensure that those links aren't repeated.
the script should make the accounts visit 1 link per run.
So I run the program with 100 accounts, it should select 100 non visited links to visit with those 100 accounts for that run.
Then I can I run the program again, with 200 accounts for example, and then 200 accounts will visit 200 links that still have never been visited before.
I plan to run it like this, so a lot of data will be building up in links and sentlinks.txt. So I should be able to handle millions without slowing down anything
I am open to hear your ideas on how to make this efficient, I just need a proof of concept script basically with the threading do
Requirements:
- Make sure each account inputted is used one time
- Choose 1 link for the account to visit in that run
- The link must not be repeated ever
- Links additionally stored in sentlinks.txt should support millions and not slow down the program at all. For example, the program shouldn't freeze when I start it.
- Python
- Make sure to follow every other step mentioned previously while explaining the post. Please ask questions before starting if you aren't sure.
I am open to hear ideas on how to solve this issue in python, as I really can't have any repeats, and I can't be waiting forever to start the program even when millions of lines are stored.
A realistic number of lines for the files will be around 10mil-50mil.
Both in links.txt and sentlinks.txt
Proxies will contain around 100k max
Accounts will contain around 300k max
Proxies and accounts do not need to be related, the proxies can be randomly assigned.
PM me on cracked and leave your discord. I will check my PM's often
Below is the full detail of the script and what it should do.
The script is a proof of concept that you will be making, you will only be tasked to print certain data, and prove it can handle millions lines of data without being slow.
There should be this list of files for data:
Links.txt - Just a simple link variable to be able to be used in the code
SentLinks.txt - Every Links.txt visited from above will be put here, so that the link is not revisited from other runs, or from the same run with a different thread
Accounts.txt - This is another variable to be used in the code
Proxies.txt - Another variable to be used in the code
So a code example can be written below by you with an efficient threading system that supports million lines of data and doesnt repeat:
```py
def link_visit():
print(account + ' Visited ' + link + ' With ' + proxy)
```
Thats all I want the code to be able to do, is print that variable information, but all work together in threads. The threading should be fast and efficient.
For example links would look like
```
link1
link2
link3
... up to millions of links
```
As well there will be a sentlinks.txt
This is where the optimization needs to be coded.
Normally, when you append lines on python- it freezes the program (because it is reading every line to make sure it is not in links.txt) and then executes the code.
I want a very fast way to organize sentlinks.txt from links.txt
The sentlinks are links that basically loop to be removed from links.txt. To ensure that those links aren't repeated.
the script should make the accounts visit 1 link per run.
So I run the program with 100 accounts, it should select 100 non visited links to visit with those 100 accounts for that run.
Then I can I run the program again, with 200 accounts for example, and then 200 accounts will visit 200 links that still have never been visited before.
I plan to run it like this, so a lot of data will be building up in links and sentlinks.txt. So I should be able to handle millions without slowing down anything
I am open to hear your ideas on how to make this efficient, I just need a proof of concept script basically with the threading do
Requirements:
- Make sure each account inputted is used one time
- Choose 1 link for the account to visit in that run
- The link must not be repeated ever
- Links additionally stored in sentlinks.txt should support millions and not slow down the program at all. For example, the program shouldn't freeze when I start it.
- Python
- Make sure to follow every other step mentioned previously while explaining the post. Please ask questions before starting if you aren't sure.
I am open to hear ideas on how to solve this issue in python, as I really can't have any repeats, and I can't be waiting forever to start the program even when millions of lines are stored.
A realistic number of lines for the files will be around 10mil-50mil.
Both in links.txt and sentlinks.txt
Proxies will contain around 100k max
Accounts will contain around 300k max
Proxies and accounts do not need to be related, the proxies can be randomly assigned.
PM me on cracked and leave your discord. I will check my PM's often
If you enjoyed my content I shared, consider leaving a like and +repping to encourage me to continue providing contributions
Note: I do not provide support on site regarding my shop, please contact on telegram and be sure to read our terms
https://discordu.sellix.io
https://t.me/discordustock
Note: I do not provide support on site regarding my shop, please contact on telegram and be sure to read our terms
https://discordu.sellix.io
https://t.me/discordustock