[C#] What's the best way to load big combos in a program without it hanging?

[12]

I think title says it all.

I'm currently using a StreamWriter and adding each line to a Hashset, but combos of 1MILL and above, take around 40 seconds to load.

Is there a faster way?

[116]

add them to a queue

[172]

Backgroundworker or load data asynchronous to wherever you want

[2]

There's not need to actually load all the combos in memory at once. Just keep the stream open and read a combo when you need one. Loading 1 million combos will take up a chunk of memory.

[958]

Just load it up in chunks or when you're actually using a chunk.

[344]

I would use File.ReadAllLines() , i think its the best.

[172]

I would use File.ReadAllLines() , i think its the best.

This will cause your application to freezing and continue working when the list is done (if its alot text it may also crash and stop completely working), its the same like StreamReader. With less text its okay but with such big text like 1 million of lines and this stuff you won't come far with File or StreamReader Class except using it in a backgroundworker.

[72]

Well, depends, if you are using File.ReadAllLines() in a WinForms/WPF application, it will indeed freeze the application till its fully loaded, unless its ran on another thread.
I had once an idea for Progressive Loading, that allowed "loading" any amount of combo, even let's say 10gb, without overflowing the memory at all (like Reading it full does).
Imho its better than loading into chunks because depending on size of combo.