threader - Githubissues

crestfall-sh / modules

Crestfall Modules

MIT License

5 stars 0 forks source link

threader #10

Open joshxyzhimself opened 1 year ago

joshxyzhimself commented 1 year ago

csv

split by line (e.g. every 100k lines) https://stackoverflow.com/a/45761990/19804714
prepare range of csv files (one thread = one file = 100k lines)
create thread for each cpu
assign task for each thread

tables

prepare range of rows (one thread = 10k rows)
create thread for each cpu
assign task for each thread