namebrandon / Sparkov_Data_Generation

Synthetic Credit Card Transaction Generator used in the Sparkov program.
MIT License
133 stars 62 forks source link

Refactor: parallelize transaction generation #10

Closed streamnsight closed 2 years ago

streamnsight commented 2 years ago

Transaction generation is parallelize by generating and doing the look up of random values in bulk prior to printing, as well as using multiprocessing and splitting the customer list into chunks so as to run on as many cores as possible in parallel.