prunning & sampling strategies to handle large amounts of data

[shaigue]

Different techniques for reducing complexity where considered:

• early prunning (before complete aggragated counts) based on counts
• after complete count prunning
• data sub sapmling
• different masking vocabulary for different dataset slices.

Organize and present the different tradeoffs between those, and what was our decision.