search

snowplow-incubator / sauna

:hotsprings: A decisioning and response platform
https://github.com/snowplow/sauna/wiki
70 stars 11 forks source link

Merge similar content from different files #5

Open Dveim opened 8 years ago

Dveim commented 8 years ago

At the moment, each file processes separately. So, if two files have almost identical content, there will be two requests to responder, instead of one.

alexanderdean commented 8 years ago

In the meantime, we could work around this by mandating PARALLEL OFF in the Redshift UNLOAD query.

alexanderdean commented 8 years ago

Leave this one for now I think...