tracking-exposed / trex

youtube & tiktok analysis + youchoose recommendation custmizer. backend, extensions, and tooling
https://docs.tracking.exposed
GNU Affero General Public License v3.0
52 stars 15 forks source link

fix: polish mongo indexes #795

Closed vecna closed 1 year ago

vecna commented 1 year ago

because of migration opportunity and because the experimentId has changed concept during the time, a few collections in our mongodb needs some review.

This PR propose few changes and we can discuss, based on the currently used query and data model, if some fields are outdated.

vecna commented 1 year ago

@ascariandrea problems still present: the metadata collection now has changed but the index do not reflect the query we are using.

for example #800 introduce the possibility that any field might be used to query the metadata, but not all the fields are mongodb index. we should understand which are the most frequent,to ensure quick queries

ascariandrea commented 1 year ago

@vecna I would only add the index on the nature.type for now, as #713 is still in development and so we don't have any real filter in place at the moment.

vecna commented 1 year ago

should be ready now @ascariandrea @Pandry