opendatateam / udata

Customizable and skinnable social platform dedicated to open data.
http://udata.readthedocs.org
GNU Affero General Public License v3.0
239 stars 87 forks source link

Expose dataservices' datasets by link instead of list #3156

Closed ThibaudDauce closed 1 week ago

ThibaudDauce commented 4 weeks ago

Related to https://github.com/datagouv/data.gouv.fr/issues/1467

maudetes commented 2 weeks ago

Testing this PR on dev env with a dataservice linked to 20K datasets does not scale at the moment. See the sentry error when accessing https://dev.data.gouv.fr/api/1/dataservices/api-tabulaire-data-gouv-fr-beta/ ( :warning: only 1000 associated datasets have been kept to this dataservice now). I think we could try using db.LazyReferenceField as in the topic model?