Changelog
### 6.0.0
```
- :warning: Kafka removal [2783](https://github.com/opendatateam/udata/pull/2783)[#2794](https://github.com/opendatateam/udata/pull/2794):
- Resources events publication now uses webhooks
- Search indexation (at runtime and with index command) are now made through HTTP requests.
- If you use [udata-search-service](https://pypi.org/project/udata-search-service/), you need to upgrade to the >=2.0.0 version
- Add dedicated extras endpoints on resources and datasets [2779](https://github.com/opendatateam/udata/pull/2779)
- Enrich catalog with harvest infos [2789](https://github.com/opendatateam/udata/pull/2789)
- Add optionnal license select group custom setting for admin [2786](https://github.com/opendatateam/udata/pull/2786)
- Make index setup optional on init based on config [2797](https://github.com/opendatateam/udata/pull/2797)
```
### 5.0.2
```
- :warning: Upgrade to `Flask-Security-Too` version 4.0.0 [2772](https://github.com/opendatateam/udata/pull/2772):
- New User model attribute `fs_uniquifier`, migration needed.
- The `fs_uniquifier` is used to invalidate existing session in case of password reset.
- The user's `fs_uniquifier` is used instead of the `id` for auth mecanism including permissions.
- Exhaustive list of changes [here](https://flask-security-too.readthedocs.io/en/stable/changelog.html#version-4-0-0).
- Fix apiv2 swagger with harvest metadata and add apiv2 swagger tests [2782](https://github.com/opendatateam/udata/pull/2782)
- Improve frequency criterion in quality score [2771](https://github.com/opendatateam/udata/pull/2771)
- Add quality score to csv catalogs [2785](https://github.com/opendatateam/udata/pull/2785)
- Optimize DCAT harvesting on large multiple-paged catalogs, introduce `HARVEST_MAX_ITEMS` development setting [2781](https://github.com/opendatateam/udata/pull/2781)
- Add condition in security mail utils class to avoid mail sending according to config var [2788](https://github.com/opendatateam/udata/pull/2788)
```
### 5.0.1
```
- Fix resource harvest uri validation error [2780](https://github.com/opendatateam/udata/pull/2780)
```
### 5.0.0
```
- :warning: **Breaking change** Use dedicated dynamic harvest metadata for dataset and resources. A migration copies identifying fields from extras to this dedicated metadata field. Extras won't be used anymore for harvest-related information. udata-ckan, udata-ods and udata-front packages are impacted and should be upgraded accordingly [2762](https://github.com/opendatateam/udata/pull/2762)
```
### 4.1.3
```
- Fix image URLs for suggest endpoints [2761](https://github.com/opendatateam/udata/pull/2761)
- Switch from `Flask-restplus` to its fork `Flask-rest-x` [2770](https://github.com/opendatateam/udata/pull/2770)
- Clean inactive harvest datasets. :warning: a migration archives datasets linked to inactive harvest sources [2764](https://github.com/opendatateam/udata/pull/2764) [#2773](https://github.com/opendatateam/udata/pull/2773) [#2777](https://github.com/opendatateam/udata/pull/2777)
- Fix randomly failing suggest tests [2775](https://github.com/opendatateam/udata/pull/2775)
- Fix alt attribute not shown on image [2776](https://github.com/opendatateam/udata/pull/2776)
```
### 4.1.2
```
- Clean up event code [2751](https://github.com/opendatateam/udata/pull/2751)
- Replace mongo legacy image in CI [2754](https://github.com/opendatateam/udata/pull/2754)
- Fixes test `test_suggest_datasets_api` by modifying condition [2759](https://github.com/opendatateam/udata/pull/2759)
- Fix doc name duplicate on rdf endpoints [2763](https://github.com/opendatateam/udata/pull/2763)
```
### 4.1.1
```
- Quality score computation refactoring and now returning it in list datasets endpoint. Update was made in admin too. [2746](https://github.com/opendatateam/udata/pull/2746)
- :warning: Manifest logic was removed and udata does now work as standalone [2747](https://github.com/opendatateam/udata/pull/2747)
- Remove map related stuff [2749](https://github.com/opendatateam/udata/pull/2749)
- Add library udata_event_service to produce Kafka messages [2743](https://github.com/opendatateam/udata/pull/2743)
```
### 4.1.0
```
- Add html support for posts [2731](https://github.com/opendatateam/udata/pull/2731)
- Use mongo search if `SEARCH_SERVICE_API_URL` variable is not set [2728](https://github.com/opendatateam/udata/pull/2728)
- Improve resource extension detection [2729](https://github.com/opendatateam/udata/pull/2729/files)
- Remove resources in dataset search serialization [2730](https://github.com/opendatateam/udata/pull/2730)
- Add endpoint to directly get specific resource by rid [2732](https://github.com/opendatateam/udata/pull/2732).
- Publish kafka message when resource is created, modified or deleted [2733](https://github.com/opendatateam/udata/pull/2733)
- Clean documentation and code with respect to independent search service [2738](https://github.com/opendatateam/udata/pull/2738)
- Fix size argument in suggests endpoint and corresponding tests [2739](https://github.com/opendatateam/udata/pull/2739)
- Add udata instance name prefix and action suffix for kafka topics [2736](https://github.com/opendatateam/udata/pull/2736)
- Fix tokenisation by building an `AND` query (see comments in code) for mongo text search and pagination [2740](https://github.com/opendatateam/udata/pull/2740)
```
### 4.0.2
```
- Remove unused `_total_pages` search property [2726](https://github.com/opendatateam/udata/pull/2726)
- Use -followers as default suggest sort on datasets, reuses and orgas [2727](https://github.com/opendatateam/udata/pull/2727)
- Reintroduce user suggest with mongo contains [2725](https://github.com/opendatateam/udata/pull/2725)
```
### 4.0.1
```
- Removed `post_save` signal within `add_resource` and `update_resource` methods. [2720](https://github.com/opendatateam/udata/pull/2720)
- Refactor and update documentation with latest udata updates [2717](https://github.com/opendatateam/udata/pull/2717)
- Add harvest csv adapter for a catalog of harvesters [2722](https://github.com/opendatateam/udata/pull/2722)
```
### 4.0.0
```
Breaking change
Search refactor [2680](https://github.com/opendatateam/udata/pull/2680)
- :warning: Search changes [2692](https://github.com/opendatateam/udata/pull/2692):
- The search feature is not within udata anymore and queries a distant service.
- The search feature is now optional and is enabled by setting the `SEARCH_SERVICE_API_URL` setting.
- When search is not enabled, the search endpoints will return a `501 Not Implemented` error.
- The ModelAdapter, SearchQuery and SearchResult patterns were kept but heavily refactored.
- udata uses a Kafka producer to send documents to index to the search service.
- udata uses HTTP request to query the search service.
- :warning: API changes [2669](https://github.com/opendatateam/udata/pull/2669):
- List endpoints for organizations, datasets, reuses and users are now querying MongoDB instead of ElasticSearch.
- Those endpoints use MongoDB full text search when `q` argument is used. Some unused filters on this route were dropped.
- A new API parser was implemented to replace the search one.
- The previous ElasticSearch endpoints were moved to APIv2 with the following url pattern: `/{object}/search` (ex: `/datasets/search`).
- :warning: Suggest changes [2685](https://github.com/opendatateam/udata/pull/2685) and [#2696](https://github.com/opendatateam/udata/pull/2696):
- Current suggest implementation moved from an Elasticsearch index to a MongoDB query using the term `contains`.
- The user suggest was entirely removed, as its existence is now less relevant because of the full text search.
```
### 3.3.3
```
- Extend dcat properties support (frequency litteral, creation and modification date, landing page and abstract description) [2715](https://github.com/opendatateam/udata/pull/2715)
```
Links
- PyPI: https://pypi.org/project/udata
- Changelog: https://pyup.io/changelogs/udata/
- Repo: https://github.com/opendatateam/udata
pyup-bot
commented
1 year ago
This PR updates udata from 3.3.2 to 6.0.0.
Changelog
### 6.0.0 ``` - :warning: Kafka removal [2783](https://github.com/opendatateam/udata/pull/2783)[#2794](https://github.com/opendatateam/udata/pull/2794): - Resources events publication now uses webhooks - Search indexation (at runtime and with index command) are now made through HTTP requests. - If you use [udata-search-service](https://pypi.org/project/udata-search-service/), you need to upgrade to the >=2.0.0 version - Add dedicated extras endpoints on resources and datasets [2779](https://github.com/opendatateam/udata/pull/2779) - Enrich catalog with harvest infos [2789](https://github.com/opendatateam/udata/pull/2789) - Add optionnal license select group custom setting for admin [2786](https://github.com/opendatateam/udata/pull/2786) - Make index setup optional on init based on config [2797](https://github.com/opendatateam/udata/pull/2797) ``` ### 5.0.2 ``` - :warning: Upgrade to `Flask-Security-Too` version 4.0.0 [2772](https://github.com/opendatateam/udata/pull/2772): - New User model attribute `fs_uniquifier`, migration needed. - The `fs_uniquifier` is used to invalidate existing session in case of password reset. - The user's `fs_uniquifier` is used instead of the `id` for auth mecanism including permissions. - Exhaustive list of changes [here](https://flask-security-too.readthedocs.io/en/stable/changelog.html#version-4-0-0). - Fix apiv2 swagger with harvest metadata and add apiv2 swagger tests [2782](https://github.com/opendatateam/udata/pull/2782) - Improve frequency criterion in quality score [2771](https://github.com/opendatateam/udata/pull/2771) - Add quality score to csv catalogs [2785](https://github.com/opendatateam/udata/pull/2785) - Optimize DCAT harvesting on large multiple-paged catalogs, introduce `HARVEST_MAX_ITEMS` development setting [2781](https://github.com/opendatateam/udata/pull/2781) - Add condition in security mail utils class to avoid mail sending according to config var [2788](https://github.com/opendatateam/udata/pull/2788) ``` ### 5.0.1 ``` - Fix resource harvest uri validation error [2780](https://github.com/opendatateam/udata/pull/2780) ``` ### 5.0.0 ``` - :warning: **Breaking change** Use dedicated dynamic harvest metadata for dataset and resources. A migration copies identifying fields from extras to this dedicated metadata field. Extras won't be used anymore for harvest-related information. udata-ckan, udata-ods and udata-front packages are impacted and should be upgraded accordingly [2762](https://github.com/opendatateam/udata/pull/2762) ``` ### 4.1.3 ``` - Fix image URLs for suggest endpoints [2761](https://github.com/opendatateam/udata/pull/2761) - Switch from `Flask-restplus` to its fork `Flask-rest-x` [2770](https://github.com/opendatateam/udata/pull/2770) - Clean inactive harvest datasets. :warning: a migration archives datasets linked to inactive harvest sources [2764](https://github.com/opendatateam/udata/pull/2764) [#2773](https://github.com/opendatateam/udata/pull/2773) [#2777](https://github.com/opendatateam/udata/pull/2777) - Fix randomly failing suggest tests [2775](https://github.com/opendatateam/udata/pull/2775) - Fix alt attribute not shown on image [2776](https://github.com/opendatateam/udata/pull/2776) ``` ### 4.1.2 ``` - Clean up event code [2751](https://github.com/opendatateam/udata/pull/2751) - Replace mongo legacy image in CI [2754](https://github.com/opendatateam/udata/pull/2754) - Fixes test `test_suggest_datasets_api` by modifying condition [2759](https://github.com/opendatateam/udata/pull/2759) - Fix doc name duplicate on rdf endpoints [2763](https://github.com/opendatateam/udata/pull/2763) ``` ### 4.1.1 ``` - Quality score computation refactoring and now returning it in list datasets endpoint. Update was made in admin too. [2746](https://github.com/opendatateam/udata/pull/2746) - :warning: Manifest logic was removed and udata does now work as standalone [2747](https://github.com/opendatateam/udata/pull/2747) - Remove map related stuff [2749](https://github.com/opendatateam/udata/pull/2749) - Add library udata_event_service to produce Kafka messages [2743](https://github.com/opendatateam/udata/pull/2743) ``` ### 4.1.0 ``` - Add html support for posts [2731](https://github.com/opendatateam/udata/pull/2731) - Use mongo search if `SEARCH_SERVICE_API_URL` variable is not set [2728](https://github.com/opendatateam/udata/pull/2728) - Improve resource extension detection [2729](https://github.com/opendatateam/udata/pull/2729/files) - Remove resources in dataset search serialization [2730](https://github.com/opendatateam/udata/pull/2730) - Add endpoint to directly get specific resource by rid [2732](https://github.com/opendatateam/udata/pull/2732). - Publish kafka message when resource is created, modified or deleted [2733](https://github.com/opendatateam/udata/pull/2733) - Clean documentation and code with respect to independent search service [2738](https://github.com/opendatateam/udata/pull/2738) - Fix size argument in suggests endpoint and corresponding tests [2739](https://github.com/opendatateam/udata/pull/2739) - Add udata instance name prefix and action suffix for kafka topics [2736](https://github.com/opendatateam/udata/pull/2736) - Fix tokenisation by building an `AND` query (see comments in code) for mongo text search and pagination [2740](https://github.com/opendatateam/udata/pull/2740) ``` ### 4.0.2 ``` - Remove unused `_total_pages` search property [2726](https://github.com/opendatateam/udata/pull/2726) - Use -followers as default suggest sort on datasets, reuses and orgas [2727](https://github.com/opendatateam/udata/pull/2727) - Reintroduce user suggest with mongo contains [2725](https://github.com/opendatateam/udata/pull/2725) ``` ### 4.0.1 ``` - Removed `post_save` signal within `add_resource` and `update_resource` methods. [2720](https://github.com/opendatateam/udata/pull/2720) - Refactor and update documentation with latest udata updates [2717](https://github.com/opendatateam/udata/pull/2717) - Add harvest csv adapter for a catalog of harvesters [2722](https://github.com/opendatateam/udata/pull/2722) ``` ### 4.0.0 ``` Breaking change Search refactor [2680](https://github.com/opendatateam/udata/pull/2680) - :warning: Search changes [2692](https://github.com/opendatateam/udata/pull/2692): - The search feature is not within udata anymore and queries a distant service. - The search feature is now optional and is enabled by setting the `SEARCH_SERVICE_API_URL` setting. - When search is not enabled, the search endpoints will return a `501 Not Implemented` error. - The ModelAdapter, SearchQuery and SearchResult patterns were kept but heavily refactored. - udata uses a Kafka producer to send documents to index to the search service. - udata uses HTTP request to query the search service. - :warning: API changes [2669](https://github.com/opendatateam/udata/pull/2669): - List endpoints for organizations, datasets, reuses and users are now querying MongoDB instead of ElasticSearch. - Those endpoints use MongoDB full text search when `q` argument is used. Some unused filters on this route were dropped. - A new API parser was implemented to replace the search one. - The previous ElasticSearch endpoints were moved to APIv2 with the following url pattern: `/{object}/search` (ex: `/datasets/search`). - :warning: Suggest changes [2685](https://github.com/opendatateam/udata/pull/2685) and [#2696](https://github.com/opendatateam/udata/pull/2696): - Current suggest implementation moved from an Elasticsearch index to a MongoDB query using the term `contains`. - The user suggest was entirely removed, as its existence is now less relevant because of the full text search. ``` ### 3.3.3 ``` - Extend dcat properties support (frequency litteral, creation and modification date, landing page and abstract description) [2715](https://github.com/opendatateam/udata/pull/2715) ```Links
- PyPI: https://pypi.org/project/udata - Changelog: https://pyup.io/changelogs/udata/ - Repo: https://github.com/opendatateam/udata