search

arquivo / pwa-technologies

Arquivo.pt main goal is the preservation and access of web contents that are no longer available online. During the developing of the PWA IR (information retrieval) system we faced limitations in searching speed, quality of results, scalability and usability. To cope with this, we modified the archive-access project (http://archive-access.sourceforge.net/) to support our web archive IR requirements. Nutchwax, Nutch and Wayback’s code were adapted to meet the requirements. Several optimizations were added, such as simplifications in the way document versions are searched and several bottlenecks were resolved. The PWA search engine is a public service at http://archive.pt and a research platform for web archiving. As it predecessor Nutch, it runs over Hadoop clusters for distributed computing following the map-reduce paradigm. Its major features include fast full-text search, URL search, phrase search, faceted search (date, format, site), and sorting by relevance and date. The PWA search engine is highly scalable and its architecture is flexible enough to enable the deployment of different configurations to respond to the different needs. Currently, it serves an archive collection searchable by full-text with 180 million documents ranging between 1996 and 2010.
http://www.arquivo.pt
GNU General Public License v3.0
39 stars 7 forks source link

Image Advanced Search should support multiple format search #1236

Closed dcgomes closed 2 years ago

dcgomes commented 2 years ago

What is the URL that originated the issue? https://arquivo.pt/image/advanced/search?q=&from=19910806&to=20220121&trackingId=2250ef93a34adb4c5daf_39afec52f3282ff9d9b3

What happened? On the "Images with the format:" input field only one format can be chosen at a time, even though the system supports searches with more than one file type.

What should have happened? The user interface should allow for multiple options to be selected. https://arquivo.pt/image/search?q=publico+format%3Agif%2Cjpg&l=en&from=19910806&to=20220121&trackingId=2250ef93a34adb4c5daf_4934ad1eedfe5d91065b

It also seems to exist some inconsistency with behavior of commands "type" and "format".

VascoRatoFCCN commented 2 years ago

https://github.com/arquivo/arquivo-webapp-eros/commit/7cf93986d9b6107fa6fcdf609b3ed5698c6325ea was supposed to reference #1235

VascoRatoFCCN commented 2 years ago

The format: tag does not do anything, you can check that by using both tags at the same time:

https://arquivo.pt/image/search?q=format%3Agif%2Cpng+type%3Ajpeg

All the results have names like "image.png" but their actual type is JPEG. Currently there is no way to search multiple formats.

VascoRatoFCCN commented 2 years ago

https://github.com/arquivo/image-search-api/commit/c6b113037897c1c4521f79f280ee81d615935c28 fixed this issue.

Can be tested at https://dev.arquivo.pt/image/search?q=publico+type%3Agif%2Cpng

arquivo-awp commented 2 years ago

Looks OK. Ready to deploy.