search

ArchivesPortalEuropeFoundation / Topic-Detection

Using machine learning approaches for automatic topic detection in a multilingual environment
6 stars 0 forks source link

Issue when searching for entities on Dev Interface #79

Open fedenanni opened 2 years ago

fedenanni commented 2 years ago

Hi @kstamatis I might need your help debugging this problem. The new dev interface that we have set up does not accept any entity query. For all of them gives back a server error (see below). What I think is happening is either a problem reading some local files or a problem querying Wikipedia or Wikidata from inside the container, however I don't know how to debug that (locally on my machine all works fine).

Screenshot 2022-04-23 at 15 31 01

Where should we start? Thanks!

fedenanni commented 2 years ago

Actually I think i have found a way - you can see the log of the container running docker container logs topic-detection-backend on the VM. It seems there's a memory issue when entity queries are fired - could you increase the memory of the container Screenshot 2022-04-23 at 15 34 35 ?

fedenanni commented 2 years ago

Alternatively we could try to change this when inizialising the parallel search pandarallel.initalize withuse_memory_fs=False` - I'll give it a try now

fedenanni commented 2 years ago

@kstamatis I changed that line and restarted - maybe it solves the issue otherwise I think we'll need more memory

fedenanni commented 2 years ago

@kstamatis actually that might have solved the issue it seems