search

UHaifa-IS / whgazetteer-mehdie

World Historical Gazetteer - MEHDIE version
http://whgazetteer.org
BSD 3-Clause "New" or "Revised" License
1 stars 1 forks source link

Matching failure: Error with Datasets, check again #151

Closed sinairusinek closed 10 months ago

sinairusinek commented 10 months ago

Error happened when trying to match Kima2024-1toMatchMaghrebAndalus vs ThurayyaAndalusMaghreb around 15:13, 10.1.24

tomersagi commented 10 months ago

Not a timeout. 

[2024-01-10 13:08:39,383: INFO/MainProcess] Received task: datasets.tasks.run_mehdi_er[7ff209cd-3a4f-4a3b-aea5-824f1f8cf2b8]  
[2024-01-10 13:08:39,387: WARNING/ForkPoolWorker-1] running mehdi_er
[2024-01-10 13:08:39,413: INFO/ForkPoolWorker-1] converting tsv to csv
[2024-01-10 13:08:39,454: INFO/ForkPoolWorker-1] posting to mehdi-er-snlwejaxvq-ez.a.run.app/uploadfile/ with files: /tmp/tmpev2wkzmq/Kima_June_2023 (3).csv and /tmp/tmpev2wkzmq/ThurayaSham.xlsx.csv
[2024-01-10 13:10:44,245: ERROR/ForkPoolWorker-1] Request failed: Expecting value: line 1 column 1 (char 0)
[2024-01-10 13:10:44,250: WARNING/ForkPoolWorker-1] received status from mehdie_er
[2024-01-10 13:10:44,251: WARNING/ForkPoolWorker-1] 500
[2024-01-10 13:10:44,264: INFO/ForkPoolWorker-1] Task datasets.tasks.run_mehdi_er[7ff209cd-3a4f-4a3b-aea5-824f1f8cf2b8] succeeded in 124.877072006464s: (None, 500)
tomersagi commented 10 months ago

This is occuring because the prep service is returning None

sinairusinek commented 10 months ago

What could cause it?

On Wed, 10 Jan 2024 at 16:28, Tomer Sagi @.***> wrote:

This is occuring because the prep service is returning None

— Reply to this email directly, view it on GitHub https://github.com/UHaifa-IS/whgazetteer-mehdie/issues/151#issuecomment-1884954480, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABBNVBC5OXQJX3ESRZNIDQ3YN2QSLAVCNFSM6AAAAABBUYYDHSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBUHE2TINBYGA . You are receiving this because you authored the thread.Message ID: @.***>

tomersagi commented 10 months ago

Not enough memory for the Prep service. I increased to 1GB (was 0.5 GB). Please try again.

sinairusinek commented 10 months ago

should I try again?

On Wed, 10 Jan 2024 at 16:35, Tomer Sagi @.***> wrote:

Not enough memory for the Prep service. I increased to 1GB (was 0.5 GB).

— Reply to this email directly, view it on GitHub https://github.com/UHaifa-IS/whgazetteer-mehdie/issues/151#issuecomment-1884966467, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABBNVBAG5CCZRNYLCVXH5YTYN2RK5AVCNFSM6AAAAABBUYYDHSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBUHE3DMNBWG4 . You are receiving this because you authored the thread.Message ID: @.***>

tomersagi commented 10 months ago

Yes

tomersagi commented 10 months ago

Memory still not enough at 1GB, increased to 6 GB. @sinairusinek try again in 30 minutes.

sinairusinek commented 10 months ago

Will try this evening!

On Fri, 12 Jan 2024, 5:03 pm Tomer Sagi, @.***> wrote:

Memory still not enough at 1GB, increased to 6 GB. @sinairusinek https://github.com/sinairusinek try again in 30 minutes.

— Reply to this email directly, view it on GitHub https://github.com/UHaifa-IS/whgazetteer-mehdie/issues/151#issuecomment-1889450542, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABBNVBG5E2H77WEZHNXVTMTYOFGEZAVCNFSM6AAAAABBUYYDHSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBZGQ2TANJUGI . You are receiving this because you were mentioned.Message ID: @.***>

sinairusinek commented 10 months ago

sorry, both jobs are still failing with the same result. These are relatively small sets so I don't see how this could be an issue of memory...

On Fri, 12 Jan 2024 at 17:04, Sinai Rusinek @.***> wrote:

Will try this evening!

On Fri, 12 Jan 2024, 5:03 pm Tomer Sagi, @.***> wrote:

Memory still not enough at 1GB, increased to 6 GB. @sinairusinek https://github.com/sinairusinek try again in 30 minutes.

— Reply to this email directly, view it on GitHub https://github.com/UHaifa-IS/whgazetteer-mehdie/issues/151#issuecomment-1889450542, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABBNVBG5E2H77WEZHNXVTMTYOFGEZAVCNFSM6AAAAABBUYYDHSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBZGQ2TANJUGI . You are receiving this because you were mentioned.Message ID: @.***>

tomersagi commented 10 months ago

resolved by fixing indentation bug in er-prep