reustle / covid19japan-data

https://data.covid19japan.com
MIT License
49 stars 16 forks source link

Data not updating since 9/15 #92

Closed awtimmering closed 2 years ago

awtimmering commented 2 years ago

Looks like the GitHub actions are firing but latest numbers are of 9/15 (3 days ago).

liquidx commented 2 years ago

Thanks for reporting, that is odd. The actions are not failing, so we didn't notice. I'm checking it now.

liquidx commented 2 years ago

Oh, the action is running out of memory and silently failing.

https://github.com/reustle/covid19japan-data/runs/3637633216?check_suite_focus=true


FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
 1: 0xa1a640 node::Abort() [node]
 2: 0xa1aa4c node::OnFatalError(char const*, char const*) [node]
 3: 0xb9a62e v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [node]
 4: 0xb9a9a9 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [node]
 5: 0xd57c25  [node]
 6: 0xd582b6 v8::internal::Heap::RecomputeLimits(v8::internal::GarbageCollector) [node]
 7: 0xd64b75 v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::GCCallbackFlags) [node]
 8: 0xd65a25 v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [node]
 9: 0xd6719c v8::internal::Heap::CollectAllAvailableGarbage(v8::internal::GarbageCollectionReason) [node]
10: 0xd68536 v8::internal::Heap::AllocateRawWithRetryOrFail(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [node]
11: 0xd36a0d v8::internal::Factory::NewRawTwoByteString(int, v8::internal::AllocationType) [node]
12: 0xf76ca5 v8::internal::String::SlowFlatten(v8::internal::Isolate*, v8::internal::Handle<v8::internal::ConsString>, v8::internal::AllocationType) [node]
13: 0xb9988b v8::internal::String::Flatten(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::AllocationType) [node]
14: 0xbadc69 v8::String::Utf8Length(v8::Isolate*) const [node]
15: 0x9f3229  [node]
16: 0xc06599  [node]
17: 0xc08387 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
18: 0x140dd19  [node]
liquidx commented 2 years ago

I've temporarily done a manual data update for yesterday's data. We'll have to go in an optimize it a bit to reduce the memory usage.

Thanks again!

liquidx commented 2 years ago

Manually increased the node env heap size so this should get it back to working again.

https://github.com/reustle/covid19japan-data/commit/87e29544f36dac0ab8abdf5a978302411e21e333

wbudd commented 2 years ago

@liquidx Looks like this issue is happening again, since last evening?

liquidx commented 2 years ago

Should be updated now. We just didn't update the numbers last night.

wbudd commented 2 years ago

Oh, I see, thanks—didn't realize there was a manual step involved in generating the updates.