search

edv / docker-spotweb

Dockerfile to easily set up Spotweb using Docker on the Raspberry Pi (or any compatible arm chipset) and regular x86 chipsets
MIT License
29 stars 20 forks source link

Initial install only fills spots from date of setup #51

Closed DrFrankensteinUK closed 10 months ago

DrFrankensteinUK commented 1 year ago

Hey sorry back again, we seem to be seeing a bug and I am not sure if it's from here or upstream as I have seen this on other containers as well.

By default Spotweb seems to be using 'today' as the default date to pull spots from so no backlog is pulled. And when amending the date back to November 2009 from the UI the database does not change.

If I manually flush tables (might be overkill) and then manually amend the 'Retrieve_Newer_Than' to 1257030000 in the Settings table everything then pulls correctly.

Happy to do any testing required to get this working as it seems to do it on every fresh install.

Tables I flush with Foreign Key checks disabled are:

cache
commentsfull
commentsposted
commentsxover
moderedringbuffer
reportsposted
reportsxover
spots
spotsfull
spotstatelist
usenetstate
lennyg1 commented 1 year ago

For anyone else finding this at some point. I just ran the following command after changing the Retrieve_Newer_Than date in the database settings table. Setting this through frontend didn't do much for me. The retro command should only be run once and will take a while depending on what you set it to.

docker exec spotweb /usr/bin/php /app/retrieve.php --retro

DrFrankensteinUK commented 11 months ago

I have noticed this is taking place on every fresh install - I will do some investigating on if there is a way to stop the behaviour.

DrFrankensteinUK commented 11 months ago

Apologies I will get back to this!

pic16f876 commented 11 months ago

For anyone else finding this at some point. I just ran the following command after changing the Retrieve_Newer_Than date in the database settings table. Setting this through frontend didn't do much for me. The retro command should only be run once and will take a while depending on what you set it to.

docker exec spotweb /usr/bin/php /app/retrieve.php --retro

This worked perfectly!

modparts commented 10 months ago

For anyone else finding this at some point. I just ran the following command after changing the Retrieve_Newer_Than date in the database settings table. Setting this through frontend didn't do much for me. The retro command should only be run once and will take a while depending on what you set it to.

docker exec spotweb /usr/bin/php /app/retrieve.php --retro

how do i change date in db?

DrFrankensteinUK commented 10 months ago

For anyone else finding this at some point. I just ran the following command after changing the Retrieve_Newer_Than date in the database settings table. Setting this through frontend didn't do much for me. The retro command should only be run once and will take a while depending on what you set it to.

docker exec spotweb /usr/bin/php /app/retrieve.php --retro

I have a mini guide just to save typing up in here.

https://drfrankenstein.co.uk/spotweb-not-backfilling/

how do i change date in db?

modparts commented 10 months ago

For anyone else finding this at some point. I just ran the following command after changing the Retrieve_Newer_Than date in the database settings table. Setting this through frontend didn't do much for me. The retro command should only be run once and will take a while depending on what you set it to. docker exec spotweb /usr/bin/php /app/retrieve.php --retro

I have a mini guide just to save typing up in here.

https://drfrankenstein.co.uk/spotweb-not-backfilling/

how do i change date in db?

Thank you very much, very helpfull and glad i got it working.