Robinmcgvr / Kapow-Data

Please log here any issues found regarding Kapow Data
1 stars 0 forks source link

France - tv-programe.telecablesat.fr #202

Open Robinmcgvr opened 1 year ago

Robinmcgvr commented 1 year ago

Downloads from this site have now ceased as of 17/07 I've got Matteo looking into it ...

GoodallE commented 1 year ago

On 2023-07-24 12:30, Robinmcgvr wrote:

Downloads from this site have now ceased as of 17/07 I've got Matteo looking into it ... Thanks Robin ;)

Robinmcgvr commented 1 year ago

The site is surrently blocking us - Matteo has started a work around, which will make the data for this site an extra day behind if it works. We may also need to drop some channels, I ahve identified ones we don't need, such as belgian german swiss and italian ones this source picks up at the moment. I am hoping we can keep all the french ones in case they are needed at a later date.

Lynne12 commented 1 year ago

Website returns on 31 July, but none of the channels required for online scheduling are available for loading.

Robinmcgvr commented 1 year ago

Yes this is still a work in progress - we are seeing if we can get it to work fully again, I will update at the end of this week.

Robinmcgvr commented 1 year ago

More on this data - for all online scheduling channels (Cinc. Cinf. serieclub , Paris Premiere and Teva) the data stopped giving us the full day from 14/07 onwards All these channels are available via programm-tv.net - this site though does not give episode information Paris Premiere and Teva are also available via programme-television.org Cinc and cinf are currently also available via Belgian site cinetelerevue So we can cover all the channels apart from Serieclub from other sites we already download at the moment should we need to abandon telcablesat as a loading source I am seein gif I can find sericlub somewhere else

Robinmcgvr commented 1 year ago

I have saved data for Channel Sericlub from the TVEpg.eu site for channel Serieclub as this seems to be the only one we don't have an alternative source for . It will be a pain if we end up having to plug this gap manually, but it might come to it.

Lynne12 commented 1 year ago

@Robinmcgvr what is happening with this, please? I am loading 29 Aug-4 Sep week and this shows 4 September missing.

Robinmcgvr commented 1 year ago

is that a specific channel that is missing?

Robinmcgvr commented 1 year ago

There is a lag on the data from this source now due to the way Matteo has to treat it to get around the security, so it will be a few days behind -

Robinmcgvr commented 1 year ago

Anyway thanks for the heads up on the 4th being missing , which i can see it is now, as this would not have been picked up til tomorrow, the robots are only checked twice a week and note that on a monday we see data up to sunday and friday up to thursday in most cases

Robinmcgvr commented 1 year ago

Did you switch your loading source for any of the channels ? See August 3 entry above for alternative sources mentioned for some of these

Lynne12 commented 1 year ago

I haven't done anything, as you have not given any specific instructions. Most of the comments appear to be note gathering. If you would like loading sources switched, please advise which ones and the websites we will now use. The less websites the better, as it causes more work.

Robinmcgvr commented 1 year ago

what was the last period loaded for the french data?

Robinmcgvr commented 1 year ago

sorry seen that now

Lynne12 commented 1 year ago

July is missing 14th-31st August is missing 1st

Robinmcgvr commented 1 year ago

@Lynne12 so we can load the gaps from the following sources: programme-television.org (this site includes the episode info in a way that should import into studio - so the better source to use, sorry) Teva, Paris Premiere, Syfy,

programme-tv.net cinc and cinf (movies so don't need ep info)

Serieclub only has an alternative source for 06/08/2023 onwards, so unfortunately I am going to be stuck with manually scheduling that which is a pain

Robinmcgvr commented 1 year ago

n.b. actually need to go back to the 14/07 as we only have the very early hours for that date - guess we will get overlap potentially for two records per day for that period

Lynne12 commented 1 year ago

@Robinmcgvr I have asked Richard to set up the alternate websites, so that I can load the missing data. Will wait to hear when the serieclub 1 August is manually scheduled.

Lynne12 commented 1 year ago

n.b. actually need to go back to the 14/07 as we only have the very early hours for that date - guess we will get overlap potentially for two records per day for that period

I've deleted the overlaps.

Lynne12 commented 1 year ago

@Lynne12 so we can load the gaps from the following sources: programme-television.org (this site includes the episode info in a way that should import into studio - so the better source to use, sorry) Teva, Paris Premiere, Syfy,

programme-tv.net cinc and cinf (movies so don't need ep info)

Serieclub only has an alternative source for 06/08/2023 onwards, so unfortunately I am going to be stuck with manually scheduling that which is a pain

@Robinmcgvr Serieclub only needs 1 August manually scheduled. The remainder of August data is loaded for online scheduling. Can you please let me know which website I should be using to load Serieclub going forwards?

Lynne12 commented 1 year ago

@Robinmcgvr just reading back on this. Are we no longer using telecablesat website, going forward, for any channels? If so I need to set up the gap filling websites (as per your messages above), as the permanent loading websites.

Robinmcgvr commented 1 year ago

re, Serie club we should use the site programme-television.org

Robinmcgvr commented 1 year ago

I think it would probably be good idea to use the above source for all of the loading going forwards as it carries all the channels and it would keep things simple to use a single source

Lynne12 commented 1 year ago

@Robinmcgvr Loading source changed for all 6 channels. Just 1st August for you to manually schedule for Serieclub.

Robinmcgvr commented 8 months ago

@Lynne12 @Ma-rco We are missing 13/01/2024 for this one