search

MetPX / sarracenia

https://MetPX.github.io/sarracenia
GNU General Public License v2.0
44 stars 22 forks source link

Incomplete XMLs being distributed since January 21, 2019 #131

Open mikegabriel opened 5 years ago

mikegabriel commented 5 years ago

Hello,

I am not sure if you have had it reported but starting January 21, sr_subscribe has been downloading incomplete XML files for certain locations.

Specifically, the closing tag </siteData> is being included at </sit

I've updated the the latest version of sarracenia but the problem persists.

For reference, see the latest as of this time of writing for s0000822 (Moose Jaw, SK) and look at line 866.

Is there troubles on your end of things or do you have suggestions?

Thanks!

petersilva commented 1 year ago

Hi there... today feeds, are migrating to being produced directly by the source, and we can just deliver it, instead of having to harvest them without co-operation from the source. This change ihappenning now, Perhaps tommorrow you should see a change.

matthewdarwin commented 1 year ago

Still get some corrupted files.

matthewdarwin commented 8 months ago

Corrupted city_page xml files continue to be distributed. Several hundred per day on average.

petersilva commented 7 months ago

Is this still a problem? You submitted a fix to your plugin a week or two ago. Did that explain everything, or are you still seeing corruption?

matthewdarwin commented 7 months ago

ongoing....

From: Sun Feb 11 00:00:00 EST 2024
To:   Sun Feb 11 23:59:59 EST 2024

                         successful downloads (dd): 626,144
                   dd non-index non-AMQP downloads: 602,631
         unsuccessful downloads (other, see below): 478
                                 avg download time: 0.25 seconds
                                  avg document age: 1436.04 seconds

List of Errors:
   5          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000598_e.xml
   4          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/BC/s0000679_e.xml
   4          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/SK/s0000684_f.xml
   4          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000598_f.xml
   4          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/BC/s0000242_f.xml
   4          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NS/s0000670_e.xml
   4          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NU/s0000540_e.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000610_e.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NS/s0000649_e.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NL/s0000859_f.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/MB/s0000445_f.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NL/s0000128_f.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/ON/s0000539_e.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/BC/s0000671_e.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/YT/s0000825_e.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/YT/s0000760_e.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/BC/s0000633_f.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000541_e.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/ON/s0000641_e.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/BC/s0000242_e.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/AB/s0000477_f.xml
   3          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/MB/s0000776_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000620_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/ON/s0000233_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NL/s0000114_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NU/s0000713_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/AB/s0000066_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000627_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/BC/s0000392_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/SK/s0000209_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/MB/s0000778_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/ON/s0000629_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000784_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/YT/s0000593_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NU/s0000694_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/SK/s0000684_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000542_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/AB/s0000518_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/BC/s0000592_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/ON/s0000752_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NT/s0000560_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/BC/s0000770_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/PE/s0000026_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NU/s0000820_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/MB/s0000417_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000494_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/ON/s0000753_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/ON/s0000538_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/SK/s0000576_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NL/s0000594_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000346_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/MB/s0000566_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/PE/s0000138_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NB/s0000688_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NL/s0000181_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/SK/s0000581_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000348_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/MB/s0000508_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/ON/s0000639_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NT/s0000560_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/SK/s0000514_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/ON/s0000642_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NL/s0000115_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NT/s0000164_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NT/s0000442_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NL/s0000100_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NT/s0000759_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/MB/s0000778_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NL/s0000736_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NT/s0000570_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/AB/s0000824_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NU/s0000678_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/ON/s0000231_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/BC/s0000002_e.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NL/s0000780_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/BC/s0000679_f.xml
   2          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/NU/s0000672_f.xml
   1          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/ON/s0000512_f.xml
   1          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000483_f.xml
   1          Invalid XML https://dd.weather.gc.ca/citypage_weather/xml/QC/s0000480_e.xml
etc...