jmozmoz / cloudmap

Python script to download a cloudmap from https://clouds.matteason.co.uk/ if a new one is abailable
GNU General Public License v3.0
17 stars 6 forks source link

Cannot download (all) satellite images! #5

Closed chron0 closed 9 years ago

chron0 commented 9 years ago

Anyone else having trouble getting latest images? For the past 24h cloudmap hasn't downloaded any new image. Manual login at dundee shows latest images of today. Am I the only one with this problem?

jmozmoz commented 9 years ago

The filenames of one of the satellites has changed. MSG3 is now MSG1.

I will fix it tonight.

chron0 commented 9 years ago

Sweet, I was assuming some changes on upstream side, but since the debug switch didn't really put out more information I was at a loss and didn't have enough time to strace ;)

jmozmoz commented 9 years ago

Should be fixed with the commits 90acb6491bb5e0d23ba35d8187f8819870f82343 and release 0.5.2 (3eca558b53607f6b530afd2cb7a35afc1b648ff5) on pypi

chron0 commented 9 years ago

Aye, thanks, 0.5.2 working here too, after manual deployment. Pip install failed me on ubuntu for some reason however, it seems to download the win32.zip for reasons I don't understand :)

/usr/bin/pip run on Thu Dec  4 09:21:09 2014
Downloading/unpacking CreateCloudMap
  Getting page http://pypi.python.org/simple/CreateCloudMap
  URLs to search for versions for CreateCloudMap:
  * http://pypi.python.org/simple/CreateCloudMap/
  Getting page http://pypi.python.org/simple/CreateCloudMap/
  Analyzing links from page https://pypi.python.org/simple/createcloudmap/
    Skipping link https://pypi.python.org/packages/2.7/C/CreateCloudMap/CreateCloudMap-0.3.0-py2.7.egg#md5=70a4d55dcbeb21adb48ca3e8d11ad4ac (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .egg
    Skipping link https://pypi.python.org/packages/2.7/C/CreateCloudMap/CreateCloudMap-0.4.0-py2.7.egg#md5=494c20a02e1faa35920745a4d3eb864c (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .egg
    Skipping link https://pypi.python.org/packages/2.7/C/CreateCloudMap/CreateCloudMap-0.4.1-py2.7.egg#md5=d62f61fed573ca47f710c8acc80da9df (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .egg
    Skipping link https://pypi.python.org/packages/2.7/C/CreateCloudMap/CreateCloudMap-0.4.2-py2.7.egg#md5=32eb949b04ad348e11569a65c34de72a (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .egg
    Skipping link https://pypi.python.org/packages/2.7/C/CreateCloudMap/CreateCloudMap-0.5.0-py2.7.egg#md5=83020602417648f9c1df2d577a10d7d0 (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .egg
    Skipping link https://pypi.python.org/packages/2.7/C/CreateCloudMap/CreateCloudMap-0.5.1-py2.7.egg#md5=02ad535d9ee9ae577d417e85ca72ee96 (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .egg
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.1.0.win-amd64.exe#md5=91ec09f813bb48ae5664eef410b3a2bc (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.2.0.cygwin-1.7.27-i686.exe#md5=4c14b50be692a30876ba463c90658c16 (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.2.0.win32.exe#md5=b6df4cecf7816c39a7a8521369fa0929 (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.3.0.cygwin-1.7.27-i686.exe#md5=f12b444e15455dd9784bc4baaede38da (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.3.0.win32.exe#md5=181db9707fdfde1789a47074b106ddbd (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.4.0.cygwin-1.7.28-i686.exe#md5=2db967d38155d00b3413a53532fe621d (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.4.0.win32.exe#md5=32bbc006226df993608914f781b55fe3 (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.4.1.cygwin-1.7.28-i686.exe#md5=871a5a2f85f41e3c5164a0ad185aefa8 (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.4.1.win32.exe#md5=535579ce61fc885e6f421a80d69469fc (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.4.2.cygwin-1.7.28-i686.exe#md5=736a26ac6d04a12798bb21b5bea7b3fc (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.4.2.win32.exe#md5=5e1523ec880f260d6a1e7bda0fafa88c (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.5.0.win32.exe#md5=7ede2b120bf59171449f4794d8c2bdb4 (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.5.1.win-amd64.exe#md5=27a3a10e8a7123fd75de01e2518538a8 (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.5.1.win32.exe#md5=b6c87027cc0d317bdcd6f8be1b8d0cea (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.5.2.win-amd64.exe#md5=5605749877e590f1939ef206759a67dd (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Found link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.5.2.win-amd64.zip#md5=e7614c4d4943a5ef157153ae5ea47f47 (from https://pypi.python.org/simple/createcloudmap/), version: 0.5.2.win-amd64
    Skipping link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.5.2.win32.exe#md5=dbb67f2551bcf48d632e841012bbdd07 (from https://pypi.python.org/simple/createcloudmap/); unknown archive format: .exe
    Found link https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.5.2.win32.zip#md5=6de4bd3f306421de6794ed6533e88e4f (from https://pypi.python.org/simple/createcloudmap/), version: 0.5.2.win32
    Found link https://pypi.python.org/packages/source/C/CreateCloudMap/CreateCloudMap-0.1.0.zip#md5=5c7f828d121729bf2218d7e56cb2b3e1 (from https://pypi.python.org/simple/createcloudmap/), version: 0.1.0
    Found link https://pypi.python.org/packages/source/C/CreateCloudMap/CreateCloudMap-0.2.0.tar.gz#md5=6123e4206da20b5d762ebd816f6d269b (from https://pypi.python.org/simple/createcloudmap/), version: 0.2.0
    Found link https://pypi.python.org/packages/source/C/CreateCloudMap/CreateCloudMap-0.3.0.tar.gz#md5=d738e33f5a12ed89a4fa938d77437d9e (from https://pypi.python.org/simple/createcloudmap/), version: 0.3.0
    Found link https://pypi.python.org/packages/source/C/CreateCloudMap/CreateCloudMap-0.4.0.tar.gz#md5=0766776c7324f4c344fc178b09159257 (from https://pypi.python.org/simple/createcloudmap/), version: 0.4.0
    Found link https://pypi.python.org/packages/source/C/CreateCloudMap/CreateCloudMap-0.4.1.tar.gz#md5=5d6c0b23caeb60266ee6e2904229b5ee (from https://pypi.python.org/simple/createcloudmap/), version: 0.4.1
    Found link https://pypi.python.org/packages/source/C/CreateCloudMap/CreateCloudMap-0.4.2.tar.gz#md5=2097881bb224b2e6baff505b5445ecb1 (from https://pypi.python.org/simple/createcloudmap/), version: 0.4.2
    Found link https://pypi.python.org/packages/source/C/CreateCloudMap/CreateCloudMap-0.5.0.tar.gz#md5=52991988b9564ee1cc2cb026f1b707ba (from https://pypi.python.org/simple/createcloudmap/), version: 0.5.0
    Found link https://pypi.python.org/packages/source/C/CreateCloudMap/CreateCloudMap-0.5.1.tar.gz#md5=d4f8cf00aaccfdb7ec58dae6f8b4c929 (from https://pypi.python.org/simple/createcloudmap/), version: 0.5.1
    Found link https://pypi.python.org/packages/source/C/CreateCloudMap/CreateCloudMap-0.5.2.zip#md5=7a8045b5f360108d9f4ad57b93dc6a89 (from https://pypi.python.org/simple/createcloudmap/), version: 0.5.2
  Using version 0.5.2.win32 (newest of versions: 0.5.2.win32, 0.5.2.win-amd64, 0.5.2, 0.5.1, 0.5.0, 0.4.2, 0.4.1, 0.4.0, 0.3.0, 0.2.0, 0.1.0)
  Downloading from URL https://pypi.python.org/packages/any/C/CreateCloudMap/CreateCloudMap-0.5.2.win32.zip#md5=6de4bd3f306421de6794ed6533e88e4f (from https://pypi.python.org/simple/createcloudmap/)
  Running setup.py egg_info for package CreateCloudMap
    Traceback (most recent call last):
      File "<string>", line 14, in <module>
    IOError: [Errno 2] No such file or directory: '/root/build/CreateCloudMap/setup.py'
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):

  File "<string>", line 14, in <module>

IOError: [Errno 2] No such file or directory: '/root/build/CreateCloudMap/setup.py'

----------------------------------------
Command python setup.py egg_info failed with error code 1
Exception information:
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 126, in main
    self.run(options, args)
  File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 223, in run
    requirement_set.prepare_files(finder, force_root_egg_info=self.bundle, bundle=self.bundle)
  File "/usr/lib/python2.7/dist-packages/pip/req.py", line 980, in prepare_files
    req_to_install.run_egg_info()
  File "/usr/lib/python2.7/dist-packages/pip/req.py", line 216, in run_egg_info
    command_desc='python setup.py egg_info')
  File "/usr/lib/python2.7/dist-packages/pip/__init__.py", line 255, in call_subprocess
    % (command_desc, proc.returncode))
InstallationError: Command python setup.py egg_info failed with error code 1
jmozmoz commented 9 years ago

I added a .tar.gz version of the package to pypi.

chron0 commented 9 years ago

Sweet thanks, did the dundee guys change the name again? Because the error reappeared today :)

jmozmoz commented 9 years ago

Yes indeed, they changed the name back. So so simplest fix for the moment is to install version 0.5.1:

pip uninstall CreateCloudMap
pip install CreateCloudMap==0.5.1
chron0 commented 9 years ago

Like a charm on ubuntu 12.10, here's the trace, just FYI and as reference for others.

# pip install CreateCloudMap==0.5.1
Downloading/unpacking CreateCloudMap==0.5.1
  Downloading CreateCloudMap-0.5.1.tar.gz
  Running setup.py egg_info for package CreateCloudMap

Requirement already satisfied (use --upgrade to upgrade): pyresample in /usr/local/lib/python2.7/dist-packages (from CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): numpy in /usr/local/lib/python2.7/dist-packages (from CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): scipy in /usr/local/lib/python2.7/dist-packages (from CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): requests in /usr/local/lib/python2.7/dist-packages (from CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): datetime in /usr/local/lib/python2.7/dist-packages (from CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): ConfigParser in /usr/local/lib/python2.7/dist-packages (from CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): pillowfight in /usr/local/lib/python2.7/dist-packages (from CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): setuptools>=0.7.2 in /usr/local/lib/python2.7/dist-packages (from CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): pyproj in /usr/local/lib/python2.7/dist-packages (from pyresample->CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): configobj in /usr/local/lib/python2.7/dist-packages (from pyresample->CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): zope.interface in /usr/local/lib/python2.7/dist-packages (from datetime->CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): pytz in /usr/local/lib/python2.7/dist-packages (from datetime->CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): PIL in /usr/local/lib/python2.7/dist-packages/PIL (from pillowfight->CreateCloudMap==0.5.1)
Requirement already satisfied (use --upgrade to upgrade): six in /usr/local/lib/python2.7/dist-packages (from configobj->pyresample->CreateCloudMap==0.5.1)
Installing collected packages: CreateCloudMap
  Running setup.py install for CreateCloudMap
    changing mode of build/scripts-2.7/winpostinstall.py from 644 to 755

    changing mode of /usr/local/bin/winpostinstall.py to 755
    Installing create_map script to /usr/local/bin
Successfully installed CreateCloudMap
Cleaning up...

and cloudmaps are updated again, sorry for the inconvenient waste of time, but I couldn't know that they would change it back and wanted to see if I'm the only one with this problem :) Frohe, unstressige Weihnachtstage, Joachim :)

jmozmoz commented 9 years ago

I pushed a new version to pypi (with the old satellite filename)

chron0 commented 9 years ago

Sweet, I've seen you were working on 0.6, I'll deploy it over the next three days and will give you feedback how it went. Anything special new about it?

jmozmoz commented 9 years ago

For the release 0.6.0 see https://github.com/jmozmoz/cloudmap/issues/6