search

steve8x8 / geotoad

Geocaching query tool written in Ruby
https://buymeacoffee.com/steve8x8
Other
28 stars 8 forks source link

either unpublished or hidden subscriber-only, skipping #278

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
[Please include the relevant parts of your command line, if applicable.
Don't send your password though!]
1. geotoad.rb -u myUser -p myPW -o /Users/mkp/Documents/ouput.gpx -x gpx -q 
coord "N 52 01.777 E 008 37.444" -y 1km -v
2. All Caches are skipped with message unpublished or hidden subscriber-only.

What is the expected output? What do you see instead?
[If possible, include the last ~10--20 lines of verbose output.]
Here the verbose output for a 1km run:
*************************************************
*************************************************
(===) GeoToad 3.17.10 (x86_64-darwin12-1.9.3)
( - ) Report bugs or suggestions at http://code.google.com/p/geotoad/issues/
( - ) Please include verbose output (-v) without passwords in the bug report.
( o ) Populating templates from /Applications/GeoToad/lib/../data/../templates
( - ) 41 templates total
( - ) Cookie expires Thu, 27-Aug-2015 12:01:23 GMT (in 730.00 days)

D: Internally using distance 0.621 miles.
D: History 809f0521:  --distanceMax=1km --format=gpx --output=* 
--queryType=coord
( - ) Your cache directory is /Users/mkp/Library/Caches/GeoToad
( o ) Logging in as TeamHeepen
D: login called for user=TeamHeepen pass=*******
D: Loading cookies from /Users/mkp/Library/Preferences/GeoToad/cookies.yaml
D: loadCookie: found ASP.NET_SessionId=aevp3**************45uin
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: setting local expiry to 1
D: Checking validity of cookie (ASP.NET_SessionId=aevp3...45uin)
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/login/default.aspx
D: no local cache file found for 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/login/default.aspx
D: Fetching URL [https://www.geocaching.com/login/default.aspx]
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: creating /Users/mkp/Library/Caches/GeoToad/www.geocaching.com/login
D: outputting 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/login/default.aspx
D: Returning 41914 bytes: 

<!DOCTYPE html>
(...)>
</body>
</html>
D: post URL is https://www.geocaching.com/login/default.aspx
D: found hidden post variable: __EVENTTARGET
D: found hidden post variable: __EVENTARGUMENT
D: found hidden post variable: __VIEWSTATE
D: Found logged-in panel
D: Found login confirmation!
D: saveCookie: ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: setting local expiry to 1
D: Checking validity of cookie (ASP.NET_SessionId=aevp3...45uin)
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/login/default.aspx
D: local cache is only 0 (<= 1) sec old, using local file.
D: 41914 bytes retrieved from local cache
D: post URL is https://www.geocaching.com/login/default.aspx
D: found hidden post variable: __EVENTTARGET
D: found hidden post variable: __EVENTARGUMENT
D: found hidden post variable: __VIEWSTATE
D: Found logged-in panel
D: Found login confirmation!
D: Login returned cookie "ASP.NET_SessionId=aevp3**************45uin"
( o ) Login successful
( o ) Querying user preferences
D: setting local expiry to 21600
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/account/ManagePreferences.a
spx
D: no local cache file found for 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/account/ManagePreferences.a
spx
D: Fetching URL [http://www.geocaching.com/account/ManagePreferences.aspx]
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: creating /Users/mkp/Library/Caches/GeoToad/www.geocaching.com/account
D: outputting 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/account/ManagePreferences.a
spx
D: Returning 60567 bytes: 

<!DOCTYPE html>
(...)>
</body>
</html>
D: setting selected option ctl00$ContentBody$uxLanguagePreference=en-US 
(English)
D: setting selected option ctl00$ContentBody$uxDateTimeFormat=MM/dd/yyyy ( 
08/27/2013)
D: setting selected option ctl00$ContentBody$uxInstantMessengerProvider=0 (None)
D: setting selected option ctl00$ContentBody$ddlGPXVersion=1 (GPX 1.0)
( - ) Using date format MM/dd/yyyy

( o ) Performing coord search for N 52 01.777 E 008 37.444 (constraining to 
0.621 miles)
( o ) Coordinates "N 52 01.777 E 008 37.444" parsed as latitude 52.0296167, 
longitude 8.6240667
( - ) 
http://www.geocaching.com/seek/nearest.aspx?lat=52.029617&lng=8.624067&dist=0.62
1
D: searchResults: 
http://www.geocaching.com/seek/nearest.aspx?lat=52.029617&lng=8.624067&dist=0.62
1
D: setting local expiry to 43200
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/nearest.aspx_lat_52.02
9617_lng_8.624067_dist_0.621
D: no local cache file found for 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/nearest.aspx_lat_52.02
9617_lng_8.624067_dist_0.621
D: Fetching URL 
[http://www.geocaching.com/seek/nearest.aspx?lat=52.029617&lng=8.624067&dist=0.6
21]
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: creating /Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek
D: outputting 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/nearest.aspx_lat_52.02
9617_lng_8.624067_dist_0.621
D: Returning 99974 bytes: 

<!DOCTYPE html>
(...)>
</body>
</html>
D: found hidden post variable: __EVENTTARGET
D: found hidden post variable: __EVENTARGUMENT
D: found hidden post variable: __LASTFOCUS
D: found hidden post variable: __VIEWSTATEFIELDCOUNT
D: found hidden post variable: __VIEWSTATE
D: found hidden post variable: __VIEWSTATE1
D: --- end of row ---
D: found Favorites=0
D: creator=josi49
D: wid=GC2EGDV
D: Country/state found Nordrhein-Westfalen Germany
D: Using country Germany state Nordrhein-Westfalen
D: create date: 09/03/2010 at line:                         <span 
class="small">09/03/2010</span>
D: parsing date: [09/03/2010]
D: MM/dd/yyyy date: year=2010 month=09, day=03
D: Timestamp parsed as 2010-09-03 00:00:00 +0200
D: ctime=2010-09-03 00:00:00 +0200 cdays=1089
D: last found date: 08/17/2013 at line:                             
08/17/2013<br />
D: parsing date: [08/17/2013]
D: MM/dd/yyyy date: year=2013 month=08, day=17
D: Timestamp parsed as 2013-08-17 00:00:00 +0200
D: mtime=2013-08-17 00:00:00 +0200 mdays=10
D: --- end of row ---
D: - closing GC2EGDV record -
D: found Favorites=1
D: creator=geo-ete
D: wid=GC2N9YF
D: Country/state found Nordrhein-Westfalen Germany
D: Using country Germany state Nordrhein-Westfalen
D: create date: 02/10/2011 at line:                         <span 
class="small">02/10/2011</span>
D: parsing date: [02/10/2011]
D: MM/dd/yyyy date: year=2011 month=02, day=10
D: Timestamp parsed as 2011-02-10 00:00:00 +0100
D: ctime=2011-02-10 00:00:00 +0100 cdays=929
D: last found date: Yesterday* at line:                             
Yesterday<strong>*</strong><br />
D: parsing date: [Yesterday*]
D: date: Yesterday
D: Timestamp parsed as 2013-08-26 14:01:29 +0200
D: mtime=2013-08-26 14:01:29 +0200 mdays=1
D: --- end of row ---
D: - closing GC2N9YF record -
D: found Favorites=1
D: creator=josi49
D: wid=GC2EGDM
D: Country/state found Nordrhein-Westfalen Germany
D: Using country Germany state Nordrhein-Westfalen
D: trackables flagged:                         <a 
id="ctl00_ContentBody_dlResults_ctl03_uxTravelBugList" class="tblist" 
data-tbcount="2" data-id="1868795" 
data-guid="20be16e5-fded-4f0b-9ebb-490917f89873" href="javascript:void();"><img 
src="/images/icons/16/trackable_inventory.png" /></a>
D: create date: 09/03/2010 at line:                         <span 
class="small">09/03/2010</span>
D: parsing date: [09/03/2010]
D: MM/dd/yyyy date: year=2010 month=09, day=03
D: Timestamp parsed as 2010-09-03 00:00:00 +0200
D: ctime=2010-09-03 00:00:00 +0200 cdays=1089
D: last found date: 08/17/2013 at line:                             
08/17/2013<br />
D: parsing date: [08/17/2013]
D: MM/dd/yyyy date: year=2013 month=08, day=17
D: Timestamp parsed as 2013-08-17 00:00:00 +0200
D: mtime=2013-08-17 00:00:00 +0200 mdays=10
D: --- end of row ---
D: - closing GC2EGDM record -
D: found Favorites=0
D: creator=josi49
D: wid=GC2EGDQ
D: Country/state found Nordrhein-Westfalen Germany
D: Using country Germany state Nordrhein-Westfalen
D: trackables flagged:                         <a 
id="ctl00_ContentBody_dlResults_ctl04_uxTravelBugList" class="tblist" 
data-tbcount="1" data-id="1868798" 
data-guid="1ae9855b-4663-4545-a039-7c57380f5226" href="javascript:void();"><img 
src="http://www.geocaching.com/images/wpttypes/sm/3602.gif" alt="Rothaarsteig 
Geocoin" title="Rothaarsteig Geocoin" /></a>
D: create date: 09/03/2010 at line:                         <span 
class="small">09/03/2010</span>
D: parsing date: [09/03/2010]
D: MM/dd/yyyy date: year=2010 month=09, day=03
D: Timestamp parsed as 2010-09-03 00:00:00 +0200
D: ctime=2010-09-03 00:00:00 +0200 cdays=1089
D: last found date: Today* at line:                             
Today<strong>*</strong><br />
D: parsing date: [Today*]
D: date: Today
D: Timestamp parsed as 2013-08-27 14:01:29 +0200
D: mtime=2013-08-27 14:01:29 +0200 mdays=0
D: --- end of row ---
D: - closing GC2EGDQ record -
D: found Favorites=0
D: creator=josi49
D: wid=GC2EGDJ
D: Country/state found Nordrhein-Westfalen Germany
D: Using country Germany state Nordrhein-Westfalen
D: create date: 09/03/2010 at line:                         <span 
class="small">09/03/2010</span>
D: parsing date: [09/03/2010]
D: MM/dd/yyyy date: year=2010 month=09, day=03
D: Timestamp parsed as 2010-09-03 00:00:00 +0200
D: ctime=2010-09-03 00:00:00 +0200 cdays=1089
D: last found date: 08/17/2013 at line:                             
08/17/2013<br />
D: parsing date: [08/17/2013]
D: MM/dd/yyyy date: year=2013 month=08, day=17
D: Timestamp parsed as 2013-08-17 00:00:00 +0200
D: mtime=2013-08-17 00:00:00 +0200 mdays=10
D: --- end of row ---
D: - closing GC2EGDJ record -
D: found Favorites=2
D: creator=vachesept
D: wid=GC23DQ6
D: Country/state found Nordrhein-Westfalen Germany
D: Using country Germany state Nordrhein-Westfalen
D: create date: 01/28/2010 at line:                         <span 
class="small">01/28/2010</span>
D: parsing date: [01/28/2010]
D: MM/dd/yyyy date: year=2010 month=01, day=28
D: Timestamp parsed as 2010-01-28 00:00:00 +0100
D: ctime=2010-01-28 00:00:00 +0100 cdays=1307
D: last found date: 08/13/2013 at line:                             
08/13/2013<br />
D: parsing date: [08/13/2013]
D: MM/dd/yyyy date: year=2013 month=08, day=13
D: Timestamp parsed as 2013-08-13 00:00:00 +0200
D: mtime=2013-08-13 00:00:00 +0200 mdays=14
D: --- end of row ---
D: - closing GC23DQ6 record -
D: found Favorites=23
D: creator=SvanThan
D: wid=GC37090
D: Country/state found Nordrhein-Westfalen Germany
D: Using country Germany state Nordrhein-Westfalen
D: create date: 11/01/2011 at line:                         <span 
class="small">11/01/2011</span>
D: parsing date: [11/01/2011]
D: MM/dd/yyyy date: year=2011 month=11, day=01
D: Timestamp parsed as 2011-11-01 00:00:00 +0100
D: ctime=2011-11-01 00:00:00 +0100 cdays=665
D: last found date: 08/11/2013 at line:                             
08/11/2013<br />
D: parsing date: [08/11/2013]
D: MM/dd/yyyy date: year=2013 month=08, day=11
D: Timestamp parsed as 2013-08-11 00:00:00 +0200
D: mtime=2013-08-11 00:00:00 +0200 mdays=16
D: --- end of row ---
D: - closing GC37090 record -
D: found Favorites=4
D: creator=josi49
D: wid=GC2EGE1
D: Country/state found Nordrhein-Westfalen Germany
D: Using country Germany state Nordrhein-Westfalen
D: create date: 09/03/2010 at line:                         <span 
class="small">09/03/2010</span>
D: parsing date: [09/03/2010]
D: MM/dd/yyyy date: year=2010 month=09, day=03
D: Timestamp parsed as 2010-09-03 00:00:00 +0200
D: ctime=2010-09-03 00:00:00 +0200 cdays=1089
D: last found date: 07/31/2013 at line:                             
07/31/2013<br />
D: parsing date: [07/31/2013]
D: MM/dd/yyyy date: year=2013 month=07, day=31
D: Timestamp parsed as 2013-07-31 00:00:00 +0200
D: mtime=2013-07-31 00:00:00 +0200 mdays=27
D: --- end of row ---
D: - closing GC2EGE1 record -
D: processPage done: page:1 total_pages: 1 parsed: 8
D: src of last get was remote
[###] (1/1) Processing results for N 52 01.777 E 008 37.444: from remote
D: pre-filter: GC2EGDV
D: pre-filter: GC2N9YF
D: pre-filter: GC2EGDM
D: pre-filter: GC2EGDQ
D: pre-filter: GC2EGDJ
D: pre-filter: GC23DQ6
D: pre-filter: GC37090
D: pre-filter: GC2EGE1
( o ) 8 geocaches found in defined area.

D: Filter running cycle 1, 8 caches left
D: Filter running cycle 2, 8 caches left
D: Filter running cycle 3, 8 caches left
( o ) Filter stage 1 complete, 8 caches left

( o ) Fetching geocache pages
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDV_l
c_10
D: no local cache file found for 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDV_l
c_10
D: Fetching URL [http://www.geocaching.com/seek/cdpf.aspx?wp=GC2EGDV&lc=10]
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: outputting 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDV_l
c_10
D: Returning 50425 bytes: 

<!DOCTYPE html>
(...)>
</body>
</html>
 ***  GC2EGDV is either unpublished or hidden subscriber-only, skipping.
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2N9YF_l
c_10
D: no local cache file found for 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2N9YF_l
c_10
D: Fetching URL [http://www.geocaching.com/seek/cdpf.aspx?wp=GC2N9YF&lc=10]
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: outputting 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2N9YF_l
c_10
D: Returning 50425 bytes: 

<!DOCTYPE html>
(...)>
</body>
</html>
 ***  GC2N9YF is either unpublished or hidden subscriber-only, skipping.
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDM_l
c_10
D: no local cache file found for 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDM_l
c_10
D: Fetching URL [http://www.geocaching.com/seek/cdpf.aspx?wp=GC2EGDM&lc=10]
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: outputting 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDM_l
c_10
D: Returning 50425 bytes: 

<!DOCTYPE html>
(...)>
</body>
</html>
 ***  GC2EGDM is either unpublished or hidden subscriber-only, skipping.
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDQ_l
c_10
D: no local cache file found for 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDQ_l
c_10
D: Fetching URL [http://www.geocaching.com/seek/cdpf.aspx?wp=GC2EGDQ&lc=10]
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: outputting 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDQ_l
c_10
D: Returning 50425 bytes: 

<!DOCTYPE html>
(...)>
</body>
</html>
 ***  GC2EGDQ is either unpublished or hidden subscriber-only, skipping.
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDJ_l
c_10
D: no local cache file found for 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDJ_l
c_10
D: Fetching URL [http://www.geocaching.com/seek/cdpf.aspx?wp=GC2EGDJ&lc=10]
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: outputting 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGDJ_l
c_10
D: Returning 50425 bytes: 

<!DOCTYPE html>
(...)>
</body>
</html>
 ***  GC2EGDJ is either unpublished or hidden subscriber-only, skipping.
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC23DQ6_l
c_10
D: no local cache file found for 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC23DQ6_l
c_10
D: Fetching URL [http://www.geocaching.com/seek/cdpf.aspx?wp=GC23DQ6&lc=10]
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: outputting 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC23DQ6_l
c_10
D: Returning 50425 bytes: 

<!DOCTYPE html>
(...)>
</body>
</html>
 ***  GC23DQ6 is either unpublished or hidden subscriber-only, skipping.
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC37090_l
c_10
D: no local cache file found for 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC37090_l
c_10
D: Fetching URL [http://www.geocaching.com/seek/cdpf.aspx?wp=GC37090&lc=10]
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: outputting 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC37090_l
c_10
D: Returning 50425 bytes: 

<!DOCTYPE html>
(...)>
</body>
</html>
 ***  GC37090 is either unpublished or hidden subscriber-only, skipping.
D: cachefile: 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGE1_l
c_10
D: no local cache file found for 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGE1_l
c_10
D: Fetching URL [http://www.geocaching.com/seek/cdpf.aspx?wp=GC2EGE1&lc=10]
D: using cookie ["TeamHeepen"] ASP.NET_SessionId=aevp3**************45uin
D: outputting 
/Users/mkp/Library/Caches/GeoToad/www.geocaching.com/seek/cdpf.aspx_wp_GC2EGE1_l
c_10
D: Returning 50425 bytes: 

<!DOCTYPE html>
(...)>
</body>
</html>
 ***  GC2EGE1 is either unpublished or hidden subscriber-only, skipping.

D: filtering by removeByElement: disabled
( o ) Filter stage 2 complete, 0 caches left
( o ) No caches were found that matched your requirements
*************************************************
*************************************************

What version of the product are you using? On what operating system?
[Did you check you're using the latest version?]
GeoToad 3.17.10 (x86_64-darwin12-1.9.3)

Please provide any additional information below.
System is OS X 10.8.4
- The user in this example is new created.
- Also with my own user i get this error for all caches since last Week
- Direct before start command i deleted the cache directory 
/Users/mkp/Library/Caches/GeoToad
- So i have looked to issue 243 but i'm not sure if this is the same problem, 
because it happens to all caches.

Original issue reported on code.google.com by kipp.mic...@googlemail.com on 27 Aug 2013 at 12:09

GoogleCodeExporter commented 9 years ago 
You have
[ ] checked the Project Home page
[ ] seen Issue 277

- in short, the HotFix of August 21 *completely* broke the released versions of 
GeoToad. You may be somewhat more successful using the latest SVN, but be 
careful: the number of site accesses has grown *a lot*. (But for me it works.)
This is only a temporary workaround, and I fear that there will be more changes 
in the near future. Unfortunately I'm bad at predicting the upcoming "hotfixes".
3.18.0 is still being worked on, but at the moment there's a large discrepancy 
between cache details pages and printable pages. Nothing I'd like to build a 
parser on.
You may have noticed that the "my" page returns "...?guid=..." links - 
something that got completely lost for all other (search result) pages. They 
may go away as well. If we're lucky, guids will be back some day.

Original comment by Steve8x8 on 27 Aug 2013 at 7:51