Error fetching 'feeds/us-ri.json'

[transitous-bot]

CC: @sjwhitak

An error occured while fetching a feed from feeds/us-ri.json. If the error is not temporary, please consider replacing or removing the feed. Thanks!

Here are the logs of the error(s): On 2024-06-16 01:30:41 UTC:

Postprocessing us-ri-RIPTA with gtfstidy…
Parsing GTFS feed in '/woodpecker/src/github.com/public-transport/transitous/out/.tmp-us-ri_RIPTA.gtfs.zip' ...
Error while parsing GTFS feed:
could not open required file agency.txt

You may want to try running gtfsclean with --fix for error fixing / skipping. See --help for details.
Error: Could not postprocess us-ri-RIPTA: Command '['gtfsclean', '/woodpecker/src/github.com/public-transport/transitous/out/.tmp-us-ri_RIPTA.gtfs.zip', '--check-null-coords', '--output', '/woodpecker/src/github.com/public-transport/transitous/out/.tmp-us-ri_RIPTA.gtfs.zip']' returned non-zero exit status 1.
Fetching us-ri-RIPTA…
Error: 1 errors occurred during fetching.

[mlundblad]

@sjwhitak maybe adding "fix": true to this feed would help here?

[sjwhitak]

The static map just got updated yesterday: https://www.transit.land/feeds/f-drm-rhodeislandpublictransitauthority which may have caused some issues with Transitland updating the static vs real-time connection.

I'd like to be able to verify that it's temporary, but currently I'm failing to get nigiri to import under motis, so I'm not able to verify if this is temporary or not yet.

2024-06-16T23:52:35Z [VERIFY FAIL] some imports were not successful: ["nigiri"]

initialization error: some imports were not successful: ["nigiri"]

I'll have to figure this out.

[jbruechert]

Hey, can you attach the full log from MOTIS? I suspect the error is printed somewhere else. Ideally including the one in data/log/nigiri.txt.

@sjwhitak maybe adding "fix": true to this feed would help here?

Unfortunately probably not, could not open required file agency.txt sounds like the zip file either has the wrong structure or may not be a zip file at all.

EDIT:

This is definitely not correct. It should be possible to add a small python script like fix-csv-quotes.py to fix this, there are other cases of this issue as well.

[sjwhitak]

Here is the nigiri.txt log:

2024-06-17T00:15:34Z | [info][loader.hrd                    ] input=us-ri_RIPTA.gtfs.zip, missing file for config hrd_5_00_8: rohdaten/stamm/attributd_int_int.101
2024-06-17T00:15:34Z | [info][loader.hrd                    ] input=us-ri_RIPTA.gtfs.zip, missing file for config hrd_5_00_8: rohdaten/stamm/attributd_int.101
2024-06-17T00:15:34Z | [info][loader.hrd                    ] input=us-ri_RIPTA.gtfs.zip, missing file for config hrd_5_20_26: rohdaten/stamm/attributd.txt
2024-06-17T00:15:34Z | [info][loader.hrd                    ] input=us-ri_RIPTA.gtfs.zip, missing file for config hrd_5_20_39: ATTRIBUT_DE
2024-06-17T00:15:34Z | [info][loader.hrd                    ] input=us-ri_RIPTA.gtfs.zip, missing file for config hrd_5_20_avv: attribut_de

EDIT: I didn't finish my message before accidentally clicking send.

Here is my config.ini:

modules=tiles
modules=nigiri

intermodal.router=nigiri
server.static_path=motis/web

[import]
paths=schedule-us-ri-RIPTA:us-ri_RIPTA.gtfs.zip
paths=osm:rhode-island-latest.osm.pbf
paths=coastline:rhode-island-latest-free.shp.zip

[tiles]
profile=motis/tiles-profiles/background.lua

[nigiri]
gtfsrt=us-ri-RIPTA|http://realtime.ripta.com:81/api/tripupdates?format=gtfs.proto

With us-ri_RIPTA.gtfs.zip as the new GTFS folder.

[jbruechert]

from the log, MOTIS can't parse it as GTFS and tries to parse it as Hafas raw data. Should be caused by the structure issue I described above.

(The txt files should not be in a subfolder)

[sjwhitak]

Alright, I've emailed RIPTA asking to fix this. They responded within a few hours during business hours when asking if I could import their data into OSM, so it might be fixed fairly soon.

[sjwhitak]

@jbruechert: The GTFS has been updated, though I am seeing unknown stops all throughout. Would you happen to know how to handle that?

Log:

[info][2024-06-24T21:43:39Z+0000][nigiri.cc:313] Starting GTFS-RT update: fetch URLs
[debg][2024-06-24T21:43:39Z+0000][logging.h:68] http request GET http://realtime.ripta.com:81/api/tripupdates?format=gtfs.proto
2024-06-24T21:43:39Z | [error][gtfsrt.stop_assignment        ] stop assignment: src=0, stop_id="130" not found
2024-06-24T21:43:39Z | [error][gtfsrt.stop_assignment        ] stop assignment: src=0, stop_id="56990" not found
2024-06-24T21:43:39Z | [error][gtfsrt.stop_assignment        ] stop assignment: src=0, stop_id="56995" not found
2024-06-24T21:43:39Z | [error][gtfsrt.stop_assignment        ] stop assignment: src=0, stop_id="57000" not found
2024-06-24T21:43:39Z | [error][gtfsrt.stop_assignment        ] stop assignment: src=0, stop_id="57005" not found
2024-06-24T21:43:39Z | [error][gtfsrt.stop_assignment        ] stop assignment: src=0, stop_id="57010" not found
2024-06-24T21:43:39Z | [error][gtfsrt.stop_assignment        ] stop assignment: src=0, stop_id="57025" not found
2024-06-24T21:43:39Z | [error][gtfsrt.stop_assignment        ] stop assignment: src=0, stop_id="29145" not found
2024-06-24T21:43:39Z | [error][gtfsrt.stop_assignment        ] stop assignment: src=0, stop_id="57030" not found
2024-06-24T21:43:39Z | [error][gtfsrt.stop_assignment        ] stop assignment: src=0, stop_id="57035" not found
[...]
[info][2024-06-24T21:43:39Z+0000][nigiri.cc:351] us-ri-RIPTA: total_entities=175, total_entities_success=175 (100%)

Here is my config:

modules=tiles
modules=nigiri

intermodal.router=nigiri
server.static_path=motis/web

[import]
paths=schedule-us-ri-RIPTA:RIPTA-GTFS.zip
paths=osm:rhode-island-latest.osm.pbf
paths=coastline:rhode-island-latest-free.shp.zip

[tiles]
profile=motis/tiles-profiles/background.lua

[nigiri]
gtfsrt=us-ri-RIPTA|http://realtime.ripta.com:81/api/tripupdates?format=gtfs.proto

with RIPTA-GTFS.zip, and vector tiles here.

EDIT: Seems to run fine, just getting stop errors, even though I see all the stops when running motis. I'm unsure what's going on there.

[jbruechert]

That should be fine, maybe the gtfs-rt is not entirely correct and references stops that don't exist. Shouldn't be much of a problem though :)