defgsus / parking-scraper

collection of scrapers to get parking space occupancy data across germany
4 stars 1 forks source link

Parking times April 2023 #1

Open Anujahari opened 1 year ago

Anujahari commented 1 year ago

Hi

your api looks great - I am looking for parking usage data of a few specific locations in April. I am no Python User, so I find your csvs really useful. Do you plan to update csvs of April regularly as well?

Regards Anuja

defgsus commented 1 year ago

Hi Anuja, thanks for the hint. The scraper was actually running but pushing the data did not work. It's now updated: https://github.com/defgsus/parking-data/tree/master/csv/2023/2023-04

You can also get archived data from parkenDD (https://parkendd.de/dumps/), but the archive is packaged only at the start of the next year. Here is a blog post about it.

Anujahari commented 1 year ago

Great thanks a lot! Really helps

as a special request- can you pls let me know if you can integrate some special locations ?

defgsus commented 1 year ago

It's possible to add locations if there is a website or other internet service listing the live data. The most locations are maintained in ParkAPI2. You can see an overview of the sources here or browse the original and new directories in ParkAPI2-sources.

There is actually a public API for all scraped sources and live and historic data but i forgot it's address..

Actually, here it is: https://api2.parkendd.de/

The json data of all the lots, including geo coords is here: https://api2.parkendd.de/api/v2/lots/

To find lots near a specific location you can use: https://api2.parkendd.de/api/v2/lots/?location=9.9510,53.5395&radius=200 That searches for lots around Hamburg (longitude 9.9510, latitude 53.5395) in a 200km radius

Anujahari commented 1 year ago

Ok I see

Unfortunately I don’t think we plan to publish the service live.

We are just interested in having occupancy rates in a few specific locations. And comparing it with our measured values through another app.

Regards Anuja On Thu 22. Jun 2023 at 16:32, stefan berke @.***> wrote:

It's possible to add locations if there is a website or other internet service listing the live data. The most locations are maintained in ParkAPI2 https://github.com/ParkenDD/ParkAPI2. You can see an overview of the sources here https://github.com/ParkenDD/ParkAPI2/wiki/v1-api-comparison or browse the original https://github.com/ParkenDD/ParkAPI2-sources/tree/master/original and new https://github.com/ParkenDD/ParkAPI2-sources/tree/master/new directories in ParkAPI2-sources https://github.com/ParkenDD/ParkAPI2-sources.

There is actually a public API for all scraped sources and live and historic data but i forgot it's address..

— Reply to this email directly, view it on GitHub https://github.com/defgsus/parking-scraper/issues/1#issuecomment-1602747139, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAYCWVZQP4WWYJS4UCTGU5LXMRJOBANCNFSM6AAAAAAZPVWT5M . You are receiving this because you authored the thread.Message ID: @.***>

Anujahari commented 1 year ago

Concretely, we are looking for parking statistics for the following locations, in the month of May and June

Feneberg Kempten (Im Allmey) Feneberg Leutkirch Feneberg Murnau Feneberg Sonthofen (Rudolf-Diesel-Straße) Feneberg Kempten (Ursularieder Str.)

It would be a great help if you could update these locations - even if a 15 min time stamp accuracy is not possible, a daily estimate would be sufficient.

Also I noticed in some of the csvs that all 15 min durations are not logged

Kind Regards, and really appreciate your help in advance. We would be happy to mention your project as the reference data

Kind Regards Anuja

On Thu 22. Jun 2023 at 17:37, anu hari @.***> wrote:

Ok I see

Unfortunately I don’t think we plan to publish the service live.

We are just interested in having occupancy rates in a few specific locations. And comparing it with our measured values through another app.

Regards Anuja

On Thu 22. Jun 2023 at 16:32, stefan berke @.***> wrote:

It's possible to add locations if there is a website or other internet service listing the live data. The most locations are maintained in ParkAPI2 https://github.com/ParkenDD/ParkAPI2. You can see an overview of the sources here https://github.com/ParkenDD/ParkAPI2/wiki/v1-api-comparison or browse the original https://github.com/ParkenDD/ParkAPI2-sources/tree/master/original and new https://github.com/ParkenDD/ParkAPI2-sources/tree/master/new directories in ParkAPI2-sources https://github.com/ParkenDD/ParkAPI2-sources.

There is actually a public API for all scraped sources and live and historic data but i forgot it's address..

— Reply to this email directly, view it on GitHub https://github.com/defgsus/parking-scraper/issues/1#issuecomment-1602747139, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAYCWVZQP4WWYJS4UCTGU5LXMRJOBANCNFSM6AAAAAAZPVWT5M . You are receiving this because you authored the thread.Message ID: @.***>

Anujahari commented 1 year ago

hi.. any updates on this? will it be possible to add the locations in a couple of days? what kind of costs would be involved?

defgsus commented 1 year ago

Hi @Anujahari , i checked the "Parken in Kempten" site (https://www.kempten.de/parken-567.html) and also Sonthofen (https://www.stadt-sonthofen.de/stadtinfos/oepnv-verkehr/parken/) but they do not seem to provide live data of the free places. So there is nothing we can do. If you know a web-site or service that lists the data, i can include it in the scraper.

Regarding your question about the CSVs: If a number does not change in between 15 minutes the next cell stays empty. I wanted to keep the CSVs small in size. However, if there was an error, the cell will also be empty but that can not be determined from the CSVs. In general, for an empty cell: assume it is the same number from the cells above.