kraina-ai / quackosm

QuackOSM: an open-source Python and CLI tool for reading OpenStreetMap PBF files using DuckDB
https://kraina-ai.github.io/quackosm/
Apache License 2.0
214 stars 12 forks source link

Can I use quackosm to accelerate the feature extract step in the "Transfer learning approach to bicycle sharing systems station location planning using OpenStreetMap" project? #160

Closed zrg1993 closed 2 months ago

zrg1993 commented 2 months ago

Thanks for your work "Transfer learning approach to bicycle sharing systems station location planning using OpenStreetMap". And I wonder that if quackosm can speed up the feature extraction in this project.

RaczeQ commented 2 months ago

Hello @zrg1993 👋🏻 You absolutely can! If you could use our other library - SRAI, then you would have a lot of tools available for you to prepare the data for the training. SRAI uses QuackOSM under the hood, so you won't have to worry about the speed.

What you would need is a ContextualCountEmbedder that was used in this publication. Here is a full usage documentation with OSM data download: https://kraina-ai.github.io/srai/0.7.5/examples/embedders/contextual_count_embedder/

Here you can see a full example of this transfer learning pipeline in some notebooks from our tutorials: https://github.com/kraina-ai/srai-tutorial/blob/ml-in-pl-2023/tutorial/MLinPL/05_bikes_transfer_learning.ipynb - this one you can use as a training notebook with answers in another directory. https://github.com/kraina-ai/srai-tutorial/blob/osm-deep-dive/tutorial/06_use_osm_data_in_ml_model.ipynb https://github.com/kraina-ai/srai-tutorial/blob/sotm2024/03_ml.ipynb