Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[cli] feat: export GTFS data to database & for ingesting into directions/routing API #8

Draft
wants to merge 13 commits into
base: develop
Choose a base branch
from

Conversation

danshilm
Copy link
Owner

@danshilm danshilm commented Oct 26, 2022

Initially, I wanted to export the data from OSM to GTFS files and then use that to feed into the routing API. But that would require also augmenting the OSM data before I can use it in the mobile app. That also leads us to have the issue where we are essentially at the mercy of the data on OSM. Bad idea ❌

Now, the way I decided to do it is to export the data from OSM into the database in a structure that's as close to the GTFS format as possible (having it be exact would be great). Use that data to generate the GTFS files, and use those GTFS files to generate the geojson (with gtfs-to-geojson) for use in the mobile app and to feed into the routing API. The data in the database can be easily verified and will serve as the source of truth. This also allows for users to easily edit the data if necessary. And those changes can then be selectively propagated to OSM once verified (we don't want erroneous data to end up on OSM neither).

I don't like Firestore for this. It was a bad decision. Sure, out-of-the box offline support is hella nice, but moulding structured data into a NoSQL database is just asking for troubles. Sigh.. 😮‍💨 I will migrate the data to a proper SQL database (long live Supabase 🎉), but for now, the most important feature of the mobile app needs to be functional first.

GTFS files to add (reference):

@vercel
Copy link

vercel bot commented Apr 15, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
mobouzer ✅ Ready (Inspect) Visit Preview 💬 Add feedback Apr 22, 2024 7:02pm

@danshilm danshilm changed the title [cli] feat: export GTFS for ingesting into directions/routing API [cli] feat: export GTFS data to database & for ingesting into directions/routing API Apr 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant