Feat: seo improvements v2

[Alessandro100]

closes #860

Summary:

• Added a site map so search engines can find all our feed pages ex: feeds/mdb-125
• Adding canonical link references in the head so search engines knows these pages are distinct
• Preventing google from crawling DEV / QA environments
• Improving the HTML structure on Mobile (since thats how google crawls)
• Link the MobilityDatabase from Mobilitydata.org

bonus

• refactored mobile side menu for better structure

Expected behavior:

• Mobilitydatabase should not be crawlable in QA and DEV
• The navigation menu in mobile and desktop should work as always
• Improved crawlability of the mobilitydatabase website

Testing tips:

Test the navigation elements on mobile and desktop and make sure they go to the correct pages

Note
The generation of the sitemap is done with a script that will be improved in the future if returns are noticed
Documentation of the SEO journey can be found here
https://docs.google.com/document/d/1beFarbPOLr_RgWqJIlc1AtlGaoFSOXlShCUfYPPNedE/edit?usp=sharing

• Run the unit tests with ./scripts/api-tests.sh to make sure you didn't break anything
• Add or update any needed documentation to the repo
• Format the title like "feat: [new feature short description]". Title must follow the Conventional Commit Specification(https://www.conventionalcommits.org/en/v1.0.0/).
• Linked all relevant issues
• Include screenshot(s) showing how this pull request works and fixes the issue(s)

[github-actions]

Preview Firebase Hosting URL: https://mobility-feeds-dev--pr-868-k24ztw18.web.app

[davidgamez]

LGTM

[davidgamez]

Move the Set robots.txt step before Build

[Alessandro100]

nice find, it's fixed