Skip to content

Discover Heidenheim's pedestrian zone traffic data repository.

Notifications You must be signed in to change notification settings

DumbergerL/hdh-smartcity-fuzo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HDH FuZo Data

This repository hosts traffic data from the pedestrian zone in Heidenheim, sourced from the smart city API. For further information, refer to the unofficial documentation. The repository aims not only to retrieve and archive this data but also to refine and convert it into a more practical format.

The dataset begins from November 10th, 2022.

Extract Data:

The collected data comes from these six traffic sensors provided by the smart city:

Name labelIdentifier
Arkaden 3bc2a1ae-8a6f-4cc6-aab0-0e7ac50f3077
FuZo_Eugen-Jaekle-Platz 8752218d-1afc-468f-9f89-79576547798c
FuZo_Olgastr f3060e0b-ad7c-4987-afe6-471ca7178b34
Brenzstr 841db5c7-fd00-470c-8854-e65e52b3c010
Knoepfle_Nord 95a79150-a49c-4580-8397-aa380cc596e3
Knoepfle_Ost 71e09626-6b0d-42c4-91e1-1ddc59e03c0e

The unprocessed data is organized into chunks within the raw-data directory. Each file corresponds to a specific quarter for each sensor. Below is a JSON example response from the data endpoint.

{
    "data": 
        [
            {
                "id": "25c0b636-8038-409d-8d6b-b5e721670288", "singleDataPoints": [
                    {
                        "datetime": "2023-01-01T23:30:00+00:00", 
                        "value": "1", 
                        "valueKey": "bicycle.in"
                    }, 
                    {
                        "datetime": "2023-01-01T23:30:00+00:00",
                        "value": "0", 
                        "valueKey": "van.out"
                    }, 
                ],
                "name": "Verkehr Brenzstr", 
                "labelIdentifier": "841db5c7-fd00-470c-8854-e65e52b3c010", "labelName": "Verkehr Brenzstr", 
                "latitude": 48.67826862158109, 
                "longitude": 10.151976682033705, 
                "groupIdentifier": "d18db740-d364-43ff-86c7-9655d009a529",
            }
        ]
}

Below is an illustrative request to retrieve data for the Eugen-Jaekle-Platz Sensor during Q4 of 2023:

Transform Data:

The raw collected data has been converted into a more practical format. In its original state, sensor values are spread across different objects instead of being consolidated within one object for each timestamp. This issue is resolved through the transformation process executed by the Jupyter notebook data/ProcessRawData.ipynb. Additionally, the notebook includes comments to aid in understanding the transformation procedure.

As a result of this transformation process, each sensor has a single JSON file encompassing all data for the entire time period (data-Folder):

Each sensor value is now grouped by the corresponding timestamp. Here an example of the JSON format:

{
  "id": "0438a9cc-95cb-4111-bd3c-34dec97c720a",
  "name": "Zugang Arkaden Olgastr",
  "latitude": 48.67927135526141,
  "longitude": 10.152471894699366,
  "labelIdentifier": "3bc2a1ae-8a6f-4cc6-aab0-0e7ac50f3077",
  "groupIdentifier": "d18db740-d364-43ff-86c7-9655d009a529",
  "singleDataPoints": {
    "2022-12-31 23:30:00": {
      "datetime": "2022-12-31 23:30:00",
      "timestamp": 1672525800.0,
      "bicycle.in": "0",
      "bicycle.out": "0",
      "person.in": "2",
      "person.out": "3"
    },
    "2022-12-31 23:00:00": {
      "datetime": "2022-12-31 23:00:00",
      "timestamp": 1672524000.0,
      "bicycle.in": "0",
      "bicycle.out": "0",
      "person.in": "1",
      "person.out": "3"
    }
  }
}

Important

Some of the sensor data show large time gaps. For example, the "Schloss Arkaden" sensor provides no data from 01.02.23 12:00 to 06.02.23 07:00. More information on the missing sensor values here.

Case Studies

The case-studies folder contains sample scenarios for the data provided. Example case studies:

About

Discover Heidenheim's pedestrian zone traffic data repository.

Topics

Resources

Stars

Watchers

Forks

Languages