-
Notifications
You must be signed in to change notification settings - Fork 1
Compactness
Original Pbf File = 66.12 GB
| FlatMap | Pbf (no meta, locations on ways) | |
|---|---|---|
| uncompressed | 72.125.314.843 | 84.920.749.729 |
| compressed bz2 | 55.907.932.608 | 54.290.110.221 |
planet.pbf = planet-140122.pbf so this was January 2022
66.117.018.734 planet.pbf
This is the original planet file. Its compactness origins from efficient encoding (varint, delta) and blockwise compression. To distinguish the 2 sources of compactness we unpack the blocks so that only the effect of encoding remains. Nearby we also remove metadata, which is not yet supported in FlatMap and also due to European law is often avoided anyway. This gives us
92.566.916.103 planet-nometa-raw.pbf
Next we apply the locations-on-ways design which for large files causes compaction:
84.920.749.729 planet-nometa-raw-low.pbf
We now apply full file compression on this file, to see that the blockwise file compression as practiced with pbf has the same effect as full file compression:
54.290.110.221 planet-nometa-raw.pbf.bz2
The FlatMap file is:
72.125.314.843 planet.fm
48.361.037.199 planet.fm.7z
55.907.932.608 planet.fm.bz2