This repository has been archived by the owner on Mar 6, 2019. It is now read-only.
Releases: s22s/pre-lt-raster-frames
Releases · s22s/pre-lt-raster-frames
0.6.1
- Added support for reading striped GeoTiffs (#64).
- Moved extension methods associated with querying tagged columns to
DataFrameMethods
for supporting
temporal and spatial columns on non-RasterFrame DataFrames. - GeoTIFF and GeoTrellis DataSources automatically initialize RasterFrames.
- Added
RasterFrame.toMultibandRaster
. - Added utility for rendering multiband tile as RGB composite PNG.
- Added
RasterFrame.withRFColumnRenamed
to lessen boilerplate in maintainingRasterFrame
type tag.
0.6.0
- Upgraded to Spark 2.2.1. Added
VersionShims
to allow for Spark 2.1.x backwards compatibility. - Introduced separate
rasterframes-datasource
library for hosting sources from which to read RasterFrames. - Implemented basic (but sufficient) temporal and spatial filter predicate push-down feature for the GeoTrellis layer datasource.
- Added Catalyst expressions specifically for spatial relations, allowing for some polymorphism over JTS types.
- Added a GeoTrellis Catalog
DataSource
for inspecting available layers and associated metadata at a URI - Added GeoTrellis Layer DataSource for reading GeoTrellis layers from any SPI-registered GeoTrellis backend (which includes HDFS, S3, Accumulo, HBase, Cassandra, etc.).
- Ability to save a RasterFrame as a GeoTrellis layer to any SPI-registered GeoTrellis backends. Multi-column RasterFrames are written as Multiband tiles.
- Addd a GeoTiff DataSource for directly loading a (preferably Cloud Optimized) GeoTiff as a RasterFrame, each row containing tiles as they are internally organized.
- Fleshed out support for
MultibandTile
andTileFeature
support in datasource. - Added typeclass for specifying merge operations on
TileFeature
data payload. - Added
withTemporalComponent
convenince method for creating appending a temporal key column with constant value. - Breaking: Renamed
withExtent
towithBounds
, and now returns a JTSPolygon
. - Added
EnvelopeEncoder
for encoding JTSEnvelope
type. - Refactored build into separate
core
anddocs
, paving way forpyrasterframes
polyglot module. - Added utility extension method
withPrefixedColumnNames
toDataFrame
.
0.5.12
- Added
withSpatialIndex
to introduce a column assigning a z-curve index value based on the tile's centroid in EPSG:4326. - Added column-appending convenience methods:
withExtent
,withCenter
,withCenterLatLng
- Documented example of creating a GeoTrellis layer from a RasterFrame.
- Added Spark 2.2.0 forward-compatibility
- Upgraded to GeoTrellis 1.2.0-RC2
0.5.11
0.5.10
0.5.9
0.5.8
- Upgraded to GeoTrellis 1.2.0-RC1
- Added
REPLsent
-based tour of RasterFrames - Moved Giter8 template to separate repository
s22s/raster-frames.g8
due to sbt limitations - Updated Getting Started to reference new Giter8 repo
- Changed SQL function name
rf_stats
andrf_histogram
torf_aggStats
andrf_aggHistogram
for consistency with DataFrames API
0.5.7
- Created faster implementation of aggregate statistics.
- Fixed bug in deserialization of
TileUDT
s originating fromConstantTile
s - Fixed bug in serialization of
NoDataFilter
within SparkML pipeline - Refactoring of UDF organization
- Various documentation tweaks and updates
- Added Giter8 template
0.5.6
TileUDF
s are encoded using directly into Catalyst--without Kryo--resulting in an insane
decrease in serialization time for small tiles (int8
, <= 128²), and pretty awesome speedup for
all other cell types other thanfloat32
(marginal slowing). While not measured, memory
footprint is expected to have gone down.
0.5.5
aggStats
andtileMean
functions rewritten to compute simple statistics directly rather than usingStreamingHistogram
.tileHistogramDouble
andtileStatsDouble
were replaced bytileHistogram
andtileStats
.- Added
tileSum
,tileMin
andtileMax
functions. - Added
aggMean
,aggDataCells
andaggNoDataCells
aggregate functions. - Added
localAggDataCells
andlocalAggNoDataCells
cell-local (tile generating) fuctions - Added
tileToArray
andarrayToTile
- Overflow fix in
LocalStatsAggregateFunction
.