Releases: warpstreamlabs/bento
Releases · warpstreamlabs/bento
v1.4.0
Added
- Rate limiting functionality to rate-limit based on bytes @gregfurman
error_handling.strategy
config field to override Bento's default error handling @gregfurman- Experimental
aws_s3
processor @jem-davies - Experimental
log_all_errors
field tologger
config that promotes any log containing an error type to the ERROR level @gregfurman batch_policy.jitter
field to add a random delay to batch flush intervals @gregfurmanstrategy
field todedupe
processor @gregfurman- Experimental
cypher
output component @jem-davies
Changed
- updated opensearch-go to v4 @arnitolog
- updated the go.mod file to specify Go version 1.22
Fixed
- Doc site search indexing @gregfurman
- Removed unused benthos studio package @gregfurman
- Error handling issue with
opensearch
output @arnitolog - incorrect reference to
restart_on_close
insubprocess
processor docs @dacalabrese - "zombie" http output websocket connections @buger
- correctly set Bento binary information at build-time in CI @jem-davies
New Contributors
- @buger made their first contribution in #125
- @dacalabrese made their first contribution in #164
- @arnitolog made their first contribution in #163
Full Changelog: v1.3.0...v1.4.0
v1.3.0
1.3.0 - 2024-11-04
Added
- Exposed option to enable event flushing for processor events & input events @sananguliyev
- Added
QuestDB
output component @sklarsa - Added
spanner
driver to SQL components @rvilim - Added more config fields to
kafka_franz
input component @gregfurman - Added
gcp_bigquery_write_api
output component @gregfurman - Added AWS config fields to SQL Components to enable storing user/password in AWS Secret Manager @jem-davies
- Added more types to
parquet_encode
processor @ryanworl - Altered default value for field
cas_enabled
to true incouchbase
processor @sapk
Changed
- Improved parquet handling of optional decimals and float <> float conversions @richardartoul
- Altered
gcp_bigquery
config fieldtable
to allow interpolation @jem-davies
Full Changelog: v1.2.0...v1.3.0
v1.2.0
1.2.0 - 2024-08-21
Added
- Support for nested Avro schema with the
avro_schema_nested
field to theregistry_schema_decode
andregistry_schema_decode
processors. @jem-davies - New
etcd
input component for watching an etcd key or prefix. @gregfurman - Compare And Swap (CAS) support to Couchbase with
cas_enabled
flag. @sapk init_verify_conn
field to SQL components, allowing Bento to ping a target database on initialisation. @gregfurman
Upstream Changes
v1.1.0
For installation instructions check out the getting started guide.
Added
- Bento mascot as a
favicon.ico
to docusaurus site and back into theREADME
. - New cookbook for Kafka topic mirroring.
- New local testing guide for
bento-lambda
.
Changed
- Removed more references to upstream in documentation.
Upstream Changes Synced
The full change log can be found here.
v1.0.2
What's Changed
- Chore: Fix reference to example project and update Slack card by @gregfurman in #22
- Update README.md by @smga3000 in #24
- Update doc and changelog by @epot in #25
- Uncomment by @epot in #26
- Update SECURITY.md by @cfgrillo in #29
- fix ./resources/docker/streams_mode by @jem-davies in #31
- change v4 to v1 by @aratz-lasa in #27
New Contributors
- @gregfurman made their first contribution in #22
- @smga3000 made their first contribution in #24
- @cfgrillo made their first contribution in #29
- @jem-davies made their first contribution in #31
- @aratz-lasa made their first contribution in #27
Full Changelog: v1.0.1...v1.0.2
v1.0.1
For installation instructions check out the getting started guide.
Changed
Using github's container registry instead of AWS ECR.
The full change log can be found here.
v1.0.0
v0.0.3-rc1
For installation instructions check out the getting started guide.
Added
- New
nats_kv
cache type. - The
nats_jetstream
input now supportslast_per_subject
andnew
deliver fallbacks. - Field
error_patterns
added to thedrop_on
output. - New
redis_scan
input type. - Field
auto_replay_nacks
added to all inputs that traditionally automatically retry nacked messages as a toggle for this behaviour. - New
retry
processor. - New
noop
cache. - Field
targets_input
added to theazure_blob_storage
input. - New
reject_errored
output. - New
nats_request_reply
processor. - New
json_documents
scanner.
Fixed
- The
unarchive
processor no longer yields linting errors when the formatcsv:x
is specified. This is a regression introduced in v4.25.0. - The
sftp
input will no longer consume files when the watcher cache returns an error. Instead, it will reattempt the file upon the next poll. - The
aws_sqs
input no longer logs error level logs for visibility timeout refreshing errors. - The
nats_kv
processor now allows nats wildcards for thekeys
operation. - The
nats_kv
processorkeys
operation now returns a single message with an array of found keys instead of a batch of messages. - The
nats_kv
processorhistory
operation now returns a single message with an array of objects containing the record fields instead of a batch of messages. - Field
timeout
added to thenats_kv
processor to specify the maximum period to wait on an operation before aborting and returning an error. - Bloblang comparison operators (
>
,<
,<=
,>=
) now match the precision of the compared integers when applicable. - The
parse_form_url_encoded
Bloblang method no longer produces results with an unknown data type for repeated query parameters. - The
echo
CLI command no longer fails to sanitise configs when encountering an emptypassword
field.
Changed
- The log events from all inputs and outputs when they first connect have been made more consistent and no longer contain any information regarding the nature of their connections.
- Splitting message batches with a
split
processor (or custom plugins) no longer results in downstream error handling loops around nacks. This was previously implemented as a feature to ensure unbounded expanded and split batches don't flood downstream services in the event of a minority of errors. However, introducing more clever origin tracking of errored messages has eliminated the need for this undocumented behaviour.
The full change log can be found here.