* feat: Add website layout

Signed-off-by: Xuanwo <github@xuanwo.io>

* publish to rust.i.a.o

Signed-off-by: Xuanwo <github@xuanwo.io>

* Fix license

Signed-off-by: Xuanwo <github@xuanwo.io>

* Let's try mdbook action

Signed-off-by: Xuanwo <github@xuanwo.io>

* use cargo install

Signed-off-by: Xuanwo <github@xuanwo.io>

* disable section

Signed-off-by: Xuanwo <github@xuanwo.io>

* Add docs for website

Signed-off-by: Xuanwo <github@xuanwo.io>

* Fix license

Signed-off-by: Xuanwo <github@xuanwo.io>

* action approved

Signed-off-by: Xuanwo <github@xuanwo.io>

---------

Signed-off-by: Xuanwo <github@xuanwo.io>

* feat: Expressions

* Fix comments

* Refactor expression to be more similar to iceberg model

* Fix typo

Signed-off-by: Xuanwo <github@xuanwo.io>

* feat: Add roadmap and features status in README.md

* Fix

* Fix

* Add more details according to comments

* Revert unnecessary new line break

* Nits

---------

Co-authored-by: Fokko Driesprong <fokko@apache.org>

Bumps [peaceiris/actions-gh-pages](https://github.com/peaceiris/actions-gh-pages) from 3.9.2 to 3.9.3.
- [Release notes](https://github.com/peaceiris/actions-gh-pages/releases)
- [Changelog](https://github.com/peaceiris/actions-gh-pages/blob/main/CHANGELOG.md)
- [Commits](peaceiris/actions-gh-pages@v3.9.2...v3.9.3)

---
updated-dependencies:
- dependency-name: peaceiris/actions-gh-pages
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Updates the requirements on [opendal](https://github.com/apache/incubator-opendal) to permit the latest version.
- [Release notes](https://github.com/apache/incubator-opendal/releases)
- [Changelog](https://github.com/apache/incubator-opendal/blob/main/CHANGELOG.md)
- [Commits](apache/opendal@v0.43.0...v0.43.0)

---
updated-dependencies:
- dependency-name: opendal
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Code complete

* Resolve

* Done

* Fix comments

* Fix comments

* Fix comments

* Fix

* Fix comment

* chore: Update reader api status

* Restore unnecessary change

* Add formatting for toml files

* Update call to taplo

* Add command to format and a command to check

Updates the requirements on [env_logger](https://github.com/rust-cli/env_logger) to permit the latest version.
- [Release notes](https://github.com/rust-cli/env_logger/releases)
- [Changelog](https://github.com/rust-cli/env_logger/blob/main/CHANGELOG.md)
- [Commits](rust-cli/env_logger@v0.10.0...v0.10.2)

---
updated-dependencies:
- dependency-name: env_logger
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* init file writer interface

* refine

---------

Co-authored-by: ZENOTME <st810918843@gmail.com>

* fix: Manifest parsing should consider schema evolution.

* Fix ut

* Add

* Fix format

* Add license header

…175)

Updates the requirements on [derive_builder](https://github.com/colin-kiegel/rust-derive-builder) to permit the latest version.
- [Release notes](https://github.com/colin-kiegel/rust-derive-builder/releases)
- [Commits](colin-kiegel/rust-derive-builder@v0.12.0...v0.12.0)

---
updated-dependencies:
- dependency-name: derive_builder
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* add handwritten serialize

* revert expect

* remove expect

Co-authored-by: Fokko Driesprong <fokko@apache.org>

* feat: Bump version 0.2.0 to prepare for release.

* Update dependencies

* add unit tests

* fix type

Updates the requirements on [opendal](https://github.com/apache/opendal) to permit the latest version.
- [Release notes](https://github.com/apache/opendal/releases)
- [Changelog](https://github.com/apache/opendal/blob/main/CHANGELOG.md)
- [Commits](apache/opendal@v0.44.0...v0.44.2)

---
updated-dependencies:
- dependency-name: opendal
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Couple of small things:

- The license check failed because the `dist/*` files were there
- Add `dist/*` to gitignore since we don't want to push these files to the repo
- Make `scripts/release.sh` executable
- Align the svn structure with PyIceberg and Java

…th (#201)

* refactor: remove support of manifest list format as a list of file paths#158

* refactor: add field definition to manifest list

* refactor: delete duplicated function

* refactor: fix duplicate function name

* remove avro unwraps

* rm unwrap in schema manifest

* rm some expects

* rm types

* fix clippy

* fix string format

* refine some unwrap

* undo schema.rs

* Fix: add required rust version in cargo.toml

* added rust-version to workspace=true in package

This number indicates from which release the code was generated.
For example, currently new endpoints are added to the spec, but
they are not supported by iceberg-rust yet.

* feat: make transport configurable (#188)

* implement default for HmsThriftTransport

* Add UnboundSortOrder

* Separate build methods for bound and unbound

* Use a constant for unsorted order_id

* ci: Add workflow for publish

Signed-off-by: Xuanwo <github@xuanwo.io>

* Fix publish

Signed-off-by: Xuanwo <github@xuanwo.io>

---------

Signed-off-by: Xuanwo <github@xuanwo.io>

* docs: Add basic README for all crates

Signed-off-by: Xuanwo <github@xuanwo.io>

* Remove license

Signed-off-by: Xuanwo <github@xuanwo.io>

* Update links

Signed-off-by: Xuanwo <github@xuanwo.io>

---------

Signed-off-by: Xuanwo <github@xuanwo.io>

…ns (#204)

* doc: Add download page

* Fix links

…203)

Updates the requirements on [derive_builder](https://github.com/colin-kiegel/rust-derive-builder) to permit the latest version.
- [Release notes](https://github.com/colin-kiegel/rust-derive-builder/releases)
- [Commits](colin-kiegel/rust-derive-builder@v0.13.0...v0.13.1)

---
updated-dependencies:
- dependency-name: derive_builder
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* add file io s3 test

* add license

* fixed version & rm port scanner

* ci: Ignore RUSTSEC-2023-0071 for no actions to take

Signed-off-by: Xuanwo <github@xuanwo.io>

* Fix license header

Signed-off-by: Xuanwo <github@xuanwo.io>

---------

Signed-off-by: Xuanwo <github@xuanwo.io>

* feat: Add expression builder and display.

* Fix comments

* Fix doc test

* Fix name of op

* Fix comments

* Fix timestamp

* chord:  IssueNavigationLink for RustRover

* move to .idea

* add apache license

---------

Co-authored-by: fuqijun <qijun.fqj@alibaba-inc.com>

Issue: #150

* feat: TableScan parquet file read to RecordBatch stream

* chore: add inline hinting and fix incorrect comment

* refactor: extract record batch reader

* refactor: rename `FileRecordBatchReader` to `ArrowReader`

* refactor: rename file_record_batch_reader.rs to arrow.rs
* refactor: move `batch_size` param to `TableScanBuilder`
* refactor: rename `TableScan.execute` to `to_arrow`

* refactor: use builder pattern to create `ArrowReader`

* fmt members

* setup basic test-infra for hms-catalog

* add license

* add hms create_namespace

* add hms get_namespace

* fix: typo

* add hms namespace_exists and drop_namespace

* add hms update_namespace

* move fns into HmsCatalog

* use `expose` in docker-compose

* add hms list_tables

* fix: clippy

* fix: cargo sort

* fix: cargo workspace

* move fns into utils + add constants

* include database name in error msg

* add pilota to cargo workspace

* add minio version

* change visibility to pub(crate); return namespace from conversion fn

* add minio version in rest-catalog docker-compose

* fix: hms test docker infrastructure

* add version to minio/mc

* fix: license header

* fix: core-site

---------

Co-authored-by: mlanhenke <Marvin.Lanhenke@Berief-Food.de>

* feat: Implement binding expression

…etadata (#259)

* fixing some broken branch

* adding readonly property to Table, and setting readonly value on StaticTable

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* change serde metadata v2

* change default partition_specs and sort_orders

* change test

* use DEFAULTS

* make optional oauth param configurable

* fix review comments.

---------

Co-authored-by: hpal <hpal@apple.com>

* enable public access to ManifestEntry properties

* implementing getter methods instead of direct access

)

* feat: Implement the conversion from ArrowSchema to iceberg Schema

* For review

* Update test

* Add LargeString, LargeBinary, LargeList and FixedSizeList

* Add decimal type

* For review

* Fix clippy

…ad return a new struct, leaving the original unmoved" (#290)

* fmt members

* setup basic test-infra for hms-catalog

* add license

* add hms create_namespace

* add hms get_namespace

* fix: typo

* add hms namespace_exists and drop_namespace

* add hms update_namespace

* move fns into HmsCatalog

* use `expose` in docker-compose

* add hms list_tables

* fix: clippy

* fix: cargo sort

* fix: cargo workspace

* move fns into utils + add constants

* include database name in error msg

* add pilota to cargo workspace

* add minio version

* change visibility to pub(crate); return namespace from conversion fn

* add minio version in rest-catalog docker-compose

* fix: hms test docker infrastructure

* add version to minio/mc

* fix: license header

* fix: core-site

* split utils and errors

* add fn get_default_table_location

* add fn get_metadata_location

* add docs

* add HiveSchemaBuilder

* add schema to HiveSchemaBuilder

* add convert_to_hive_table

* cargo sort

* implement table_ops without TableMetadataBuilder

* refactor: HiveSchema fn from_iceberg

* prepare table creation without metadata

* simplify HiveSchemaBuilder

* refactor: use ok_or_else()

* simplify HiveSchemaBuilder

* fix visibility of consts

* change serde metadata v2

* change default partition_specs and sort_orders

* change test

* add create table with metadata

* use FileIO::from_path

* add test_load_table

* small fixes + docs

* rename

* extract get_metadata_location from hive_table

* add integration tests

* fix: clippy

* remove whitespace

* fix: fixture names

* remove builder-prefix `with`

* capitalize error msg

* remove trait bound `Display`

* add const `OWNER`

* fix: default warehouse location

* add test-case `list_tables`

* add all primitives to test_schema

* exclude `Timestamptz` from hive conversion

* remove Self::T from schema

* remove context

* keep file_io in HmsCatalog

* use json schema repr

---------

Co-authored-by: mlanhenke <Marvin.Lanhenke@Berief-Food.de>

* feat: implement PruneColumn for Schema

* fix: fix bugs for PruneColumn implementation

* test: add test cases for PruneColumn

* fix: fix minor to make more rusty

* fix: fix cargo clippy

* fix: construct expected_type from SchemaBuilder

* fix: more readability

* change return type of prune_column

* extend dependency DIRS

* create dependencies for glue

* basic setup

* rename test

* add utils/get_sdk_config

* add tests

* add list_namespace

* fix: clippy

* fix: unused

* fix: workspace

* fix: name

* use creds in test-setup

* fix: empty dependencies.rust.tsv

* fix: rename endpoint_url

* remove deps.tsv

* add hms deps.tsv

* fix deps.tsv

* fix: deps.tsv

* feat: rest client respect prefix prop

Signed-off-by: TennyZhuang <zty0826@gmail.com>

* add test

Signed-off-by: TennyZhuang <zty0826@gmail.com>

* fix tests without prefix

Signed-off-by: TennyZhuang <zty0826@gmail.com>

* fix clippy

Signed-off-by: TennyZhuang <zty0826@gmail.com>

---------

Signed-off-by: TennyZhuang <zty0826@gmail.com>

* renaming FileScanTask.data_file to data_manifest_entry

* renaming data_file.content() to content_type()

* changing pub method to data()

* add from_build_error

* impl create_namespace

* impl get_namespace

* add macro with_catalog_id

* impl namespace_exists

* impl update_namespace

* impl list_tables

* impl drop_namespace

* fix: clippy

* update docs

* update docs

* fix: naming and visibility of error conversions

* add transform_literal

* refine

* fix unwrap

---------

Co-authored-by: ZENOTME <st810918843@gmail.com>

* feat: Complete predicate builders for all operators.

* ci: fix fmt error

* fix nan and notnan

Note that: the default headers will not be overwritten.

* feat: Read Parquet data file with projection

* fix

* Update

* More

* For review

* Use FeatureUnsupported error.

* basic fix

* change to Result<i32>

* use try_unary

Signed-off-by: TennyZhuang <zty0826@gmail.com>