feat: add support for pyarrow.ExtensionType

[fecet]

Description

The description of the main changes of your pull request

Related Issue(s)

Documentation

The current code lacks support for pyarrow's ExtensionType when writing to Delta Lake, which is used by many libraries in the pyarrow ecosystem. This PR aims to improve the Delta Lake Python bindings to enhance support for these third-party ecosystems.

For example, the following code tests that data can be correctly written after adding this PR per Eventual-Inc/Daft#2827 (comment):

import daft

df_dogs = daft.from_pydict(
    {
        "urls": [
            "https://live.staticflickr.com/65535/53671838774_03ba68d203_o.jpg",
            "https://live.staticflickr.com/65535/53671700073_2c9441422e_o.jpg",
            "https://live.staticflickr.com/65535/53670606332_1ea5f2ce68_o.jpg",
            "https://live.staticflickr.com/65535/53671838039_b97411a441_o.jpg",
            "https://live.staticflickr.com/65535/53671698613_0230f8af3c_o.jpg",
        ],
        "full_name": [
            "Ernesto Evergreen",
            "James Jale",
            "Wolfgang Winter",
            "Shandra Shamas",
            "Zaya Zaphora",
        ],
        "dog_name": ["Ernie", "Jackie", "Wolfie", "Shaggie", "Zadie"],
    }
)
df_dogs = df_dogs.with_column(
    "image_bytes", df_dogs["urls"].url.download(on_error="null")
).with_column("image", daft.col("image_bytes").image.decode())
df_dogs.write_deltalake("path/to/file")

[ion-elgreco]

@fecet can you add some tests please?

[fecet]

Thanks for your quick replay, I have add a test at test_schema

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 72.63%. Comparing base (73107a7) to head (125f9bf).
Report is 4 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #2885   +/-   ##
=======================================
  Coverage   72.63%   72.63%           
=======================================
  Files         131      131           
  Lines       40016    40016           
  Branches    40016    40016           
=======================================
+ Hits        29064    29067    +3     
  Misses       9089     9089           
+ Partials     1863     1860    -3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[ion-elgreco]

Thanks!