feat: support copy from xml.

[eliasyaoyc]

Signed-off-by: Elias.Yao siran0611@gmail.com

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

my implementation references mysql, and test complele stream load and copy stage
format1:

<row column1="value1" column2="value2" .../>

format2:

<row>
  <column1>value1</column1>
  <column2>value2</column2>
</row>

format3:

<row>
  <field name='column1'>value1</field>
  <field name='column2'>value2</field>
</row>

finally, line 119 in input_context.rs, would it be better to have then as arguments to the input_context.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Updated
databend	⬜️ Ignored (Inspect)		Nov 3, 2022 at 2:17AM (UTC)

[drmingdrmer]

If proto files change, add a line to increase the version and describe what changes are introduced:

https://github.com/datafuselabs/databend/blob/421c0fb60c26c7a3ce551bcec1a579f9c4fee753/src/meta/proto-conv/src/util.rs#L65

And add test to load this version of the message, reference:

https://github.com/datafuselabs/fuse-query/blob/ce4e7a40ae890eb4f5ea3b943c93a50811d13ea8/src/meta/proto-conv/tests/it/user_proto_conv.rs#L171

[eliasyaoyc]

<?xml version="1.0"?>

<data>
  <!-- row tag -->
  <row title="Transaction Processing" author="Jim Gray" date="1992"/>
</data>

<data>
  <row>
  <title>Readings in Database Systems</title>
  <author>Michael Stonebraker</author>
  <date>2004</date>
  </row>
</data>

<data>
  <row>
  <field name="title">aaaa</field>
  <field name="author">bbbb</field>
  <field name="date">2022</field>
  </row>
</data>

result:

[Xuanwo]

@mergify update

[mergify]

update

✅ Branch has been successfully updated

[Xuanwo]

Please add a stateful test case to make sure we can load data from XML correctly~

[youngsofun]

by the way, do you know any real life cases of loading from XML?

[Xuanwo]

by the way, do you know any real life cases of loading from XML?

We can test against https://www.treasurydirect.gov/xml/

Docs here: https://community.snowflake.com/s/article/How-to-Easily-Load-XML-with-SQL-Pt-1#:~:text=LOADING%20XML%20DATA%20INTO%20SNOWFLAKE&text=Create%20a%20new%20table%20with,column%20of%20the%20new%20table.

[youngsofun]

ontime.xml can be removed now.
and need resolve the conflicts.

[youngsofun]

others LGTM

[sundy-li]

LGTM, thank you for your persistence and contribution.

[Xuanwo]

cc @soyeric128, we supports copy from xml format now!

[soyeric128]

cc @soyeric128, we supports copy from xml format now!

OK. Nice to see COPY INTO grows stronger, BTW.

[soyeric128]

Some quick questions about the file formats:

• Does the streaming load API also support for xml ?
• Does COPY INTO support for TSV files?

[Xuanwo]

• Does the streaming load API also support for XML ?

Y.

• Does COPY INTO support for TSV files?

Y.

[soyeric128]

Does a single data file have a size limit when working with the streaming load API or COPY INTO command?

[Xuanwo]

Does a single data file have a size limit when working with the streaming load API or COPY INTO command?

No such limit so far.

---

It's better to start a new discussion at https://github.com/datafuselabs/databend/discussions so that we are not disturbing subscribers of this PR 💌