feat: inverted index

[BohuTANG]

Summary

Creating and Building Inverted Index

Syntax:

CREATE [ASYNC] INVERTED INDEX ivt_index ON <table>(<column>) ...

By default, the SYNC mode is enabled where data is automatically generated without any errors returned during writing.

Refreshing Inverted Index

Syntax

REFRESH INVERTED INDEX <index_name> [LIMIT <limit>]

For:

• SYNC mode failures sometime
• Create withASYNC mode and building

[ZuoTiJia]

I am very interested in this feature. How does Databend implement inverted index?

[BohuTANG]

@ZuoTiJia

Hi, @b41sh is working on it, this is a EE feature. We're currently planning to utilize the fst library as a core component of our solution.

By the way, if you're interested, you might want to delve into some good first issues.

[b41sh]

I am very interested in this feature. How does Databend implement inverted index?

Hi, @ZuoTiJia Thanks for your attention, I'm still investigating the implementation of full-text inverted index and will describe the detailed design in the later RFC.

[coffeecms]

@ZuoTiJia

Hi, @b41sh is working on it, this is a EE feature. We're currently planning to utilize the fst library as a core component of our solution.

By the way, if you're interested, you might want to delve into some good first issues.

I hope it will avaiable in free version because Inverted Index still free 100% in others data warehouse like: StarRocks, Doris...

[BohuTANG]

@ZuoTiJia
Hi, @b41sh is working on it, this is a EE feature. We're currently planning to utilize the fst library as a core component of our solution.
By the way, if you're interested, you might want to delve into some good first issues.

I hope it will avaiable in free version because Inverted Index still free 100% in others data warehouse like: StarRocks, Doris...

Thank you for your interest in our features.
To clarify, Databend Enterprise Features are not equivalent to "pay-to-use". Instead, they require authorization from us (DatabendLabs) to be used. This authorization can be granted to individuals, companies, or other organizations. This model is common in many open-source projects, where some of their Enterprise Features might not even be open-source. However, Databend is fully open-source.