performance optimization by ReifyStatement

[1178615156]

Problem

case class TestTable(id: Long , name: String)
val testTable = quote(query[TestTable])
val K = 1000
val ids = 1L to (100L * K)
val query = ctx.run(testTable .filter(e => liftQuery(ids).contains(e.id)))

the query will take long long time when ids size is big (E.g 100000)
😭 #811 is not solve it completely

Solution

use the O(n) algorithm to replace the old O(n*2) algorithm

Result

test code

val time = org.scalameter.config().withWarmer(Warmer.Zero).measure(
  query 
)
println(time)

database is empty
before : 71145.496378 ms
after : 776.846794 ms
😄

Checklist

• Unit test all changes
• Update README.md if applicable
• Add [WIP] to the pull request title if it's work in progress
• Squash commits that aren't meaningful changes
• Run sbt scalariformFormat test:scalariformFormat to make sure that the source files are formatted

@getquill/maintainers

[mosyp]

Looks awesome!
Is it finished? If yes then please rebase changes into single commit

[mosyp]

Could you please rename it, quill-core is not bound to sql, cql etc.

[jilen]

Maybe we could simply convert the List to Vector to solve append performance

[1178615156]

@jilen the string + string it is O(n); so just replace List[ScalarLift] to Vector[ScalarLift] that is not enough

[mosyp]

Thank you!