Add a max size for normalize cache

[wb14123]

Fixes #2484

Problem

There is no bound for normalize cache which results memory usage increase without limit for dynamic queries.

Solution

Added a capacity to normalize cache. Default to 1024 and can be override by quill.query.cacheDynamicMaxSize.

Notes

Added a new dependency Google Guava to use its cache implementation. I know it's better to avoid new dependency but Google Guava is a pretty widely adopted library. It's cache implementation is widely tested. For such a critical use case in quill, I think it's better to have a widely tested implementation than reinventing the wheel.

Checklist

• Unit test all changes
• Update README.md if applicable
• Add [WIP] to the pull request title if it's work in progress
• Squash commits that aren't meaningful changes
• Run sbt scalariformFormat test:scalariformFormat to make sure that the source files are formatted

@getquill/maintainers

Note:

sbt scalariformFormat test:scalariformFormat give me error:

[error] Not a valid command: scalariformFormat                                                                                                                                       
[error] Not a valid project ID: scalariformFormat                                         
[error] Expected ':'                                                                                                                                                                 
[error] Not a valid key: scalariformFormat (similar: scalaArtifacts, scalafmt, scalafmtDoFormatOnCompile)                                                                            
[error] scalariformFormat                                                                                                                                                            
[error]     

[CLAassistant]

All committers have signed the CLA.

[wb14123]

Pushed a new commit to make the default cache size 1024. However from my profiling, each AST seems to have pretty different sizes. I'm wondering if there is a way to get memory footprint from an AST efficiently so that we can use CacheBuilder.weigher(Weigher) to make the cache size smarter

[wb14123]

The GC looks much normal after this fix as well:

[guizmaii]

Please use Caffeine (See Guava doc https://guava.dev/releases/31.0-jre/api/docs/com/google/common/cache/CacheBuilder.html#:~:text=Caffeine's%20types%20are%20better%20than,backed%20by%20a%20Guava%20CacheLoader%20.)

[wb14123]

Oh seems f.asJava doesn't compile against Scala 2.12. Will push a fix. Sorry for rushing it ...

[guizmaii]

Oh seems f.asJava doesn't compile against Scala 2.12

We're sorry for you and we're sorry to have to maintain Scala 2.12 compat 😄
Thanks for your work 🙏

[guizmaii]

Latest version of Caffeine doesn't support Java8 anymore apparently:

[error] java.lang.UnsupportedClassVersionError: com/github/benmanes/caffeine/cache/Caffeine has been compiled by a more recent version of the Java Runtime (class file version 55.0), this version of the Java Runtime only recognizes class file versions up to 52.0

The good news is that we're about to drop support of JDK8 too!

FYI: #2878

[wb14123]

@guizmaii oh I didn't realize you are working on dropping Java 8. I added a check for Java version so we can use it without breaking Java 8

[guizmaii]

oh I didn't realize you are working on dropping Java 8

The ZIO environment in its entirety decided to remove Java8 support (triggered by some needs in zio-quill)
Your work is just the motivation I needed to make this change 🙂

[guizmaii]

Thanks again for your work @wb14123! ❤️