Make InMemory
object store track last modified time for each entry
#3782
Labels
enhancement
Any new improvement worthy of a entry in the changelog
good first issue
Good for newcomers
help wanted
object-store
Object Store Interface
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
The
InMemory
object stores currently spoofs thelast_modified
field of the fetchedObjectMeta
s. In some cases, it is important for this value to be correct.One such case is deducing the
DeltaTable
version based on a user-provided timestamp in time travel querying—if thelast_modified
field is wrong the wrong version of the table will be loaded. Admittedly, no one should be using an in-memory store for actual work, but it would still be very handy to have this working for testing.Describe the solution you'd like
Keep a separate map of
last_modified
timestamps, and update it on each write call (put
,copy
, etc.).Describe alternatives you've considered
Don't use
InMem
store wheneverlast_modified
field is crucial for the logic.Additional context
This could be a good first issue.
The text was updated successfully, but these errors were encountered: