Handles partials in source code hash

[skrawcz]

This is a stop gap measure to handle
partials for the CacheAdapter.

Changes

• adds check for partial functions; they have .func attribute on a callable.

How I tested this

This code now works:

from hamilton.function_modifiers import source, inject
from hamilton.ad_hoc_utils import create_temporary_module
import time

@inject(foo=source("foo"))
def worker(seconds: int, foo: int) -> int:
    print(f"start work {seconds}s")
    start = time.time()
    time.sleep(1)
    # yield {
    #     "job_name": f"sleep_{seconds}",
    #     "cmd": [f"sleep {str(seconds)}"],
    #     "block": True,
    # }
    print(f"foo: {foo}")
    end = time.time()
    print(f"end stop {end - start:.2f}s work")
    return seconds


if __name__ == "__main__":
    from hamilton import driver
    from hamilton.execution import executors
    from hamilton.lifecycle.default import CacheAdapter
    logic = create_temporary_module(
        worker,
    )

    dr = (
        driver.Builder()
        .with_modules(logic)
        .enable_dynamic_execution(allow_experimental_mode=True)
        .with_local_executor(executors.SynchronousLocalTaskExecutor())
        .with_remote_executor(
            executors.MultiThreadingExecutor(max_tasks=4)
        )
        # !!! error when uncomment this line !!!
        # TypeError: module, class, method, function, traceback, frame, or code object was expected, got partial
        .with_adapters(CacheAdapter(cache_path="cache"))
        .with_config({"foo": 42})
        .build()
    )
    start = time.time()
    dr.execute(["worker"], inputs={"seconds": 3})
    print(f"Time taken: {time.time() - start: .2f} seconds")

Notes

Checklist

• PR has an informative and human-readable title (this will be pulled into the release notes)
• Changes are limited to a single goal (no scope creep)
• Code passed the pre-commit check & code is left cleaner/nicer than when first encountered.
• Any change in functionality is tested
• New functions are documented (with a description, list of inputs, and expected output)
• Placeholder code is flagged / future TODOs are captured in comments
• Project documentation has been updated if adding/changing functionality.

[Roy-Kid]

It looks nice. We can merge it.

[Roy-Kid]

clever 😂

[elijahbenizzy]

Nits, looks good

[elijahbenizzy]

cool -- can make it into a function for clarity: get_original_function(func: Callable) + test, but this is good

[elijahbenizzy]

Yeah if the func-derivation is a function then this one is less necessary (although still nice to have), and we can test that/get more confidence.