Modify arg default

[PhilippeMoussalli]

No description provided.

[PhilippeMoussalli]

This is needed for arguments that are taken from the componentSpec which always have a string type

[RobbeSneyders]

It might be a bit cleaner to include this in the Argument class. I think this should work:

@dataclass
class Argument:

    default: t.Any

    def __post_init__(self):
        self.default = None if self.default == "None" else self.default

[PhilippeMoussalli]

This was previously defined in the ComponentSpec but in fact should be evaluated at runtime. Optional arguments with defaults should not be included in the arg section of the componentOp otherwise some errors occur

I1016 10:42:19.355692      27 cache.go:116] Connecting to cache endpoint 10.0.12.128:8887
[2023-10-16 10:42:21,330 | fondant.cli | INFO] Component `LoadFromHubComponent` found in module main
usage: fondant [-h] [--component_spec COMPONENT_SPEC] [--cache CACHE]
               [--input_partition_rows INPUT_PARTITION_ROWS]
               [--cluster_type CLUSTER_TYPE] [--client_kwargs CLIENT_KWARGS]
fondant: error: argument --input_partition_rows: invalid int value: "{{$.inputs.parameters['input_partition_rows']}}"

[RobbeSneyders]

Thanks @PhilippeMoussalli! The pipeline that was failing before now succeeds.

[RobbeSneyders]

It might be a bit cleaner to include this in the Argument class. I think this should work:

@dataclass
class Argument:

    default: t.Any

    def __post_init__(self):
        self.default = None if self.default == "None" else self.default

[RobbeSneyders]

t.Any already includes t.Optional.

[PhilippeMoussalli]

ahh good to know

[PhilippeMoussalli]

Thanks @PhilippeMoussalli! The pipeline that was failing before now succeeds.

Glad it works :) I hope everything is fine now with the argument but some things might still pop up