Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Misc issue fixes #581

Merged
merged 1 commit into from
Aug 16, 2022
Merged

Misc issue fixes #581

merged 1 commit into from
Aug 16, 2022

Conversation

jaymo001
Copy link
Collaborator

Description

This PR fixes multiple minor issues related to Feathr backward compatibility.

  1. Support Tensor in Header by replacing FeatureTypes with FeatureTypeConfig.
  2. Fix a bug related to derived feature function adaptor in config loader, where the adapted derived feature function is not being used.
  3. Fix a bug related to keyExtractor where keyExpression is null.
  4. Add test cases

Does this PR introduce any user-facing changes?

No.

@jaymo001 jaymo001 merged commit d1f07ac into main Aug 16, 2022
@@ -38,7 +38,7 @@ private[offline] class SimpleConfigurableAnchorExtractor( @JsonProperty("key") k

@transient private lazy val parserContext = MvelContext.newParserContext

private val keyExpression = key.map(k => MVEL.compileExpression(k, parserContext))
private val keyExpression = if (key == null) Seq() else key.map(k => MVEL.compileExpression(k, parserContext))
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is the meaning of the Seq() case here? Can you explain it in a quick comment in the code

Comment on lines +4 to +9
/**
* The metadata for FeaturizedDataset
* @param meta extra metadata
* @param header feature type header info
*/
case class FeaturizedDatasetMetadata(meta: Map[String, String] = Map(), header: Option[Header] = None ) {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be more docs about what this means; what a featurized-dataset is? (Do we have docs about it in this public version of feathr? Should we just call it as feathr's output dataset that includes info about the tensor types of joined features...?)

Also, what does "extra metadata" mean; what kinds of things is the map allowed/expected to contain, what are the keys, values, etc.

@xiaoyongzhu xiaoyongzhu deleted the misc_fix branch August 22, 2022 06:19
ahlag pushed a commit to ahlag/feathr that referenced this pull request Aug 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants