-
Notifications
You must be signed in to change notification settings - Fork 1.9k
Element‐wise interaction
Alexey Taymanov edited this page Oct 12, 2023
·
1 revision
If there are two dense vectors (namespaces) a and b of the same dimension, there is a way to learn element-wise interactions using command line --interact ab.
Required conventions:
- both namespaces are the only namespaces starting with corresponding letters (no other namespaces are added into the same feature group)
- first value of both vectors are equal to 1
- vectors are dense (integers as features names in text vw format or json array in json format) Example: '1 |a 0:1 1:0.2 2:0.3 |b 0:1 1:0.4 2:0.5'
Side effects:
- both interacted namespaces a and b got excluded from final feature representation and replaced with a[0]*b[0], a[1] *b[1],...
- interaction features are written into first(positionally) namespace hashes, so "--interact ab" and "--interact ba" are different from feature hashes point of view (but equivalent from learning perspective)
- Home
- First Steps
- Input
- Command line arguments
- Model saving and loading
- Controlling VW's output
- Audit
- Algorithm details
- Awesome Vowpal Wabbit
- Learning algorithm
- Learning to Search subsystem
- Loss functions
- What is a learner?
- Docker image
- Model merging
- Evaluation of exploration algorithms
- Reductions
- Contextual Bandit algorithms
- Contextual Bandit Exploration with SquareCB
- Contextual Bandit Zeroth Order Optimization
- Conditional Contextual Bandit
- Slates
- CATS, CATS-pdf for Continuous Actions
- Automl
- Epsilon Decay
- Warm starting contextual bandits
- Efficient Second Order Online Learning
- Latent Dirichlet Allocation
- VW Reductions Workflows
- Interaction Grounded Learning
- CB with Large Action Spaces
- CB with Graph Feedback
- FreeGrad
- Marginal
- Active Learning
- Eigen Memory Trees (EMT)
- Element-wise interaction
- Bindings
-
Examples
- Logged Contextual Bandit example
- One Against All (oaa) multi class example
- Weighted All Pairs (wap) multi class example
- Cost Sensitive One Against All (csoaa) multi class example
- Multiclass classification
- Error Correcting Tournament (ect) multi class example
- Malicious URL example
- Daemon example
- Matrix factorization example
- Rcv1 example
- Truncated gradient descent example
- Scripts
- Implement your own joint prediction model
- Predicting probabilities
- murmur2 vs murmur3
- Weight vector
- Matching Label and Prediction Types Between Reductions
- Zhen's Presentation Slides on enhancements to vw
- EZExample Archive
- Design Documents
- Contribute: