-
Notifications
You must be signed in to change notification settings - Fork 3.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add GATv3Conv implementation and tests #9937
base: master
Are you sure you want to change the base?
Conversation
for more information, see https://pre-commit.ci
this is good at a high level. however i want to see how it compares to existing work. Can you please update this example: |
also please make sure the CI (automated testing) is all green |
for more information, see https://pre-commit.ci
for more information, see https://pre-commit.ci
for more information, see https://pre-commit.ci
Description
This Pull Request introduces GATv3Conv, a context-aware extension of GATv2. It applies element-wise multiplication of source and target feature embeddings, incorporates a learnable context attention layer, and supports optional weight sharing. Inspired by the GATher framework (Narganes-Carlon et al., 2024).
Key Changes
torch_geometric/nn/conv/gatv3_conv.py
– Implements the GATv3Conv layer.test/nn/conv/test_gatv3_conv.py
– Validates functionality, including bipartite inputs, edge attributes, and return of attention weights.torch_geometric/nn/conv/__init__.py
– ExportsGATv3Conv
for usage throughout the PyG library.Reference
https://arxiv.org/abs/2409.16327
This work is authored by David Narganes-Carlon and collaborators. Let me know if further modifications or clarifications are needed.