Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pinecone provider support for pinecone-client>=3 #37307

Merged
merged 61 commits into from
Apr 30, 2024
Merged
Show file tree
Hide file tree
Changes from 49 commits
Commits
Show all changes
61 commits
Select commit Hold shift + click to select a range
5b2f086
basic migration
rawwar Feb 10, 2024
d0d11fc
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Feb 10, 2024
84ad6c7
Merge branch 'main' of github.com:apache/airflow into kalyan/37158-pi…
rawwar Feb 13, 2024
f23dbc4
Merge branch 'main' of github.com:apache/airflow into kalyan/37158-pi…
rawwar Feb 13, 2024
d9ea839
Merge branch 'main' of github.com:apache/airflow into kalyan/37158-pi…
rawwar Feb 14, 2024
242ef5e
Merge branch 'main' of github.com:apache/airflow into kalyan/37158-pi…
rawwar Feb 15, 2024
b6a3d48
use self.conn
rawwar Feb 17, 2024
8ec66a7
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Feb 17, 2024
834ecad
Merge branch 'main' of github.com:apache/airflow into kalyan/37158-pi…
rawwar Feb 18, 2024
4f4cc02
Merge branch 'main' of github.com:apache/airflow into kalyan/37158-pi…
rawwar Feb 21, 2024
5379d86
Merge branch 'main' of https://github.com/apache/airflow into kalyan/…
rawwar Apr 12, 2024
9f21167
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 12, 2024
c3d61de
replace conn with pc property
rawwar Apr 13, 2024
cb83e63
Add operators for creating index
rawwar Apr 13, 2024
3767b73
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 13, 2024
df28c84
support PINECONE_DEBUG_CURL
rawwar Apr 13, 2024
d2b6c18
update tests
rawwar Apr 13, 2024
23271dc
update changelog
rawwar Apr 13, 2024
ed4781f
Update airflow/providers/pinecone/CHANGELOG.rst
rawwar Apr 13, 2024
2d355a0
Update airflow/providers/pinecone/CHANGELOG.rst
rawwar Apr 13, 2024
358f682
update Changelog
rawwar Apr 13, 2024
7bd914f
fix spelling
rawwar Apr 13, 2024
3c308a6
update Changelog
rawwar Apr 13, 2024
f2ae94c
update Changelog
rawwar Apr 13, 2024
ab501bf
fix spelling
rawwar Apr 13, 2024
8d733c1
update docs
rawwar Apr 13, 2024
7fa7b7b
add example dags for new operators
rawwar Apr 13, 2024
a212ada
update docs
rawwar Apr 13, 2024
a486b86
update docs
rawwar Apr 13, 2024
b2724d1
update docs
rawwar Apr 13, 2024
d00ebe2
update docs
rawwar Apr 14, 2024
f920fb8
update docstrings
rawwar Apr 14, 2024
dbd8e30
update docs
rawwar Apr 14, 2024
b681272
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 14, 2024
1eb76e8
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 14, 2024
aa3e5e0
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 14, 2024
8c61248
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 15, 2024
6367618
accept api_key only from connections
rawwar Apr 15, 2024
83ff6e0
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 15, 2024
8c9f421
Add missing docstrings
rawwar Apr 16, 2024
b2aca0c
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 17, 2024
11ef4b5
Update airflow/providers/pinecone/hooks/pinecone.py
rawwar Apr 18, 2024
4b7246e
Update airflow/providers/pinecone/hooks/pinecone.py
rawwar Apr 18, 2024
a1b8e58
update spec methods to be keyword only
rawwar Apr 18, 2024
4de11c2
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 18, 2024
4a3ea30
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 18, 2024
d11ec6c
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 19, 2024
3703b7f
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 21, 2024
c191536
Merge branch 'main' of https://github.com/apache/airflow into kalyan/…
rawwar Apr 24, 2024
85c62d9
Merge branch 'main' of https://github.com/apache/airflow into kalyan/…
rawwar Apr 26, 2024
0ba015b
rename pinecone connection object
rawwar Apr 26, 2024
7347fae
make conn a property
rawwar Apr 26, 2024
a4340b7
remove comments from provider.yaml
rawwar Apr 26, 2024
3d59d96
update docs
rawwar Apr 26, 2024
9c9d123
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 26, 2024
fe42c1c
update docstring of create_index to talk about spec object creation
rawwar Apr 27, 2024
65772f6
Merge branch 'main' of https://github.com/apache/airflow into kalyan/…
rawwar Apr 27, 2024
fb18c8b
fix spelling
rawwar Apr 27, 2024
a6ff7de
fix docstring
rawwar Apr 27, 2024
59269fd
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 27, 2024
2c75ec9
Merge branch 'main' into kalyan/37158-pinecone-3.x
rawwar Apr 28, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 30 additions & 0 deletions airflow/providers/pinecone/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,36 @@
Changelog
---------

2.0.0
.....

Breaking changes
~~~~~~~~~~~~~~~~

.. warning::
This release of provider has breaking changes from previous versions. Changes are based on
the migration guide from pinecone - <https://canyon-quilt-082.notion.site/Pinecone-Python-SDK-v3-0-0-Migration-Guide-056d3897d7634bf7be399676a4757c7b>
Taragolis marked this conversation as resolved.
Show resolved Hide resolved

* ``log_level`` field is removed from the Connections as it is not used by the provider anymore.
* ``PineconeHook.get_conn`` now returns ``Connection`` object instead of ``PineconeConnection`` object. Use ``pc`` property to access the Pinecone client.
* Following ``PineconeHook`` methods are converted from static methods to instance methods. Hence, Initialization is required to use these now:
rawwar marked this conversation as resolved.
Show resolved Hide resolved

+ ``PineconeHook.list_indexes``
+ ``PineconeHook.upsert``
+ ``PineconeHook.create_index``
+ ``PineconeHook.describe_index``
+ ``PineconeHook.delete_index``
+ ``PineconeHook.configure_index``
+ ``PineconeHook.create_collection``
+ ``PineconeHook.delete_collection``
+ ``PineconeHook.describe_collection``
+ ``PineconeHook.list_collections``
+ ``PineconeHook.query_vector``
+ ``PineconeHook.describe_index_stats``

* ``PineconeHook.create_index`` is updated to accept a ``ServerlessSpec`` or ``PodSpec`` instead of directly accepting index related configurations
* To initialize ``PineconeHook`` object, API key needs to be passed via argument or the connection.

1.1.2
.....

Expand Down
Loading
Loading