Add Pinecone Provider - #35094
Merged
Merged
Conversation
utkarsharma2
commented
Oct 20, 2023
utkarsharma2
requested review from
kaxil,
pankajkoti,
phanikumv and
sunank200
October 20, 2023 22:28
utkarsharma2
force-pushed
the
Pinecone-provider
branch
from
October 27, 2023 16:00
c51a1b4 to
fe6d728
Compare
utkarsharma2
force-pushed
the
Pinecone-provider
branch
from
October 30, 2023 12:38
fe6d728 to
c17f994
Compare
utkarsharma2
marked this pull request as ready for review
October 30, 2023 12:44
josh-fell
reviewed
Oct 30, 2023
utkarsharma2
force-pushed
the
Pinecone-provider
branch
2 times, most recently
from
November 1, 2023 14:21
fead816 to
ffa9917
Compare
pankajastro
reviewed
Nov 2, 2023
pankajastro
reviewed
Nov 2, 2023
utkarsharma2
requested review from
ashb,
bbovenzi,
eladkal,
ephraimbuddy,
jedcunningham,
jhtimmins,
o-nikolas,
pierrejeambrun and
ryanahamilton
as code owners
November 3, 2023 10:44
Co-authored-by: Josh Fell <48934154+josh-fell@users.noreply.github.com>
utkarsharma2
force-pushed
the
Pinecone-provider
branch
from
November 6, 2023 18:15
259b065 to
6de02a5
Compare
utkarsharma2
removed request for
ashb,
bbovenzi,
bolkedebruin,
dstandish,
jhtimmins,
o-nikolas,
pierrejeambrun,
ryanahamilton and
uranusjr
November 6, 2023 19:19
60 tasks
romsharon98
pushed a commit
to romsharon98/airflow
that referenced
this pull request
Nov 10, 2023
This PR is part of our larger effort to add first-class integrations to support LLMOps that was presented at Airflow Summit. In this PR we are adding Pinecone Provider. Pinecone is a fully managed vector database that makes it easy to add vector search to production applications. The primary objective of this Provider is to present users with an alternative Vector Database. --------- Co-authored-by: Josh Fell <48934154+josh-fell@users.noreply.github.com> Co-authored-by: Hussein Awala <hussein@awala.fr> Co-authored-by: Pankaj Singh <98807258+pankajastro@users.noreply.github.com> Co-authored-by: Pankaj <pankaj.singh@astronomer.io>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR is part of our larger effort to add first-class integrations to support LLMOps that was presented at Airflow Summit.
In this PR we are adding Pinecone Provider. Pinecone is a fully managed vector database that makes it easy to add vector search to production applications. The primary objective of this Provider is to present users with an alternative Vector Database.
Example DAG:
The PineconeIngestOperator can accept either a list vector or a callable returning a list vector.
Email Discussion related to the effort can be found here - https://lists.apache.org/thread/0d669fmy4hn29h5c0wj0ottdskd77ktp