Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Postgres vector data types #391

Open
uw4 opened this issue Jul 9, 2024 · 2 comments
Open

Support Postgres vector data types #391

uw4 opened this issue Jul 9, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@uw4
Copy link
Contributor

uw4 commented Jul 9, 2024

When storing embeddings in pg vector we get these warnings:

2024-07-07 18:20:47,572 INFO [org.das.ser.Services] (executor-thread-161) Starting metadata collection for tenant=null
2024-07-07 18:20:47,933 SEVERE [org.das.ser.Metadata] (executor-thread-161) Type unknown: BIGSERIAL
2024-07-07 18:20:47,934 SEVERE [org.das.ser.Metadata] (executor-thread-161) Type unknown: VECTOR
2024-07-07 18:20:47,934 SEVERE [org.das.ser.Metadata] (executor-thread-161) Type unknown: BIGSERIAL
2024-07-07 18:20:47,935 SEVERE [org.das.ser.Metadata] (executor-thread-161) Type unknown: VECTOR
2024-07-07 18:20:47,936 SEVERE [org.das.ser.Metadata] (executor-thread-161) Type unknown: UUID
2024-07-07 18:20:47,936 SEVERE [org.das.ser.Metadata] (executor-thread-161) Type unknown: VECTOR

Tested with dockerhub container pgvector/pgvector:pg16

@uw4 uw4 added the enhancement New feature or request label Jul 9, 2024
@uw4
Copy link
Contributor Author

uw4 commented Jul 9, 2024

Not critical as the table can still be browsed read-only:

image

@uw4
Copy link
Contributor Author

uw4 commented Jul 9, 2024

Typical stacktrace during browsing:

2024-07-09 18:30:50,839 INFO [org.das.ser.ExMapper] (executor-thread-167) REST exception: org.postgresql.util.PSQLException: ERROR: operator does not exist: bigint = character varying
Hint: No operator matches the given name and argument types. You might need to add explicit type casts.
Position: 49
at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2713)
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2401)
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:368)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:498)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:415)
at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:190)
at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:134)
at org.apache.commons.dbcp2.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:122)
at org.apache.commons.dbcp2.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:122)
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
at java.base/java.lang.reflect.Method.invoke(Method.java:580)
at org.dashjoin.service.SQLDatabase$Aspect.invoke(SQLDatabase.java:193)
at jdk.proxy4/jdk.proxy4.$Proxy99.executeQuery(Unknown Source)
at org.dashjoin.service.SQLDatabase.readInternal(SQLDatabase.java:835)
at org.dashjoin.service.SQLDatabase.read(SQLDatabase.java:752)
at org.dashjoin.service.Data.read(Data.java:702)
at org.dashjoin.service.Data.read(Data.java:635)
at org.dashjoin.service.Data.list(Data.java:931)
at org.dashjoin.service.Data_ClientProxy.list(Unknown Source)

@aeberhart aeberhart added this to the 5.2 milestone Jul 10, 2024
@aeberhart aeberhart self-assigned this Jul 10, 2024
@aeberhart aeberhart removed this from the 5.2 milestone Jul 10, 2024
@aeberhart aeberhart added this to the backlog milestone Jul 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants