RuntimeError: no encoder for OID 1000

[songololo]

After inserting around 25,000 items into a database, I'll start getting this error:

RuntimeError: no encoder for OID 1000

which I've isolated to a boolean array data type (boolean[7][24]). (The error doesn't occur when I don't set this value).

It is a nested list of 7*24 elements, which is converted from a numpy array to a python list via the numpy to_list() method.

The asyncpg version is 0.10.1

[elprans]

Do you mind sharing the actual query and the table structure on which this can be reproduced?

This works for me:

        res = await self.con.fetchval('''
            SELECT $1::bool[][]
        ''', [[True, False], [False, True]])

[songololo]

@elprans

The issue occurs under different conditions than I originally thought. It is not caused by nested arrays, but under some scenarios where I'm working with both array and geom types. I've pasted-in an example scenario below that triggers the issue on my system:

• The error only occurs if inserting both the array and the geometry type
• If using a pool, then the error occurs at 25,000 items
• When directly using the connection (no pool), then the error occurs right away.

This will replicate the issue for me (requires PostGIS extension):

import asyncio
import asyncpg

async def array_vs_geom():

    db_connection = await asyncpg.connect(
        host='localhost',
        port=5432,
        user='my_username'
    )

    await db_connection.execute('''
        CREATE SCHEMA IF NOT EXISTS my_schema;
        CREATE TABLE IF NOT EXISTS my_schema.my_table (
            id text PRIMARY KEY,
            arr boolean[2],
            geom geometry(Point, 4326)
        );
        CREATE UNIQUE INDEX IF NOT EXISTS id_index_test ON my_schema.my_table (id);
    ''')

    for i in range(50000):
        if i % 1000 == 0:
            print(f'Processed {i}')
        try:
            await db_connection.execute(f'''
                INSERT INTO my_schema.my_table (id, arr, geom)
                  VALUES ($1, $2, ST_SetSRID($3::geometry, 4326))
                ON CONFLICT (id) DO UPDATE SET
                    arr = $2,
                    geom = ST_SetSRID($3::geometry, 4326)
                WHERE my_schema.my_table.id = $1
                ''',
                i,
                # happens regardless of specific array contents or dimensions
                [True, True],
                # happens regardless of specific geometry
                '01010000000C71568BA2F15BC01B419A196CB04040')
        except Exception as e:
            # error encountered at 25,000 items for pool, or immediately if no pool
            print(f' exception {e} at count {i}')
            raise e

if __name__ == '__main__':
    loop = asyncio.get_event_loop()
    loop.run_until_complete(array_vs_geom())

[elprans]

Confirmed. I can reproduce this with your script.

[elprans]

Fixed in df64f55.