Table with name does not exist

[jibiabraham-rz]

What happens?

Hello, I am able to perform the following set of steps successfully using duckdb shell (cli) but it breaks when done via the python library.

INSTALL aws;
INSTALL httpfs;
INSTALL iceberg;

CREATE OR REPLACE SECRET (
    TYPE s3,
    PROVIDER credential_chain
);

ATTACH OR REPLACE 'arn:aws:s3tables:...:bucket/s3_table' AS s3_tables_db (
    TYPE iceberg,
    ENDPOINT_TYPE s3_tables
);

# This works from the shell
FROM s3_tables_db.core.product LIMIT 5;

Any help at all would be appreciated.

To Reproduce

import duckdb


conn = duckdb.connect()
conn.install_extension("aws")
conn.install_extension("httpfs")
conn.install_extension("iceberg")
conn.sql(
    """
        CREATE OR REPLACE SECRET (
            TYPE s3,
            PROVIDER credential_chain
        );
    """
)
conn.sql(
    """
        ATTACH OR REPLACE 'arn:aws:s3tables:...:bucket/s3_table' AS s3_tables_db (
            TYPE iceberg,
            ENDPOINT_TYPE s3_tables
        );
    """
)

# Works
x = conn.execute("show all tables;").fetchall()

# Errors out
y = conn.execute(
    """
    FROM s3_tables_db.core.product LIMIT 5;
    """
).fetchall()

Output

Exception has occurred: CatalogException
Catalog Error: Table with name product does not exist!
Did you mean "s3_tables_db.core.product"?

OS:

OSX

DuckDB Package Version:

1.4.1

Python Version:

3.12

Full Name:

Jibi Abraham

Affiliation:

Razor Group

What is the latest build you tested with? If possible, we recommend testing with the latest nightly build.

I have tested with a stable release

Did you include all relevant data sets for reproducing the issue?

No - Other reason (please specify in the issue body)

Did you include all code required to reproduce the issue?

• Yes, I have

Did you include all relevant configuration to reproduce the issue?

• Yes, I have

[jibiabraham-rz]

FYI - This may be a regression of some sorts. The same works with duckdb version 1.3.1

[paultiq]

I could not reproduce on 1.4.1 (Windows & Linux) with a new s3_table.

I first created a "core" schema and a "range1" table with a sequence of ints.

import duckdb

duckdb.execute("""
INSTALL aws;
INSTALL httpfs;
INSTALL iceberg;

CREATE OR REPLACE SECRET (
    TYPE s3,
    PROVIDER credential_chain
);

ATTACH OR REPLACE 'arn:aws:s3tables:us-east-1:<someid>:bucket/<somebucketname>' AS s3_tables_db (
    TYPE iceberg,
    ENDPOINT_TYPE s3_tables
);

 from s3_tables_db.core.range1 limit 5
""").fetchall()

[jibiabraham-rz]

I don't really know what is wrong in which case. I can consistently replicate the issue on my mac with both 1.4.0 and 1.4.1
For now, I will revert to 1.3.2. If you have suggestions, I would be happy to test and report back

[paultiq]

My procedure was to connect to the s3table, and:

create schema core;
create table range1 as (value int);
insert into range1 select * from range(100);

I'm curious if there's something different about your schema or table, but perhaps what I wrote above (ie: with a different schema) and see if it reproduces. I'll try on my mac later today.