Project
AWS's managed metadata catalog for data lakes, holding the table and schema definitions that query engines resolve against.
Amazon Web Services added Iceberg materialized views to Redshift, so a result Redshift computes once can be read by Spark and Athena, a dev.to write-up says. Teams that copy shared metrics between engines with ETL jobs can retire those jobs only if the views stay fresh enough for their readers.
Reality
AWS has embedded DuckDB in Aurora PostgreSQL from versions 17.11 and 18.6, so one SQL query can join live rows with Iceberg and Parquet tables in S3. Reverse-ETL jobs that exist only for that join can be retired if the database instance has room for the lake scans.
Reality
Keeping the Iceberg table format governance-unaware was a deliberate call. That leaves the catalog as the only thing standing on the path of every read. A dev.to guide lists six pieces an operator has to source above it.
Reality
Posit's IDE now ships as a custom SageMaker Studio image, and queries to Athena, Glue and S3 run on the Space role's permissions while Posit Assistant authenticates to Bedrock with the same environment credentials.
Reality
AWS schedules compaction, snapshot expiration and orphan cleanup on table buckets itself, and a dev.to teardown finds that managed maintenance halts on any table carrying a user-defined tag or branch.
Reality