AWS Integrates DuckDB with Aurora PostgreSQL for Direct S3 Data Analysis

AWS has expanded its Aurora PostgreSQL service to allow users to analyze historical data in Amazon S3 directly from the database. This eliminates the need for organizations to first copy data before operational and historical data can be queried together.

Until now, combining current transaction data with large volumes of older data required data pipelines to transfer information from S3 to a database, consuming additional storage and computing power.

Aurora PostgreSQL can now directly access data stored in Apache Iceberg and Parquet formats using DuckDB for analytical processing. This allows applications to run queries via existing PostgreSQL interfaces that combine regular Aurora tables with data from a data lake.

AWS has rapidly assigned DuckDB a broader role within its platform, with the technology primarily intended to eliminate the need for analytical queries to first pass through other services or infrastructure.