pg_mooncake
Columnstore Table in Postgres
Repository
Mooncake-Labs/pg_mooncake
https://github.com/Mooncake-Labs/pg_mooncake
Source
pg_mooncake-0.2.0.tar.gz
pg_mooncake-0.2.0.tar.gz
Overview
| Package | Version | Category | License | Language |
|---|---|---|---|---|
pg_mooncake | 0.2.0 | OLAP | MIT | Rust |
| ID | Extension | Bin | Lib | Load | Create | Trust | Reloc | Schema |
|---|---|---|---|---|---|---|---|---|
| 2440 | pg_mooncake | No | No | Yes | Yes | No | No | - |
| Related | pg_duckdb pg_duckdb duckdb_fdw pg_analytics columnar citus_columnar pg_parquet orioledb timescaledb |
|---|
unpublished release
Version
| Type | Repo | Version | PG Ver | Package | Deps |
|---|---|---|---|---|---|
| EXT | PIGSTY | 0.2.0 | 1817161514 | pg_mooncake | pg_duckdb |
| RPM | PIGSTY | 0.2.0 | 1817161514 | pg_mooncake_$v | - |
| DEB | PIGSTY | 0.2.0 | 1817161514 | postgresql-$v-pg-mooncake | - |
Build
You can build the RPM / DEB packages for pg_mooncake using pig build:
pig build pkg pg_mooncake # build RPM / DEB packages
Install
You can install pg_mooncake directly. First, make sure the PGDG and PIGSTY repositories are added and enabled:
pig repo add pgsql -u # Add repo and update cache
Install the extension using pig or apt/yum/dnf:
pig install pg_mooncake; # Install for current active PG version
pig ext install -y pg_mooncake -v 18 # PG 18
pig ext install -y pg_mooncake -v 17 # PG 17
pig ext install -y pg_mooncake -v 16 # PG 16
pig ext install -y pg_mooncake -v 15 # PG 15
pig ext install -y pg_mooncake -v 14 # PG 14
dnf install -y pg_mooncake_18 # PG 18
dnf install -y pg_mooncake_17 # PG 17
dnf install -y pg_mooncake_16 # PG 16
dnf install -y pg_mooncake_15 # PG 15
dnf install -y pg_mooncake_14 # PG 14
apt install -y postgresql-18-pg-mooncake # PG 18
apt install -y postgresql-17-pg-mooncake # PG 17
apt install -y postgresql-16-pg-mooncake # PG 16
apt install -y postgresql-15-pg-mooncake # PG 15
apt install -y postgresql-14-pg-mooncake # PG 14
Preload:
shared_preload_libraries = 'pg_duckdb, pg_mooncake';
Create Extension:
CREATE EXTENSION pg_mooncake CASCADE; -- requires: pg_duckdb
Usage
pg_mooncake is a Postgres extension that creates columnstore mirrors of your tables in Iceberg format, designed as a sub-extension of pg_duckdb.
pg_mooncake docs: https://docs.mooncake.dev/
Quick Setup
Install pg_duckdb and pg_mooncake with pig:
pig repo set
pig install pg_duckdb pg_mooncake
Edit postgresql.conf, then restart to take effect
shared_preload_libraries = 'pg_duckdb,pg_mooncake'
duckdb.allow_community_extensions = true
wal_level = logical
Hello Worlds
-- create the extension alone with pg_duckdb
CREATE EXTENSION pg_mooncake CASCADE;
-- Next, create a regular Postgres table trades:
CREATE TABLE trades(
id bigint PRIMARY KEY,
symbol text,
time timestamp,
price real
);
-- Then, create a columnstore mirror trades_iceberg that stays in sync with trades:
CALL mooncake.create_table('trades_iceberg', 'trades');
-- Now, insert some data into trades:
INSERT INTO trades VALUES
(1, 'AMD', '2024-06-05 10:00:00', 119),
(2, 'AMZN', '2024-06-05 10:05:00', 207),
(3, 'AAPL', '2024-06-05 10:10:00', 203),
(4, 'AMZN', '2024-06-05 10:15:00', 210);
-- Finally, query it with duckdb
EXPLAIN
SELECT avg(price) FROM trades_iceberg WHERE symbol = 'AMZN';
You will see the DuckDBScan in the execution plan:
QUERY PLAN
------------------------------------------------------------
Custom Scan (DuckDBScan) (cost=0.00..0.00 rows=0 width=0)
DuckDB Execution Plan:
┌───────────────────────────┐
│ UNGROUPED_AGGREGATE │
│ ──────────────────── │
│ Aggregates: avg(#0) │
└─────────────┬─────────────┘
┌─────────────┴─────────────┐
│ PROJECTION │
│ ──────────────────── │
│ CAST(price AS DOUBLE) │
│ │
│ ~0 rows │
└─────────────┬─────────────┘
┌─────────────┴─────────────┐
│ MOONCAKE_SCAN │
│ ──────────────────── │
│ Table: trades_iceberg │
│ Projections: price │
│ │
│ Filters: │
│ symbol='AMZN' │
│ │
│ ~0 rows │
└───────────────────────────┘
Feedback
Was this page helpful?
Thanks for the feedback! Please let us know how we can improve.
Sorry to hear that. Please let us know how we can improve.