Data export overview

Export Types

Type
Frequency
Format
Path Pattern

Hourly

Every hour

Parquet

{export}/date={YYYY-MM-DD}/hour={HH:mm}/

Daily

Daily at 00:00 UTC

CSV/Parquet

{export}/date={YYYY-MM-DD}/


S3 Structure

s3://hyena-hip3/
β”œβ”€β”€ hourly/
β”‚   β”œβ”€β”€ summary/
β”‚   β”‚   β”œβ”€β”€ funding/
β”‚   β”‚   └── liquidations/
β”‚   └── raw/
β”‚       β”œβ”€β”€ orders/
β”‚       β”‚   β”œβ”€β”€ all/
β”‚       β”‚   └── builder/
β”‚       β”œβ”€β”€ fills/
β”‚       β”‚   β”œβ”€β”€ perp/
β”‚       β”‚   β”œβ”€β”€ spot/
β”‚       β”‚   β”œβ”€β”€ builder/
β”‚       β”‚   β”œβ”€β”€ liquidation/
β”‚       β”‚   β”œβ”€β”€ twap/
β”‚       β”‚   └── hlpe_counterparty_taker/*
β”‚       β”œβ”€β”€ oracle/
β”‚       β”œβ”€β”€ ledger/
β”‚       β”œβ”€β”€ twap_statuses/
β”‚       β”œβ”€β”€ funding/
β”‚       └── book_diffs/
β”‚       └── foundational/
β”‚           β”œβ”€β”€ per_contract/
β”‚           └── per_address/
β”‚
└── daily/
    β”œβ”€β”€ hlpe_fee_summary/
    β”œβ”€β”€ fills_summary_per_user/
    └── snapshots/
        β”œβ”€β”€ positions/
        β”œβ”€β”€ accounts/
        β”œβ”€β”€ orderbooks/
        └── spot_holders/

How It Works

  1. Hourly exports run ~1 minute past the hour:

    • Raw data: All HyENA dex events β€” fills, orders, oracle prices, USDE spot trades, ledger transfers, TWAP statuses, book diffs

    • Foundational: Per-second market snapshots (per contract and per address)

    • Aggregations: Funding payments and liquidations per user

  2. Daily exports run at 00:10 UTC:

    • Aggregations for slack report maker/taker volume summaries per user and hlpe take summary

    • Snapshots capture the current state of HyENA dex and allow for a general overview and together with the raw hourly exports they allow for reconstructing the HyENA dex state to any point in time.


Data Availability

From HyENA launch:

  • Fills (all types), ledger events, funding, liquidations, TWAP statuses

Available from december 22. Can be backfilled later if necessary:

  • Orders, book diffs, oracle prices


File Naming

Hourly

  • Format: Parquet

  • Path: {s3_path}/date={YYYY-MM-DD}/hour={HH}/{HH}_{name}.parquet

  • Example: hourly/raw/fills/perp/date=2025-12-15/hour=09/09_fills.parquet

See Hourly Exports for specifics.

Daily

  • Aggregations: CSV, single file overwritten daily

  • Snapshots: Parquet, timestamped {ts}_{name}.parquet

  • Path: daily/{type}/... or daily/snapshots/{type}/date={YYYY-MM-DD}/...

See Daily exports for specifics.

Last updated