Acquisition discipline
Separates vendor download and file extraction from database mutation so ingestion can be audited, rerun, and reconciled.
A futures data engineering layer that turns raw third-party contract history into auditable, session-aware, roll-adjusted research bars for quantitative trading system development.
Position summary
Its role is to acquire vendor futures data, normalize contract records, enforce session semantics, compute proprietary roll events, construct continuous futures bars, and persist research-ready outputs in a structured database. The value is not simply download automation; it is the transformation of fragmented contract files into a repeatable, testable data foundation.
Separates vendor download and file extraction from database mutation so ingestion can be audited, rerun, and reconciled.
Builds symbol-level continuous series from contract-level futures history using roll-event metadata and additive adjustment controls.
Produces downstream data ranges and quality evidence that help research workflows avoid silent data defects.
Pipeline
Configured instruments, active contract months, daily bars, and minute bars are acquired and inventoried before persistence.
Raw records are standardized into a coherent market-session policy so daily and intraday data share a consistent exchange-day interpretation.
Back/front contract transitions are identified through controlled roll logic and persisted as auditable metadata.
Roll deltas are accumulated into adjusted continuous bars for strategy research, validation, and reporting workflows.
Technical strengths
Raw contract records, roll metadata, and adjusted outputs are treated as separate artifacts, improving auditability and controlled rebuilds.
Research bars are aligned to a consistent session model, reducing time-boundary errors in feature engineering and validation.
Structured persistence supports repeatable ingestion, downstream SQL-heavy aggregation, and reproducible research windows.
Inventory checks, usable-range reporting, and invariant checks protect research from quietly consuming incomplete or inconsistent history.
This page describes data-management methodology at a marketing and architecture level. It does not disclose vendor credentials, database schemas, table names, endpoint implementations, roll thresholds, private configuration values, or source code.