Repository navigation

Feature/ndit 655 refdata arrow integration - #37

Merged

stevenhsd merged 15 commits into

develop_v06from

feature/ndit-655_refdata_arrow_integration

Feb 12, 2026

Commits on Jan 26, 2026
- feat: Change how error messages are generated (by writing in batches). Duckdb no long relies on pandas- use of pyarrow, multiprocessing and background thread batch writing to avoid memory pressure
  stevenhsd
  committed
  efe0fa0
Commits on Jan 27, 2026
- style: run black, isort and resolve linting issues
  stevenhsd
  committed
  f1fd8aa
Commits on Jan 28, 2026
Commits on Feb 3, 2026
- refactor: merge in main and resolve conflicts and linting issues
  stevenhsd
  committed
  141e1b3
Commits on Feb 6, 2026
Commits on Feb 9, 2026
- feat: added reference data loading of arrow ipc files including enhanced test coverage for reference data loaders
  stevenhsd
  committed
  70d2399
Commits on Feb 10, 2026
Commits on Feb 11, 2026
- refactor: amended process pool to use executor supplied to duckdb pipeline/data contract rather than always instantiating new pool
  stevenhsd
  committed
  85e9693