Skip to content

FIREFLY-2108: Deprecate DsvTableIO and move its delimited-file reading functionality into DuckDbReadable - #2020

Merged
loitly merged 1 commit into
devfrom
FIREFLY-2108-duckdb-csv-import
Sep 23, 2026
Merged

loitly merged 1 commit into
devfrom
FIREFLY-2108-duckdb-csv-import

Conversation

@loitly

@loitly loitly commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

Ticket: https://jira.ipac.caltech.edu/browse/FIREFLY-2108

Also:

  • Centralize DdColumn-to-DataType mapping to prevent divergence.

Test: https://firefly-2108-duckdb-csv-import.irsakubedev.ipac.caltech.edu/firefly/

To Test

  1. Go to Tables (TAP).
  2. Select Edit ADQL.
  3. Select the CADC service.
  4. Click Upload Table and select the b.csv test file attached to the ticket.
  5. Enter the following in the Query box:
    SELECT * FROM TAP_UPLOAD.upload_table
  6. Click Search.
  7. Verify that the objectId column type is long.

For comparison, running the same test on firefly.irsakubedev shows objectId as double.

…g functionality into DuckDbReadable

- Centralize DdColumn-to-DataType mapping to prevent divergence.
@loitly loitly added this to the 2026.3 milestone Sep 22, 2026
@loitly
loitly requested a review from robyww September 22, 2026 23:39
@loitly loitly self-assigned this Sep 22, 2026
@loitly loitly added the bug label Sep 22, 2026

@robyww robyww left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good

@loitly
loitly merged commit a8bf354 into dev Sep 23, 2026
1 check passed
@loitly
loitly deleted the FIREFLY-2108-duckdb-csv-import branch September 23, 2026 20:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants