Skip to content

release v0.10.0 (#144) - #144

Draft
georgeRobertson wants to merge 28 commits into
mainfrom
release_v010
Draft

georgeRobertson wants to merge 28 commits into
mainfrom
release_v010

feat: add orphan and group rejections to spark backend (#174)

df8bbe4
Select commit
Loading
Failed to load commit list.
SonarQubeCloud / SonarCloud Code Analysis succeeded Oct 8, 2026 in 34s

Annotations

Check warning on line 448 in src/dve/core_engine/message.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TxvuEDR3t5Uh0Oq&open=AaDx_TxvuEDR3t5Uh0Oq&pullRequest=144

Check warning on line 179 in src/dve/reporting/excel_report.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_T49uEDR3t5Uh0Oy&open=AaDx_T49uEDR3t5Uh0Oy&pullRequest=144

Check warning on line 406 in src/dve/core_engine/backends/base/rules.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Replace "list(...)[0]" with "next(iter(...))" to avoid materializing the entire iterable.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaCQtnLIPiTetWKRyLgv&open=AaCQtnLIPiTetWKRyLgv&pullRequest=144

Check warning on line 165 in src/dve/core_engine/message.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TxvuEDR3t5Uh0Ol&open=AaDx_TxvuEDR3t5Uh0Ol&pullRequest=144

Check warning on line 248 in src/dve/core_engine/backends/implementations/duckdb/duckdb_helpers.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_ThKuEDR3t5Uh0Ob&open=AaDx_ThKuEDR3t5Uh0Ob&pullRequest=144

Check warning on line 715 in src/dve/pipeline/pipeline.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Replace this comprehension with passing the iterable to the collection constructor call

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDNr_XSRLva7KyeTTJb&open=AaDNr_XSRLva7KyeTTJb&pullRequest=144

Check warning on line 176 in src/dve/common/error_utils.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_T38uEDR3t5Uh0Ox&open=AaDx_T38uEDR3t5Uh0Ox&pullRequest=144

Check warning on line 1033 in src/dve/pipeline/pipeline.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_T2LuEDR3t5Uh0Ov&open=AaDx_T2LuEDR3t5Uh0Ov&pullRequest=144

Check warning on line 371 in src/dve/core_engine/backends/implementations/spark/spark_helpers.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TnCuEDR3t5Uh0Od&open=AaDx_TnCuEDR3t5Uh0Od&pullRequest=144

Check warning on line 402 in src/dve/core_engine/backends/metadata/rules.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TsxuEDR3t5Uh0Oh&open=AaDx_TsxuEDR3t5Uh0Oh&pullRequest=144

Check warning on line 342 in src/dve/core_engine/message.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TxvuEDR3t5Uh0Oo&open=AaDx_TxvuEDR3t5Uh0Oo&pullRequest=144

Check warning on line 667 in src/dve/core_engine/backends/metadata/rules.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TsxuEDR3t5Uh0Oi&open=AaDx_TsxuEDR3t5Uh0Oi&pullRequest=144

Check warning on line 55 in src/dve/core_engine/configuration/v1/hierarchy.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_Tu1uEDR3t5Uh0Oj&open=AaDx_Tu1uEDR3t5Uh0Oj&pullRequest=144

Check warning on line 298 in src/dve/metadata_parser/models.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_T0iuEDR3t5Uh0Os&open=AaDx_T0iuEDR3t5Uh0Os&pullRequest=144

Check warning on line 65 in src/dve/core_engine/backends/metadata/rules.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TsxuEDR3t5Uh0Of&open=AaDx_TsxuEDR3t5Uh0Of&pullRequest=144

Check warning on line 889 in src/dve/pipeline/pipeline.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Remove "@lru_cache"/"@cache" from this instance method; the cache retains "self" and can leak memory.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_T2LuEDR3t5Uh0Ot&open=AaDx_T2LuEDR3t5Uh0Ot&pullRequest=144

Check warning on line 199 in src/dve/core_engine/message.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TxvuEDR3t5Uh0Om&open=AaDx_TxvuEDR3t5Uh0Om&pullRequest=144

Check warning on line 213 in src/dve/core_engine/backends/readers/xml.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TqLuEDR3t5Uh0Oe&open=AaDx_TqLuEDR3t5Uh0Oe&pullRequest=144

Check warning on line 47 in src/dve/core_engine/message.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TxvuEDR3t5Uh0Ok&open=AaDx_TxvuEDR3t5Uh0Ok&pullRequest=144

Check warning on line 283 in src/dve/core_engine/message.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TxvuEDR3t5Uh0On&open=AaDx_TxvuEDR3t5Uh0On&pullRequest=144

Check warning on line 1098 in src/dve/pipeline/pipeline.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Combine these nested "with" statements into a single "with" with multiple contexts.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_T2LuEDR3t5Uh0Ow&open=AaDx_T2LuEDR3t5Uh0Ow&pullRequest=144

Check warning on line 1025 in src/dve/pipeline/pipeline.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_T2LuEDR3t5Uh0Ou&open=AaDx_T2LuEDR3t5Uh0Ou&pullRequest=144

Check warning on line 139 in src/dve/core_engine/backends/implementations/spark/spark_helpers.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TnCuEDR3t5Uh0Oc&open=AaDx_TnCuEDR3t5Uh0Oc&pullRequest=144

Check warning on line 228 in src/dve/core_engine/backends/metadata/rules.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Use a union type expression for this type hint.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDx_TsxuEDR3t5Uh0Og&open=AaDx_TsxuEDR3t5Uh0Og&pullRequest=144

Check warning on line 93 in src/dve/core_engine/message.py

See this annotation in the file changed.

@sonarqubecloud sonarqubecloud / SonarCloud Code Analysis

Rename this field "ReportingEntity" to match the regular expression ^[_a-z][_a-z0-9]*$.

See more on https://sonarcloud.io/project/issues?id=NHSDigital_data-validation-engine&issues=AaDtakx5e96Vtai58T-z&open=AaDtakx5e96Vtai58T-z&pullRequest=144