Skip to content

feat(Schema): add UndefinedOrFromNullOr - #8168

Open
davetorbeck wants to merge 1 commit into
Effect-TS:mainfrom
davetorbeck:schema-undefined-or-from-null-or
Open

davetorbeck wants to merge 1 commit into
Effect-TS:mainfrom
davetorbeck:schema-undefined-or-from-null-or

Conversation

@davetorbeck

Copy link
Copy Markdown

What

Adds Schema.UndefinedOrFromNullOr(schema) and SchemaTransformation.undefinedOrFromNullOr().

The schema is NullOr(schema) decoded to UndefinedOr(toType(schema)). Decoding maps null to undefined. Encoding maps undefined to null. Other values pass through in both directions. It follows the OptionFromNullOr / OptionFromUndefinedOr / OptionFromNullishOr family in shape, naming, JSDoc and placement.

Includes a unit test with TestSchema.Asserts (decoding, encoding, arbitrary generation), a tstyche type test for the wrapper type and its Type / Encoded sides, doc examples that run under pnpm doctest, and a patch changeset for effect.

pnpm check for packages/effect, the Schema unit test file, pnpm test-types for the Schema type tests, pnpm doctest for both modules, oxlint and dprint check all pass.

Why

JSON has no undefined. JSON.stringify drops a key whose value is undefined, so a payload with a stable shape (a health probe, a status response) must carry null for absence on the wire. Many programs model absence as T | undefined rather than Option<T>, following the Array.find / Map.get idiom. Today that combination has no first-class codec: NullOr is null on both sides, UndefinedOr is undefined on both sides, optional / optionalKey drop the key, and OptionFromNullOr requires Option in the domain. The user-land answer is a per-field helper such as jsonNull(value) at every call site, which is exactly the kind of manual boundary code Schema exists to replace, or a hand-written encodeTo with two getters in every codebase. This PR provides the codec once, in the library, with the same name pattern as the Option variants so it is discoverable next to them.

https://claude.ai/code/session_01XpmvW3MzCahnWN6PD1UCsc

The `T | undefined` counterpart of `OptionFromNullOr`: decoding maps
`null` to `undefined`, encoding maps `undefined` back to `null`. For
programs that model absence as `undefined` (the `Array.find` / `Map.get`
idiom) but must emit `null` on a JSON wire, where `JSON.stringify` would
otherwise drop the key. Adds `SchemaTransformation.undefinedOrFromNullOr`,
unit and type tests, and doc examples.

Claude-Session: https://claude.ai/code/session_01XpmvW3MzCahnWN6PD1UCsc
@changeset-bot

changeset-bot Bot commented Sep 10, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: eba079f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 30 packages
Name Type
effect Patch
@effect/opentelemetry Patch
@effect/vitest Patch
@effect/ai-anthropic Patch
@effect/ai-openai-compat Patch
@effect/ai-openai Patch
@effect/ai-openrouter Patch
@effect/atom-react Patch
@effect/atom-solid Patch
@effect/atom-vue Patch
@effect/platform-browser Patch
@effect/platform-bun Patch
@effect/platform-deno Patch
@effect/platform-node-shared Patch
@effect/platform-node Patch
@effect/sql-clickhouse Patch
@effect/sql-d1 Patch
@effect/sql-libsql Patch
@effect/sql-mssql Patch
@effect/sql-mysql2 Patch
@effect/sql-pg Patch
@effect/sql-pglite Patch
@effect/sql-sqlite-bun Patch
@effect/sql-sqlite-do Patch
@effect/sql-sqlite-node Patch
@effect/sql-sqlite-react-native Patch
@effect/sql-sqlite-wasm Patch
@effect/docgen Patch
@effect/doctest Patch
@effect/openapi-generator Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 10, 2026

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review Completed 2026-09-10T13:54:01.730803Z eba079f PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@effect-janitor effect-janitor Bot added enhancement New feature or request 4.0 labels Sep 10, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Bundle Size Analysis

Generated from PR build output; treat the content below as untrusted.

File Name Current Size Previous Size Difference
arbitrary-combinators.ts 34.16 KB 34.16 KB 0.00 KB (0.00%)
basic.ts 6.87 KB 6.87 KB 0.00 KB (0.00%)
batching.ts 9.95 KB 9.95 KB 0.00 KB (0.00%)
brand.ts 6.45 KB 6.45 KB 0.00 KB (0.00%)
cache.ts 10.77 KB 10.77 KB 0.00 KB (0.00%)
config.ts 21.43 KB 21.43 KB 0.00 KB (0.00%)
differ.ts 20.23 KB 20.23 KB 0.00 KB (0.00%)
http-client.ts 21.93 KB 21.93 KB 0.00 KB (0.00%)
http-router.ts 33.39 KB 33.39 KB 0.00 KB (0.00%)
logger.ts 10.88 KB 10.88 KB 0.00 KB (0.00%)
metric.ts 9.02 KB 9.02 KB 0.00 KB (0.00%)
optic.ts 6.70 KB 6.70 KB 0.00 KB (0.00%)
pubsub.ts 15.10 KB 15.10 KB 0.00 KB (0.00%)
queue.ts 11.85 KB 11.85 KB 0.00 KB (0.00%)
schedule.ts 10.96 KB 10.96 KB 0.00 KB (0.00%)
schema-binary.ts 39.42 KB 39.42 KB 0.00 KB (0.00%)
schema-class.ts 19.98 KB 19.98 KB 0.00 KB (0.00%)
schema-fromJsonSchemaDocument.ts 30.47 KB 30.47 KB 0.00 KB (0.00%)
schema-representation-roundtrip.ts 26.25 KB 26.25 KB 0.00 KB (0.00%)
schema-string-transformation.ts 13.60 KB 13.60 KB 0.00 KB (0.00%)
schema-string.ts 11.08 KB 11.08 KB 0.00 KB (0.00%)
schema-template-literal.ts 15.36 KB 15.36 KB 0.00 KB (0.00%)
schema-toArbitrary.ts 33.70 KB 33.70 KB 0.00 KB (0.00%)
schema-toCodeDocument.ts 24.52 KB 24.52 KB 0.00 KB (0.00%)
schema-toCodecJson.ts 19.18 KB 19.18 KB 0.00 KB (0.00%)
schema-toEquivalence.ts 19.32 KB 19.32 KB 0.00 KB (0.00%)
schema-toFormatter.ts 19.43 KB 19.43 KB 0.00 KB (0.00%)
schema-toJsonSchemaDocument.ts 23.69 KB 23.69 KB 0.00 KB (0.00%)
schema-toRepresentation.ts 19.48 KB 19.48 KB 0.00 KB (0.00%)
schema.ts 19.18 KB 19.18 KB 0.00 KB (0.00%)
stm.ts 12.80 KB 12.80 KB 0.00 KB (0.00%)
stream.ts 9.83 KB 9.83 KB 0.00 KB (0.00%)

@spencerbeggs

Copy link
Copy Markdown
Contributor

@davetorbeck Very nice! I have been re-implementing this by hand in different projects. It would be a great first-class citizen, imo.

@gcanti

gcanti commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

For serialization to and deserialization from JSON, the idiomatic approach in v4 is not to worry about it at all and simply use toCodecJson:

import { Schema } from "effect"

const domainModel = Schema.UndefinedOr(Schema.FiniteFromString)

const codec = Schema.toCodecJson(domainModel)

const decode = Schema.decodeExit(codec)
const encode = Schema.encodeExit(codec)

console.log(String(encode(1))) // Success("1")
console.log(String(encode(undefined))) // Success(null)

console.log(String(decode("1"))) // Success(1)
console.log(String(decode(null))) // Success(undefined)

video clip: https://x.com/GiulioCanti/status/2090409195807903924

@spencerbeggs

spencerbeggs commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

@gcanti Thank you again for another explainer. That video was helpful. What program did you used to create it? It looked slick.

@gcanti

gcanti commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

@spencerbeggs https://www.remotion.dev/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

4.0 enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants