Skip to content

Benchmarks: reduce coupling to Coiled as the remote runner #235

Description

@Mmoncadaisla

The geospatial engine suite (benchmarks/geospatial/engine_suite.py) drives its remote runs through Coiled Functions. Coiled is convenient (environment sync, one reused VM per machine size) and works well today, but in review Alex raised a fair durability question: with Matthew Rocklin stepping back from Coiled (https://matthewrocklin.com/stepping-back/), it is unclear how durable Coiled Functions are long term, so the suite should not be hard-tied to a single provider.

  • Vanilla Cloud Run was suggested as a good fit, since we usually profile against ARCO-ERA5 in-region (us-central1).
  • The remote side of the suite is already mostly provider-agnostic: cells are plain functions taking a source tarball, and the native module is provisioned per VM by the harness itself (4b76f31), so porting means swapping the coiled.function decorator and the VM lifecycle handling.

Context: #227 (comment)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions