Skip to content

Move incoming files into the DSH share #84

Closed

Description

@thompson318

Description

Files moving to the DSH go into an incoming folder. Files need to moved into the waveform-share on the DSH.
We need an automated way to do this: copes with edge cases:
Two versions uploaded etc.

Definition of Done

  • Data automatically moved from incoming to waveform share by a script that is manually run

Dependencies

Comments

We don't know yet how annoying this will be in practice. Incoming stores things for a month, so manual intervention is currently required at least once a month.
Tom Couch has a script that we might be able to use to move the data.

Activity

  1. jeremyestein commented on Aug 24, 2026

    @jeremyestein
    Collaborator

    Tom said that he had to ask for a VM to be set up, which had both the arrivals and S drive mounted on it. Then you can use a cron job to look for new files and move them as appropriate.
    It also required some messing around with kerberos to get the script to run as the right user when not logged in. It sounds like it would run as a human user, not a machine account, so is somewhat more fragile than it should be.

  2. linked a pull request that will close this issueDSH extractor script #111on Oct 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions