Skip to content

Implement split-merge processing #3

@spwoodcock

Description

@spwoodcock
  • Accept optional images.json containing EXIF data, to speed up workflow.
  • Do splitting based on images.json metadata.
  • Spawn multiple standard ContainerSet workflows, but using an artifact JSON containing the URLs to download (s3 paths).
  • Run the many ContainerSets for processing each stage.
  • Final stage depends on all returned results --> merge dataset, then upload.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesthelp wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions