AWS batch allows you to easily submit many jobs simultaneously, each with their own set of input parameters. AWS will then manage the queue of jobs, provision EC2 instances as necessary, run the job, ...

In machines, data generated by the programs are stored in dedicated subfolders. The identification and management (viewing, removal, searching) of the datasets is based solely on the folder names. In ...