...
This means that, if we were to transfer the data to tape without using storageD, The IDS wouldn’t know about the newly uploaded files and wouldn’t be able to download them.
High-level requirements
A script, deployed on a server somewhere, will need to:
check ICAT for files added between a set of dates (Start data - > end date)
store the location of these files
download the files via s3 and create a checksum
create a drop file and publish to StorageD
once all files have been pushed to storageD, redownload and check checksum