Notes from planning meeting 22-04-2024

Owned by Ian Johnson
Last updated: Apr 25, 2024
1 min read

Priority Actions:

James (50%): 100Gb/s Gateways

Brij: Deletions – can we scale or do we need async?

Alex: Writable WN gateways

Jyothish: Containerized XRootD

Ian: Improving buffer layer in XrdCeph

 

Development needed to ensure that we can cope with much higher data rates (i.e. 100Gb/s NIC)

Long term sustainability of code base (Libradosstriper, ALICE authz plugin)

Data Safety –

Correct Operation, verified by (multiple?) checksums to assure integrity

Deletions – satisfy VO requirements

Availablility –

                Cope with varying load – containerise?

Usability –

                support for multiple authN methods

                ??

Sustainability –

                utilisation of resources (human effort, energy ysage, etc)

Q: Development scope of knowledge

Alice AuthN plugin availability?

Virtual placement improvements?              hybrid cache/noncache cluster in cmsd

                                            improviing buffer layer in xrdceph

On the fly checksumming/ deletion

                                                              writable WN gateways (separate WN and external  GW traffic)

containerised XRootD (kubernetes orchestration, autoscaling

  1. correct port access                                                                      moving caching to xrootd ceph?

  1. host certs for containers

                                                                tuning vector reads

performance monitoring

   testing framework (Mariam is working on)

                                                                                                  redirector level op summary

                             log file processing/scraping

 

=====================================================================

PNG from Zoom whiteboard