2024-06-06 Meeting Notes

Operational Issues
Gateways and WNs:
- Current status and upcoming changes

@Thomas, Jyothish (STFC,RAL,SC)

RALPP/Oxford issue

upgrade hiccups

OXFORD

bash-4.2$ xrdcp -f -d1 root://t2xcache01.physics.ox.ac.uk//root://ceph-svc21.gridpp.rl.ac.uk:1094/atlas:datadisk/rucio/mc15_13TeV/78/3e/EVNT.04972714._000026.pool.root.1 test4
 [2024-06-06 10:44:56.644549 +0100][Error ][AsyncSock        ] [t2xcache01.physics.ox.ac.uk:1094.0] Unable to connect: connection refused
 [2024-06-06 10:44:56.644641 +0100][Error ][PostMaster       ] [t2xcache01.physics.ox.ac.uk:1094] elapsed = 0, pConnectionWindow = 120 seconds.
 [35.5MB/35.5MB][100%][==================================================][35.5MB/s] (edited) 

to check checksums for this file? xrd version on oxford? 5.6.3

RALPP
[tpw95647@mercury010 ~]$ curl -g -6 -k 'https://[2001:630:58:1820::82f6:b003]:1094' curl: (28) Operation timed out after 300730 milliseconds with 0 out of 0 bytes received

CHEP Abstract ideas

@Thomas, Jyothish (STFC,RAL,SC)

(awaiting acceptance notifications)

XrootD Workshop plan

@Alastair Dewhurst

The workshop agenda and registration page can be found at:

https://indico.cern.ch/event/1386888/

We would kindly ask you to consider contributing to the workshop in the following areas:

•  Status, statistics and projected usage of FTS and XRootD for Run3 and beyond.

• Storage access for analysis use, including performance and CPU efficiency with emphasis on realistic running conditions (e.g., local disk, EOS, Tier2, remote data access, with or without XCache).

• Data distribution management, needs and use-cases within scientific communities: data management needs of their community, frameworks used and how they integrate FTS and/or XRootD within their workflow.

• Structured input and future requirements from the experiments and community members on the FTS medium-to-long term evolution.

• R&D projects in the realm of data management, data access and data distribution within the Grid world are also invited. This could touch on integrating Cloud Storage within scientific data management workflows or Network projects aimed at optimizing data movements.

• Discussion on connected topics such as Authentication frameworks (IAM, CILogon, etc) and the role of FTS and XRootd for emerging communities (e.g.: SKAO) in the world of scientific data management .

We encourage you to submit the title of your talk, along with how much time you would like to have to present it, using the form at https://indico.cern.ch/event/1386888/abstracts/ . 

Should the title not be sufficiently explanatory, please include a sentence or two of context.

data pipeline for another project in SCD (FTS/xrootd/antares)

Oxford Xcache issues

discussed above

Rocky 8 and 9 migration planning

all gateways except the gridftp ones are upgraded,

1 of the managers is upgraded

Shoveller

@Katy Ellis

Shoveler installation and monitoring

Future developments ideas planning work

@Ian Johnson @Thomas, Jyothish (STFC,RAL,SC)

Notes from planning meeting 22-04-2024

Deletion studies through RDR

@Ian Johnson

Deletions

https://stfc.atlassian.net/browse/XRD-83

Planning for ALICE CMSD redirection

@Thomas, Jyothish (STFC,RAL,SC)

tests to be done

Checksums fixes

@Alexander Rogovskiy @Thomas, Jyothish (STFC,RAL,SC)

WNs are currently redirecting checksums to external gws

Prefetch studies and WN changes

@Alexander Rogovskiy

ipv6 DNS poisoning attempted, but rolled back

nullfs testing for xcache hit rate - full scale test on WN TBD

Tokens Status

@Thomas, Jyothish (STFC,RAL,SC) @Katy Ellis

CMSD Load balancing

@Thomas Byrne @Thomas, Jyothish (STFC,RAL,SC)

PR:
revised load balancing algorithm - weighed random selection by Jo-stfc · Pull Request #8 · stfc/xrootd

SKA Gateway box

@James Walder

https://stfc.atlassian.net/wiki/spaces/UK/pages/215941180

Xrootd testing framework

@Mariam Demir