2024-12-12 Meeting Notes

 Date

Dec 12, 2024

 Participants

 

  • @Alexander Rogovskiy

  • @Katy Ellis

  • @James Walder

  • @Thomas Byrne

  • Lancs: Gerard, Matt, Steven

  • Glasgow:

Apologies:

 

  • Sam

CC:

 

 

 Goals

  • List of Epics

  • New tickets

  • Consider new functionality / items

  • Detailed discussion of important topics

  • Site report activity

 

 Discussion topics

Current status of Echo Gateways / WNs testing

Recent sandbox’s for review / deployments:

 

Item

Presenter

Notes

 

Item

Presenter

Notes

 

Operational Issues
Gateways and WNs:
- Current status and upcoming changes

(Gateway Auth failures)

 

 

Upgrades of GWs complete

Mini-DC challenge not perturbing RAL performance.

 

 

Checksums issue with an ATLAS file

 

[XrdCks] Checksum request during transfer locks partial file checksum into metadata for Ceph · Issue #2388 · xrootd/xrootd

https://ggus.eu/index.php?mode=ticket_info&ticket_id=169360

Checksum requested before whole file is updated. No ability to do stale checksum check in ceph, so original checksum ‘sticks’ to the file.

 

cms-aaa naming convention

 

cms-aaa is the only remaining personality to use proxy/ceph as the xrootd service names


Separate naming convention would be more appropriate, to have main/supporting

(not so urgent).

CC created, but due to be reviewed December

 

 

XRootD Managers De-VMWareification

@Thomas, Jyothish (STFC,RAL,SC)

Option 2 preferred for efficiency, but Option 1 decided on

Option 1 would be simpler to implement for a temporary fix, as the move would be reversed

antares tpc nodes to be moved to an echo leafsw, to confirm ipv4 real estate with James
lfsw30 (UPS room) decided on destination

 

Compilation and rollout status with XrdCeph and rocky 8: 5.7.x

@Thomas, Jyothish (STFC,RAL,SC)

5.7.2 published.
Investigating xrootd.redirect for write operations.

 

Shoveler

@Katy Ellis

Shoveler installation and monitoring

 

 

Deletion studies through RDR

@Ian Johnson

 

 

 

Deletions

https://stfc.atlassian.net/browse/XRD-83

 

 

XRootD Writable Workernode  Gateway Hackaton

 

@Thomas, Jyothish (STFC,RAL,SC)

XRootD Writable Workernode  Gateway Hackaton (XWWGH)

Tues 12th Nov 1600
Hackaton writeable workernode

Outcomes

 

Xrootd testing framework

 

XRootD Site Testing Framework

 

 

100 GbE Gateway testing:
SKA / Tier-1

@James Walder @Thomas, Jyothish (STFC,RAL,SC)

https://stfc.atlassian.net/wiki/spaces/UK/pages/215941180

 

image-20241212-125528.png
Average per-file transfer speeds (for 10 concurrent transfers, 1 or 5 GiB files)

 

 

UKSRC Storage Architecture

 

 

 

Tokens Status

 

  • Operational

  • Technical

  • Accounting

 

 

 

 Tom - Provided updates from Cephlacon

on GGUS:

Site reports

 

Lancaster: All our ceph troubles of the last week can be traced to users. Can we get rid of them?

Other then wishing for a user-free utopia, XRootD updated to 5.7.2 with no issues seen. Gerard has been working on tooling to make our ceph adminning easier.

 

Glasgow

 

 Action items

How to replace the original functionality of fstream monitoring, now opensearch has replaced existing solutions.

 

  •  

  •  

 

 Decisions