...
Lancaster: Gerard embarked and on a grand adventure in CEPH upgrades this week, first to the top of Pacific, then to Reef (all done whilst live). Nothing really important exploded, but the monitoring and dashboards have been finicky. In general smooth sailing though. In hindsight Gerard reckons he might well have skipped going to the top of Pacific first and just gone straight to Reef. On xroot, the LSST auth errors mentioned last week turned out to be on their side (they were using a defunct voms server to serve their proxies) - so not an xroot issue per se, but the fact that this impossible to debug from the xroot side is a huge niggle.
...