Workshop on ATLAS Computing and Software Activities at BNL - Navigating Distributed Computing, Storage, Compute, and Beyond

Name: Workshop on ATLAS Computing and Software Activities at BNL - Navigating Distributed Computing, Storage, Compute, and Beyond
Start: 2024-03-18T09:00:00-04:00
End: 2024-03-22T16:00:00-04:00
Location: Berkner Hall

18 Mar 2024, 09:00 → 22 Mar 2024, 16:00 US/Eastern

Main Hall (Berkner Hall)

Main Hall

Berkner Hall

b488

Torre Wenaus (BNL), Vincent Garonne, alexei klimentov (bnl)

Description

This workshop jointly organized by BNL's Scientific Data and Computing Center (SDCC) and Nuclear and Particle Physics Software (NPPS) Group will be a discussion-oriented technical gathering to address ATLAS computing and software activities at BNL as Run-3 progresses and the HL-LHC approaches. The first half of the week will address an array of topics with distributed computing a common theme. It will include round table discussions on computing and software activities and R&D, with contributions from leaders, developers, junior colleagues and students, offering people a forum to present and discuss their work and plans. The latter half of the week will address storage topics, including technical discussions on dCache development among dCache core developers and the SDCC development team.

An outcome of the workshop will be a short summary white paper that will inform BNL computing and software planning in the months ahead.

The zoom link for the Monday sessions is https://bnl.zoomgov.com/j/1617851500?pwd=dDlianpiQ29ScVBvaS8rTFBEZXhWdz09

All zoom links are conveniently visible on the standard agenda view

Live notes

Participants

56 View full list

Monday 18 March
- 09:30 → 09:40
  
  NPP Directorate Welcome 10m Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
  
  Zoom: https://bnl.zoomgov.com/j/1617851500?pwd=dDlianpiQ29ScVBvaS8rTFBEZXhWdz09
  
  Speaker: Dmitri Denisov (Brookhaven National Laboratory)
  
  Workshop Introduction.pptx
- 09:40 → 10:10
  
  Workshop logistics, goals, SDCC/NPPS intro 30m Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
  
  Zoom: https://bnl.zoomgov.com/j/1617851500?pwd=dDlianpiQ29ScVBvaS8rTFBEZXhWdz09
  
  Speakers: Torre Wenaus (BNL), alexei klimentov (bnl)
  
  SDCC-NPPS-Workshop-Intro-202403.pdf
- 10:10 → 10:40
  
  ATLAS SW&C goals, challenges and opportunities for collaboration 30m Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
  
  Zoom: https://bnl.zoomgov.com/j/1617851500?pwd=dDlianpiQ29ScVBvaS8rTFBEZXhWdz09
  
  Speakers: Dr Andreu Pacheco Pages (IFAE), David South (DESY), David South (TU Dortmund), Mario Lassnig (CERN)
  
  20240318 ATLAS S&C at BNL (1).pdf
- 10:40 → 12:40
  HEP-CCE project and opportunities for collaboration Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
  
  Zoom: https://bnl.zoomgov.com/j/1617851500?pwd=dDlianpiQ29ScVBvaS8rTFBEZXhWdz09
  
  Convener: Meifeng Lin (Brookhaven National Laboratory)
  - 10:40
    
    HEP-CCE Overview and BNL Responsibilities 20m
    
    Speaker: Meifeng Lin (Brookhaven National Laboratory)
    
    HEP-CCE_intro_ATLAS_BNL_Workshop_Mar2024.pdf
  - 11:00
    
    Portable Applications and Workflows [Remote] 10m
    
    Speaker: Charles Leggett (Lawrence Berkeley National Laboratory)
    
    ATLAS BNL Workshop HEP-CCE Portable Applications and Workflows.pdf
  - 11:10
    
    Optimizing Data Storage [Remote] 10m
    
    Speaker: Peter Van Gemmeren (Argonne National Laboratory)
    
    HEP-CCE_SOP.pdf
    
    HEP-CCE_SOP.pptx
  - 11:20
    
    Coffee Break 20m
  - 11:40
    
    Scaling ML Workflows 30m
    
    Speaker: Paolo Calafiura (Lawrence Berkeley National Laboratory)
    
    March BNL HEP-CCE Scaling ML (1).pdf
    
    slides
  - 12:10
    
    Opportunities for Collaboration and Discussion 30m
- 12:40 → 13:00
  
  IRIS-HEP and opportunities for collaboration 20m Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
  
  Zoom: https://bnl.zoomgov.com/j/1617851500?pwd=dDlianpiQ29ScVBvaS8rTFBEZXhWdz09
  
  Speaker: Gordon Watts (University of Washington)
  
  2024-03-18 - BNL Collaborations (7).pdf
- 13:00 → 14:00
  
  Lunch 1h Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
- 14:00 → 16:20
  SDCC and NPPS lightning talks Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
  
  Zoom: https://bnl.zoomgov.com/j/1617851500?pwd=dDlianpiQ29ScVBvaS8rTFBEZXhWdz09
  
  Convener: Tony Wong (Brookhaven National Lab (Physics Department))
  - 14:00
    
    ARM software usage in ATLAS 12m
    
    Speaker: Johannes Elmsheuser (BNL)
    
    b_180324.pdf
  - 14:12
    
    SDCC R&D on non-x86 cpu architectures 10m
    
    Speaker: Kevin Casella (SDCC)
    
    SDCC_RD_LightningTalk.pptx
  - 14:22
    
    AlmaLinux 9 developments at the SDCC 10m
    
    Speaker: Costin Caramarcu (BNL-RACF)
    
    Alma 9.pdf
  - 14:32
    
    Applications of PanDA/iDDS complex workflows 12m
    
    Speakers: Tadashi Maeno (BNL), Wen Guan (BNL)
    
    panda_idds_sdcc_npps.pptx-5.pdf
  - 14:44
    
    PanDA/Harvester/FuncX on HPC 12m
    
    Speaker: Tianle Wang (Columbia University)
    
    Funcx with harvester.pdf
  - 14:56
    
    The HSF reference implementation conditions database 12m
    
    Speakers: Lino Gerlach, Ruslan Mashinistov (BNL)
    
    conditions_db_reference_implementation_npps_2024 4.pdf
  - 15:08
    
    Training on analysis reproducibility in the HSF 12m
    
    Speaker: Michel Hernandez Villanueva (BNL)
    
    HSF Training Analysis preservation - BNL Lighthing.pdf
  - 15:20
    
    Sustainability and the Environment studies at SDCC 12m
    
    Speaker: Imran Latif
    
    Sustainability Studies.pdf
  - 15:32
    
    HPSS Batch system @BNL T1 10m
    
    Speaker: Justin Spradley
    
    HPSS Batch Application.pdf
    
    HPSS Batch Application.pptx
  - 15:42
    
    BNL Networks 13m
    
    Speaker: Mark Lukasczyk (Network Engineer)
    
    Mark - ATLAS SW&C Workshop - Networking Lightning Talk.pdf
  - 15:55
    
    OKD/OpenShift 12m
    
    Speaker: Tommy Tang
    
    USATLAS-Lightning_Talk.pdf
- 16:20 → 17:40
  
  round table discussion 1h 20m Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
  
  Zoom: https://bnl.zoomgov.com/j/1617851500?pwd=dDlianpiQ29ScVBvaS8rTFBEZXhWdz09
- 17:40 → 18:00
  
  Day 1 : wrap up 20m Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
  
  Zoom: https://bnl.zoomgov.com/j/1617851500?pwd=dDlianpiQ29ScVBvaS8rTFBEZXhWdz09
- 18:50 → 20:50
  
  Dinner 2h Tap Room
  
  Tap Room
  
  114 W Main St, Patchogue, NY
  
  Workshop dinner at Tap Room in Patchogue. Registration is now closed. If you would still like to attend, please contact the workshop conveners.
Tuesday 19 March
- 09:00 → 10:20
  
  SDCC computing center visit 1h 20m Lobby (Building 725)
  
  Lobby
  
  Building 725
  
  Speaker: John McCarthy (Brookhaven National Laboratory)
- 10:20 → 12:40
  ATLAS SW&C Coordination and L1/L2 managers meetings with SDCC & NPPS staff I ITD Seminar Room (Bldg. 515)
  
  ITD Seminar Room
  
  Bldg. 515
  
  SDCC group
  - 10:20
    
    Storage and Infrastructure Group 45m
    
    Speakers: Jason Smith (RACF/SDCC), Joe Frith (PO BOX 5000)
    
    Storage_Infrastructure_Group.pptx
  - 11:05
    
    Fabrics Group, Networking & SDCC Facilities Operations 45m
    
    Speakers: Mark Lukasczyk (Network Engineer), Tony Wong (Brookhaven National Lab (Physics Department))
    
    Fabric_Group_Introduction.pdf
  - 11:50
    
    Services and Tools Group 45m
    
    Speaker: Ofer Rind (BNL)
    
    Services & Tools Group.pdf
- 10:20 → 12:40
  
  REDWOOD project splinter meeting I conference room A (Bldg 725)
  
  conference room A
  
  Bldg 725
  
  Bldg.725 conference room A Here is the ZOOM information forr the Tuesday March 19, 2024 10:20AM-12:40PM REDWOOD project Splinter Meeting I, which is Adolfy’s session to be held in Conference A in Bldg 725, https://bnl.zoomgov.com/j/1606948065?pwd=R1BJL0hPMVlKK2RmbS9VM2NYSkF3QT09 Meeting ID: 160 694 8065 Passcode: 949591
  
  Conveners: Dr Adolfy Hoisie (BNL/CSI), Dr Scott Klasky (ORNL)
- 12:40 → 13:40
  
  lunch 1h Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
- 13:00 → 14:00
  
  ATLAS SW&C Coordination and L1/L2 managers meeting with SDCC and NPPS staff II 1h ITD seminar room (B.515)
  
  ITD seminar room
  
  B.515
  
  NPPS Group
  NPPS zoom room
  
  Speaker: Torre Wenaus (BNL)
- 13:40 → 14:40
  
  REDWOOD Project splinter meeting II conference room A (Bldg 725)
  
  conference room A
  
  Bldg 725
  
  Bldg.725 conference room A Here is the ZOOM information forr the Tuesday March 19, 2024 10:20AM-12:40PM REDWOOD project Splinter Meeting I, which is Adolfy’s session to be held in Conference A in Bldg 725, https://bnl.zoomgov.com/j/1606948065?pwd=R1BJL0hPMVlKK2RmbS9VM2NYSkF3QT09 Meeting ID: 160 694 8065 Passcode: 949591
  
  Conveners: Joseph Boudreau (University of Pittsburgh), Scott Klasky (ORNL), Verena Martinez Outschoorn (University of Massachusetts (US))
- 15:00 → 16:30
  
  Executive session 1h 30m orange seminar room (Bldg 510)
  
  orange seminar room
  
  Bldg 510
  
  ATLAS SW&C & ADC coordination
  US ATLAS L1/L2 Managers
  NPPS and SDCC Leadership teams
  
  Speaker: alexei klimentov (bnl)
Wednesday 20 March
- 08:55 → 10:25
  
  sPHENIX Visit 1h 30m Bldg.1008
  
  Bldg.1008
- 10:25 → 13:10
  Storage: Storage evolution ITD Seminar Room (SDCC Building)
  
  ITD Seminar Room
  
  SDCC Building
  
  b515 https://www.bnl.gov/maps/point.php?Lat=40.86900&Lng=-72.87899 https://bnl.zoomgov.com/j/1602281170?pwd=WGRXNDlCaDFHUHRVa2dxTDFkcjBrUT09 Meeting ID: 160 228 1170 Passcode: 728169
  
  Conveners: Jason Smith (RACF/SDCC), Tigran Mkrtchyan (DESY), Vincent Garonne
  - 10:25
    
    Storage evolution for HEP / ATLAS 30m
    
    Speaker: Vincent Garonne
    
    Evolution of Storage in High Energy Physics
  - 10:55
    
    Exploring Cloud Storage Integration: The SEAL Case Study 20m
    
    Speakers: Mr Mario Lassnig (CERN), Mr Mayank Sharma (University of Michigan)
    
    SEAL_Case_Study_BNL_21_03_34_v1.pdf
  - 11:15
    
    dCache Status and Plans 30m
    
    Speaker: Tigran Mkrtchyan (DESY)
    
    dcache-update.pdf
  - 11:45
    
    Break 20m
  - 12:05
    
    smart writing 30m
    
    Speaker: Xin Zhao (BNL)
    
    Data Carousel and tape smart writing.pdf
- 13:10 → 14:40
  
  lunch 1h 30m Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
- 14:40 → 17:30
  Storage ITD Seminar Room (SDCC Building)
  
  ITD Seminar Room
  
  SDCC Building
  
  b515 https://www.bnl.gov/maps/point.php?Lat=40.86900&Lng=-72.87899
  
  ITD Seminar Room (SDCC Building)
  b515 https://www.bnl.gov/maps/point.php?Lat=40.86900&Lng=-72.87899
  https://bnl.zoomgov.com/j/1602281170?pwd=WGRXNDlCaDFHUHRVa2dxTDFkcjBrUT09
  Meeting ID: 160 228 1170
  Passcode: 728169
  - 14:40
    
    Introduction 5m
    
    Speaker: Vincent Garonne
    
    Dinner - 03-20-2024
  - 14:45
    
    dCache@BNL 30m
    
    Speaker: Carlos Fernando Gamboa (BNL)
    
    BNL dCache workshop 2024-2.pdf
    
    dCache@BNL
  - 15:15
    
    dCache pools: File system settings, tuning and experiences 20m
    
    Speaker: robert hancock (bnl)
  - 15:35
    
    break 20m
  - 15:55
    
    dCache: Packet and flow marking 20m
    
    Speakers: Shawn McKee (University of Michigan Physics), Tigran Mkrtchyan (DESY)
    
    dcache-update_v2.pdf
    
    Scitags
  - 16:15
    
    BNL dCache Network 20m
    
    Speaker: Shigeki Misawa (BNL)
    
    Copy of BNL-dCache-Network.pdf
Thursday 21 March
- 09:30 → 12:30
  Storage: Tape 3-192
  
  3-192
  
  ITD Seminar Room (SDCC Building)
  b515 https://www.bnl.gov/maps/point.php?Lat=40.86900&Lng=-72.87899
  https://bnl.zoomgov.com/j/1602281170?pwd=WGRXNDlCaDFHUHRVa2dxTDFkcjBrUT09
  Meeting ID: 160 228 1170
  Passcode: 728169
  - 10:00
    
    HPSS@SDCC: Status, Interface and evolution 30m
    
    Speaker: Tim Chou (Brookhaven National Laboratory)
    
    WorkShopHpssAtlas2024.pdf
  - 10:30
    
    ENDIT@BNL 25m
    
    Speaker: Zhenping Liu (Brookhaven Nation Laboratory)
    
    20240321_JaneLiu_endit.pdf
    
    20240321_JaneLiu_endit.pptx
  - 10:55
    
    Break 20m
  - 11:15
    
    Tape writing and reading algorithm 20m
    
    Speaker: Wei Yang (SLAC National Accelerator Laboratory)
    
    Rubin Tape RSE
  - 11:35
    
    Tape REST interface and its usage at BNL (TBC) 20m
    
    Configuration, feedback, etc
    
    SciTags from dCache
- 12:30 → 14:00
  
  Lunch 1h 30m Main Hall
  
  Main Hall
  
  Berkner Hall
  
  b488
- 14:00 → 15:00
  Storage: R&D 3-192
  
  3-192
  
  ITD Seminar Room (SDCC Building)
  b515 https://www.bnl.gov/maps/point.php?Lat=40.86900&Lng=-72.87899
  https://bnl.zoomgov.com/j/1602281170?pwd=WGRXNDlCaDFHUHRVa2dxTDFkcjBrUT09
  Meeting ID: 160 228 1170
  Passcode: 728169
  - 14:00
    
    dCache usage analysis@BNL 20m
    
    Speakers: James Leonardi, Qiulan Huang
    
    AI-based Data Popularity, Placement Optimization for a Novel Multi-tiered Storage System at BNL_SDCC Facility .pdf
  - 14:20
    
    dCache discusion: Operations, improvements, etc 30m
    
    Speaker: Qiulan Huang
    
    dCache Discussion.pdf

Workshop on ATLAS Computing and Software Activities at BNL - Navigating Distributed Computing, Storage, Compute, and Beyond

Main Hall

Berkner Hall

Main Hall

Berkner Hall

Main Hall

Berkner Hall

Main Hall

Berkner Hall

Main Hall

Berkner Hall

Main Hall

Berkner Hall

Main Hall

Berkner Hall

Main Hall

Berkner Hall

Main Hall

Berkner Hall

Main Hall

Berkner Hall

Tap Room

Lobby

Building 725

ITD Seminar Room

Bldg. 515

conference room A

Bldg 725

Main Hall

Berkner Hall

ITD seminar room

B.515

conference room A

Bldg 725

orange seminar room

Bldg 510

Bldg.1008

ITD Seminar Room

SDCC Building

Main Hall

Berkner Hall

ITD Seminar Room

SDCC Building

3-192

Main Hall

Berkner Hall

3-192