Highlights from the art Users' Meeting, the FIFE workshop, and the - - PowerPoint PPT Presentation

▶
highlights from the art users meeting the fife workshop
SMART_READER_LITE
LIVE PREVIEW

Highlights from the art Users' Meeting, the FIFE workshop, and the - - PowerPoint PPT Presentation

Oct 31, 2022 271 likes •507 views

Highlights from the art Users' Meeting, the FIFE workshop, and the LArSoft Usability Workshop Tom Junk DUNE Software and Computing General Meeting June 27, 2016 First an Announcement: ProtoDUNE Science Workshop@CERN June 28 to June 30

slide-1
SLIDE 1

Highlights from the art Users' Meeting, the FIFE workshop, and the LArSoft Usability Workshop

Tom Junk DUNE Software and Computing General Meeting June 27, 2016

slide-2
SLIDE 2

First an Announcement: ProtoDUNE Science Workshop@CERN

  • June 28 to June 30
  • Indico Page:

https://indico.fnal.gov/conferenceDisplay.py?confId=12042

  • Chairs: Jarek Nowak, Donna Naples, Thomas Kutter, Cheng-

Ju Lin, Dorota Stefan

  • A line on the overview page says you need a LightWeight

CERN account to use Vidyo. Checking this – Vidyo allows

  • rganizers to invite non-registered participants too.

June 27, 2016 Tom Junk | Workshop Highlights 2

slide-3
SLIDE 3

art Users' Meeting Highlights

  • June 17, 2016. Indico page

https://indico.fnal.gov/conferenceOtherViews.py?view=standard&confId=12068

  • New art Fetures – Chris Green. FHiCL Features: Kyle Knoepfel
  • ROOT upgraded to V6 Now in LArSoft major release 6 (still only in release

candidates). LArSoft v06_00_00_rc3 depends on art v1_18_05 and root v6_04_06.

  • New art flags to turn on printing of available modules and descriptions
  • new executable: fhicl-dump which interprets FHiCL documents (a fcl file

and all of its includes) and prints out the intepreted parameter sets

  • FHiCL parameter validation (see Kyle's talk)
  • FHiCL parameters can now be protected from being overwritten
  • cetskelgen executable replaces artmod. Makes example module code
  • Failure of a producer to put its promised data product collection is now an
  • error. Be sure to put at least an empty collection

June 27, 2016 Tom Junk | Workshop Highlights 3

slide-4
SLIDE 4

art Users' Meeting Highlights

  • gallery – accessing art-formatted files without art – Marc

Paterno

  • API's for C++, Python, ROOT macros
  • lightweight
  • You open the file, you initiate the event loop
  • does not provide features for writing art ROOTfiles – write your own

trees or histograms or other output

June 27, 2016 Tom Junk | Workshop Highlights 4

slide-5
SLIDE 5

art Users' Meeting Highlights

  • Nice talk on Deep Learning in NOvA from Alexander Radovic
  • Look at the developing with Spack talk from Patrick Gartung
  • OS X versions 10.11 (El Capitan) onwards disable

DYLD_LIBRARY_PATH if System Integrity Protection (SIP) is turned on, breaking CET-built programs.

  • Spack is the Supercomputer package manager (LLNL)
  • uses rpaths instead of (DY)LD_LIBRARY_PATH
  • Runs on SLF*, Ubuntu, OS X; builds ROOT and G4
  • Needs some development to port current cmake files to run with it

for art-based programs

June 27, 2016 Tom Junk | Workshop Highlights 5

slide-6
SLIDE 6

FIFE Workshop Highlights

  • June 20-21, 2016. indico page

https://indico.fnal.gov/conferenceTimeTable.py?confId=12120#201 60620

June 27, 2016 Tom Junk | Workshop Highlights 6

Roadmap – Mike Kirby

slide-7
SLIDE 7

Tape media and library cost is ~ $30 / TB ($30K / PB) (T10KD, 8.5TB/tape)

  • Table below shows *addition* of:
  • FY16

16 PB $480K

  • FY17

17 PB $510K

  • FY18

29 PB $870K

SC-PMT : Tape Usage and Requests

June 27, 2016 Tom Junk | Workshop Highlights 7

Expt Current Use FY16 Addition FY17 Addition FY18 Addition Annie

  • 100

100 100 Captain-Minerva

  • 50

1,000 CDF

  • 4

4 4 CHIPS

  • 100

100 100 COUPP 30

  • DES
  • 600

1,200 1,200 DUNE 29 1,000 500 10,000 g-2

  • 2,000

3,000 3,000 Holometer

  • 50

50 50 LArIAT 4 25 25 25 MicroBoone 2,700 6,217 5,865 7,305 Minerva 1,040 1,600 1,800 2,100 Minos 518 200 100

  • Mu2e

317 250 250 250 Nova 5,237 4,000 4,000 4,000 SBND

  • 25

25 25 Seaquest 100

  • 100
  • Grand Total

9,975 16,171 17,169 29,159

Tape is a major cost! But needs are not easily predicted

Much of this originates from protoDUNEs at CERN at 200 MB/s rate

SC-PMT Process SC-PMT Slides

Margaret Votava Stu Fuess

slide-8
SLIDE 8

GP Grid Processing requests: Large memory or multi-core as single slot

June 27, 2016 8

Last year’s SC-PMT

2016 Capacity 2015 Capacity

Margaret Votava Stu Fuess

Tom Junk | Workshop Highlights

slide-9
SLIDE 9

June 27, 2016 Tom Junk | Workshop Highlights 9

FY16: How much computing so far

Over 83M wall clock hours

  • M. Votava
slide-10
SLIDE 10

June 27, 2016 Tom Junk | Workshop Highlights 10

Running jobs - offsite only

  • M. Votava
slide-11
SLIDE 11

June 27, 2016 Tom Junk | Workshop Highlights 11

Girl Scout Law

I will do my best to … use resources wisely, … make the world a better place, ….

Let’s make the world a better place – Margaret Votava

slide-12
SLIDE 12
  • Many OSG sites allow opportunistic use
  • f spare cycles:

– 231M hours across all VOs and all sites in the past year – 42M by mu2e alone – Most permit the Fermilab VO (any offsite jobs submitted via jobsub)

  • Individual experiments with collaborating

institutions that have grid sites:

– Mostly ATLAS/CMS sites either on OSG or EGI – In most cases accessible via the same OSG interface – Considered dedicated resources for that experiment – Most cases not by the entire Fermilab VO

  • Allocation-based HPC (supercomputers)

– Also can be accessible via OSG – Currently limited to two (NSF) sites

OSG:What’s out there?

June 2015-June 2016 Opportunistic use by all VOs 230,982,728 hours

Tanya Levshina

June 27, 2016 Tom Junk | Workshop Highlights 12

slide-13
SLIDE 13
  • Currently 18 OSG sites support the generic

Fermilab VO

– ATLAS (4) – CMS (9) – university HPC clusters (5)

  • What to expect on these sites

– All will have CVMFS – Multiple sites are now offering access to CVMFS/StashCache (useful for flux files access) – Most sites offer ~2GB RAM/core and ~35GB disk space but expect some variation – Most sites offer multicore slots: a way to get large memory jobs in. Most sites allow to request up to 8 cores. – Some of these sites are very large: Syracuse (SU-OG) will rival all of GPGrid at times just in opportunistic OSG running

OSG: General opportunistic

June 27, 2016 Tom Junk | Workshop Highlights 13

Tanya Levshina

slide-14
SLIDE 14
  • Most sites will

preempt

– Owner VOs can claim a slot back at any time – Your job will restart elsewhere if this occurs

  • Most sites do not
  • ffer any specific

quota for Fermilab VO jobs

– All opportunistic VOs are treated on the same footing

OSG: Preemption

June 27, 2016 Tom Junk | Workshop Highlights 14

Tanya Levshina

slide-15
SLIDE 15

FIFEMON

  • Talk by Ken Retzke
  • http://fifemon.fnal.gov
  • Use your Services username and password
  • Use it! It's very intuitive. Batch jobs, CPU, on-site, off-site
  • Dashboards can be bookmarked. A little too easy to get

sidetracked onto another experiments' pages.

June 27, 2016 Tom Junk | Workshop Highlights 15

slide-16
SLIDE 16

POMS

  • See Marc Mengel's talk
  • A tool developed for the OPOS group to help them manage job

submission and bookkeeping for multiple experiments.

  • With OPOS being phased out, SCD is working to make POMS

available directly to experiments

  • Many features in Marc's talk look as if they overlap with features

provided by Herb Greenlee's project.py

June 27, 2016 Tom Junk | Workshop Highlights 16

slide-17
SLIDE 17

Best-Practices Presentations

  • Too many to summarize here. The slides end up being vital

documentation moving forwards

  • Running on the OSG: Two talks by Ken Herner
  • Job Submissin with jobsub_client: Dennis Box
  • dCache – Dmitry Litvinsev (see especially access using XRootD

instructions and tips)

  • SAM – Robert Illingworth
  • FTS – Mike Diesburg
  • sam4users Penghei Ding

June 27, 2016 Tom Junk | Workshop Highlights 17

slide-18
SLIDE 18

LArSoft Usability Workshop Highlights

  • June 22-23, 2016. Indico page

https://indico.fnal.gov/conferenceOtherViews.py?view=standard&confId=11857

Highlights New features and efforts talk: Gianluca

  • Help with Associations: lar::PtrMaker (more readable than

CreateAssn())

  • Incremental Improvements to build system
  • Lots of work put into CI tests
  • Examples
  • Documentation

June 27, 2016 Tom Junk | Workshop Highlights 18

slide-19
SLIDE 19

LArSoft Workshop Highlights

  • Recommended talks on Code Review (Rob Kutchke, Erica

Snider)

  • See also Robert Hatcher's detailed view of GENIE and

GENIEHelper in nutools

  • Very Useful how-to-profile talk from Chris Jones – how to use

igprof (I watched Mike Wallbank profile his BlurredCluster module in minutes by copying and pasting commands out of Chris's talk given immediately before).

  • Expect more code reviews in the future – In LBNE we had them

as part of the requirements docuemnt, which is now copied into the Computing Model, DocDB 914

June 27, 2016 Tom Junk | Workshop Highlights 19

slide-20
SLIDE 20

Extras

June 27, 2016 Tom Junk | Workshop Highlights 20

slide-21
SLIDE 21

June 27, 2016 Tom Junk | Workshop Highlights 21

Igor Mandrichenko

slide-22
SLIDE 22

June 27, 2016 Tom Junk | Workshop Highlights 22

Igor Mandrichenko