justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 80354.8@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID80354.8@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3511
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 17:45:22
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2024-09-27 19:35:30
From worker nodeHostnamemh-7662-2.t2.ucsd.edu
cpuinfoAMD EPYC 7662 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 17:46:47
Input fileshd-protodune:np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017.hdf5
JobscriptExit code0
Real time1h (6430s)
CPU time1h (5141s = 79%)
Outputting started2024-09-27 19:33:59
Output fileshd-protodune-det-reco:np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017_reco_stage1_reco_stage2_20240927T193349_keepup.root
hd-protodune-det-reco:np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017_reco_stage1_reco_stage2_20240927T193349_keepup_hists.root
Finished2024-09-27 19:35:30
Saved logsjustin-logs:80354.8-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

55 XUs and 52 XVs -> 0 XUVs
C:0 T:1 4179 XUs and 4181 XVs -> 112 XUVs
C:0 T:2 24591 XUs and 26349 XVs -> 1136 XUVs
C:0 T:3 853 XUs and 1161 XVs -> 23 XUVs
C:0 T:4 131 XUs and 167 XVs -> 2 XUVs
C:0 T:5 12475 XUs and 12313 XVs -> 381 XUVs
C:0 T:6 25295 XUs and 19001 XVs -> 644 XUVs
C:0 T:7 1456 XUs and 1161 XVs -> 41 XUVs
2339 XUVs total
1305 collection wire objects
2339 potential space points
Neighbour search...
57243 tests to find 26806 neighbours
Iterating with no regularization...
Begin: 4.06665e+07
0 3.42955e+07
1 3.34955e+07
2 3.32817e+07
3 3.32208e+07
4 3.31898e+07
Now with regularization...
Begin: 3.12629e+07
0 3.12342e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  4   event 19177 TrkackID 1 startx, y, z 185.396 492.431 368.609  wireno, peakt tpcno 441 2306.51 2 dist 274.839min T, max_T5.23425 2379.85
no of hits closeby  4   event 19177 TrkackID 1 startx, y, z 185.396 492.431 368.609  wireno, peakt tpcno 441 2306.51 2 dist 274.839min T, max_T5.23425 2379.85
27-Sep-2024 12:33:49 PDT  Closed output file "np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017_reco_stage1_reco_stage2_20240927T193349_keepup.root"
27-Sep-2024 12:33:49 PDT  Closed input file "np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              69.0545       127.829       269.004       114.232       42.6876        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000612214   0.00289037    0.00602936    0.00281469    0.00152275       35     
produce:fembfilter:PDHDFEMBFilter                      0.644661      0.682665      0.723494      0.681005      0.0172741       35     
produce:wclsdatahd:WireCellToolkit                      31.3258       34.0404       36.8385       34.1665       1.07889        35     
produce:gaushit:GausHitFinder                          0.593284      0.882634       1.26088      0.874659      0.165456        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000298757   0.000479718   0.000709107   0.000457211   8.7255e-05       35     
produce:reco3d:SpacePointSolver                        0.256822       1.6638        5.51905       1.27884       1.15771        35     
produce:hitpdune:DisambigFromSpacePoints               0.362402      0.850326       1.83277      0.674444      0.377747        35     
produce:pandora:StandardPandora                          9.119        43.292        161.578       32.0855       32.6755        35     
produce:pandoraWriter:StandardPandora                  0.114279      0.204284      0.284007      0.194701      0.0396665       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.895036       2.47811       4.7875        2.31144      0.985797        35     
produce:pandoraShower:LArPandoraShowerCreation          1.04624       2.56698       4.53495       2.51629       1.00433        35     
produce:pandoracalo:Calorimetry                        0.486318       1.14386       2.14567       1.01781      0.430363        35     
produce:pandoracalonosce:Calorimetry                   0.440726       1.07483       2.03702      0.959966      0.413602        35     
produce:pandorapid:Chi2ParticleID                      0.0015977    0.00242406    0.00396488    0.00235365    0.000494698      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.938313       2.2517        4.09924       2.07196      0.906948        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.861131       2.12343       3.79159       1.9489       0.857693        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.110533      0.157771      0.210869      0.153505      0.0279629       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0354946     0.055089      0.0738863     0.0538212    0.00987361       35     
produce:emtrkmichelid:EmTrackMichelId                   20.286        32.1531       45.1683       31.4269       5.78294        35     
[art]:TriggerResults:TriggerResultInserter            2.1521e-05    3.07915e-05   9.4503e-05    2.6031e-05    1.44933e-05      35     
end_path:out1:RootOutput                               9.11e-06     1.11886e-05   3.0361e-05    1.0411e-05    3.6526e-06       35     
end_path:michelremoving:michelremoving                 0.0240588     0.0647111     0.200543      0.0363016     0.0518837       35     
end_path:michelremovinggnocchi:michelremoving          0.0215244     0.0623655     0.194598      0.0324506     0.052292        35     
end_path:calibanagnocchi:CalibAnaTree                  0.345008      0.863535       1.5994       0.815362      0.334349        35     
end_path:out1:RootOutput(write)                        0.682728       1.06874       1.53362       1.0658       0.199564        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5058.36 MB
  Peak resident set size usage (VmHWM): 2712.63 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017_reco_stage1_reco_stage2_20240927T193349_keepup.root
\tHists: np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017_reco_stage1_reco_stage2_20240927T193349_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017_reco_stage1_reco_stage2_20240927T193349_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017_reco_stage1_reco_stage2_20240927T193349_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727461118.0,
    "core.end_time": 1727465630.0,
    "core.events": [
      19041,
      19045,
      19049,
      19053,
      19057,
      19061,
      19065,
      19069,
      19073,
      19077,
      19081,
      19085,
      19089,
      19093,
      19097,
      19101,
      19105,
      19109,
      19113,
      19117,
      19121,
      19125,
      19129,
      19133,
      19137,
      19141,
      19145,
      19149,
      19153,
      19157,
      19161,
      19165,
      19169,
      19173,
      19177
    ],
    "core.event_count": 35,
    "core.first_event_number": 19041,
    "core.last_event_number": 19177,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017_reco_stage1_reco_stage2_20240927T193349_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727461118.0,
    "core.end_time": 1727465630.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0136_dataflow1_datawriter_0_20240621T042017.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:27:18 UTC       justIN version: 01.01.08