justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269441.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269441.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3589
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 18:21:24
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-10-05 02:21:48
From worker nodeHostnamedunegli-4177752-0-fnpc22012.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 01:11:42
Input fileshd-protodune:np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514.hdf5
JobscriptExit code0
Real time1h (4152s)
CPU time52m (3161s = 76%)
Outputting started2024-10-05 02:20:55
Output fileshd-protodune-det-reco:np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514_reco_stage1_reco_stage2_20241005T022049_keepup.root
hd-protodune-det-reco:np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514_reco_stage1_reco_stage2_20241005T022049_keepup_hists.root
Finished2024-10-05 02:21:34
Saved logsjustin-logs:269441.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

in TPC 4
3870 hits in TPC 5
4606 hits in TPC 6
2192 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7288 XUs and 5830 XVs -> 534 XUVs
C:0 T:2 2870 XUs and 2870 XVs -> 106 XUVs
C:0 T:3 84 XUs and 88 XVs -> 3 XUVs
C:0 T:4 64 XUs and 83 XVs -> 7 XUVs
C:0 T:5 9669 XUs and 10636 XVs -> 320 XUVs
C:0 T:6 9473 XUs and 8388 XVs -> 313 XUVs
C:0 T:7 118 XUs and 161 XVs -> 10 XUVs
1293 XUVs total
683 collection wire objects
1293 potential space points
Neighbour search...
35713 tests to find 22384 neighbours
Iterating with no regularization...
Begin: 9.41433e+06
0 9.10403e+06
1 9.08667e+06
2 9.08416e+06
Now with regularization...
Begin: 8.59804e+06
0 8.59698e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 11120 TrkackID 4 startx, y, z 89.7055 590.128 376.412  wireno, peakt tpcno 170 5 5 dist 0min T, max_T5 2305.71
no of hits closeby  0   event 11120 TrkackID 4 startx, y, z 89.7055 590.128 376.412  wireno, peakt tpcno 170 5 5 dist 0min T, max_T5 2305.71
05-Oct-2024 02:20:49 UTC  Closed output file "np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514_reco_stage1_reco_stage2_20241005T022049_keepup.root"
05-Oct-2024 02:20:49 UTC  Closed input file "np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              41.6646       64.3827       99.3729       60.6767       13.6336        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000350904   0.00185919    0.00702287     0.0015406    0.00136032       40     
produce:fembfilter:PDHDFEMBFilter                      0.563173      0.673125      0.891513      0.624425      0.0953705       40     
produce:wclsdatahd:WireCellToolkit                      22.9441       25.5102       33.5558       24.601        2.45202        40     
produce:gaushit:GausHitFinder                          0.287732      0.502426      0.864114       0.48904      0.140331        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000200811   0.000325027   0.000550382   0.000307482   7.12637e-05      40     
produce:reco3d:SpacePointSolver                        0.100581       1.33002       7.94004      0.481661       1.74917        40     
produce:hitpdune:DisambigFromSpacePoints               0.115048       0.43668       1.20243      0.365528      0.243199        40     
produce:pandora:StandardPandora                         3.04788       9.82212       28.092        8.27352       4.97193        40     
produce:pandoraWriter:StandardPandora                  0.0501595     0.107379      0.230011      0.106037      0.0346639       40     
produce:pandoraTrack:LArPandoraTrackCreation           0.369865      0.884099       1.95491      0.820914      0.331535        40     
produce:pandoraShower:LArPandoraShowerCreation         0.340784       1.04117       1.85957       0.90881       0.41853        40     
produce:pandoracalo:Calorimetry                        0.202743      0.477467       0.8093       0.451445      0.152358        40     
produce:pandoracalonosce:Calorimetry                   0.175289      0.446106      0.927274      0.427692       0.15611        40     
produce:pandorapid:Chi2ParticleID                     0.000945371   0.00147859    0.00279264    0.00138125    0.000422533      40     
produce:pandoraShowercalo:ShowerCalorimetry            0.309942       1.02603       2.05149      0.890264      0.434022        40     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.307808      0.985428       2.16993      0.854748      0.433482        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0521236     0.0892922      0.22428      0.0787022     0.0315313       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0159958     0.0318025     0.0794292     0.0285733     0.0120771       40     
produce:emtrkmichelid:EmTrackMichelId                   11.1243       19.759        32.9762       19.116        4.63994        40     
[art]:TriggerResults:TriggerResultInserter            1.3566e-05    2.41577e-05   0.000129906   2.0098e-05    1.82292e-05      40     
end_path:out1:RootOutput                               5.38e-06     1.14655e-05   4.0537e-05    1.03895e-05   5.15462e-06      40     
end_path:michelremoving:michelremoving                 0.0107154     0.0706432      0.23693      0.0420103     0.0658044       40     
end_path:michelremovinggnocchi:michelremoving          0.0109643     0.0682957     0.236879      0.0394036     0.0662906       40     
end_path:calibanagnocchi:CalibAnaTree                  0.189097      0.399669      0.803991      0.353035      0.162357        40     
end_path:out1:RootOutput(write)                        0.336301      0.621703       1.18148      0.604257      0.192885        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5028.64 MB
  Peak resident set size usage (VmHWM): 2697.09 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514_reco_stage1_reco_stage2_20241005T022049_keepup.root
\tHists: np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514_reco_stage1_reco_stage2_20241005T022049_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514_reco_stage1_reco_stage2_20241005T022049_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514_reco_stage1_reco_stage2_20241005T022049_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728092248.0,
    "core.end_time": 1728094850.0,
    "core.events": [
      11081,
      11082,
      11083,
      11084,
      11085,
      11086,
      11087,
      11088,
      11089,
      11090,
      11091,
      11092,
      11093,
      11094,
      11095,
      11096,
      11097,
      11098,
      11099,
      11100,
      11101,
      11102,
      11103,
      11104,
      11105,
      11106,
      11107,
      11108,
      11109,
      11110,
      11111,
      11112,
      11113,
      11114,
      11115,
      11116,
      11117,
      11118,
      11119,
      11120
    ],
    "core.event_count": 40,
    "core.first_event_number": 11081,
    "core.last_event_number": 11120,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27783
    ],
    "core.runs_subruns": [
      2778300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514_reco_stage1_reco_stage2_20241005T022049_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728092248.0,
    "core.end_time": 1728094850.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27783
    ],
    "core.runs_subruns": [
      2778300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027783_0277_dataflow0_datawriter_0_20240707T163514.hdf5"
    }
  ]
}
justIN time: 2024-11-24 12:07:28 UTC       justIN version: 01.01.09