justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79397.0@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79397.0@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3459
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 16:38:10
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-09-26 18:23:39
From worker nodeHostnamewn1207250.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 16:40:04
Input fileshd-protodune:np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410.hdf5
JobscriptExit code0
Real time1h (6109s)
CPU time1h (5437s = 88%)
Outputting started2024-09-26 18:21:55
Output fileshd-protodune-det-reco:np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410_reco_stage1_reco_stage2_20240926T182142_keepup.root
hd-protodune-det-reco:np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410_reco_stage1_reco_stage2_20240926T182142_keepup_hists.root
Finished2024-09-26 18:23:39
Saved logsjustin-logs:79397.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

5
6054 hits in TPC 6
3816 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 68 XUs and 148 XVs -> 5 XUVs
C:0 T:2 30328 XUs and 41233 XVs -> 1688 XUVs
C:0 T:3 95 XUs and 261 XVs -> 3 XUVs
C:0 T:4 66 XUs and 84 XVs -> 4 XUVs
C:0 T:5 23270 XUs and 38564 XVs -> 1603 XUVs
C:0 T:6 41869 XUs and 32680 XVs -> 1046 XUVs
C:0 T:7 192 XUs and 129 XVs -> 1 XUVs
4350 XUVs total
1515 collection wire objects
4350 potential space points
Neighbour search...
340912 tests to find 178782 neighbours
Iterating with no regularization...
Begin: 7.37676e+06
0 6.67055e+06
1 6.63701e+06
2 6.63147e+06
Now with regularization...
Begin: 6.26461e+06
0 6.26242e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  1   event 143557 TrkackID 3 startx, y, z 15.2035 546.992 454.174  wireno, peakt tpcno 331 4983.77 6 dist 424.287min T, max_T3968.81 5002.35
no of hits closeby  1   event 143557 TrkackID 3 startx, y, z 15.2035 546.992 454.174  wireno, peakt tpcno 331 4983.77 6 dist 424.287min T, max_T3968.81 5002.35
26-Sep-2024 19:21:42 BST  Closed output file "np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410_reco_stage1_reco_stage2_20240926T182142_keepup.root"
26-Sep-2024 19:21:42 BST  Closed input file "np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              92.0561       139.821       302.485       131.608       36.1812        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000506596   0.00322104    0.00579391    0.00338313    0.00145147       30     
produce:fembfilter:PDHDFEMBFilter                      0.694851      0.959929       1.0182       0.982618      0.0691043       30     
produce:wclsdatahd:WireCellToolkit                      49.4394       53.896        60.0678       53.8443       2.26517        30     
produce:gaushit:GausHitFinder                          0.546762       1.17172       1.90318       1.17519      0.288075        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000314954   0.000525643   0.000998224   0.00049806    0.000141044      30     
produce:reco3d:SpacePointSolver                        0.290776       2.14584       5.62634       1.65956       1.42164        30     
produce:hitpdune:DisambigFromSpacePoints               0.271602      0.944611       2.82356      0.845191       0.46276        30     
produce:pandora:StandardPandora                         7.67095       26.0764       143.833       19.6665       23.5571        30     
produce:pandoraWriter:StandardPandora                  0.161816      0.287304       0.39673      0.286418      0.0529059       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.878918       2.1432        3.61929       1.97157      0.634504        30     
produce:pandoraShower:LArPandoraShowerCreation          0.65477       2.47019       4.45657       2.42791      0.895425        30     
produce:pandoracalo:Calorimetry                        0.503416       1.04995       1.79993       1.04155      0.290308        30     
produce:pandoracalonosce:Calorimetry                   0.389893      0.928873       1.66434      0.880516      0.280312        30     
produce:pandorapid:Chi2ParticleID                     0.00178171    0.00287022     0.0054342    0.00288142    0.000687715      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.562026       2.14031       4.73261       2.11654      0.872463        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.605922       2.12662       4.70504       2.03224      0.878503        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.141516      0.250416      0.394439      0.257637       0.05745        30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0410921     0.0835011     0.126197      0.0813318     0.0195484       30     
produce:emtrkmichelid:EmTrackMichelId                   25.1494       40.5739       62.7177       40.4643       8.09088        30     
[art]:TriggerResults:TriggerResultInserter            2.3243e-05    5.80393e-05   0.000176343   5.5966e-05    2.70786e-05      30     
end_path:out1:RootOutput                               3.847e-06    8.4964e-06    3.4715e-05    6.9135e-06    5.50841e-06      30     
end_path:michelremoving:michelremoving                 0.0264723     0.149126      0.593147      0.060122      0.140394        30     
end_path:michelremovinggnocchi:michelremoving          0.0259571      0.14634      0.587631      0.0575926     0.138345        30     
end_path:calibanagnocchi:CalibAnaTree                  0.306076      0.757031       1.4137        0.72309       0.25974        30     
end_path:out1:RootOutput(write)                        0.828889       1.31192       1.99696       1.25575      0.276388        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4949.32 MB
  Peak resident set size usage (VmHWM): 2615.14 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410_reco_stage1_reco_stage2_20240926T182142_keepup.root
\tHists: np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410_reco_stage1_reco_stage2_20240926T182142_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410_reco_stage1_reco_stage2_20240926T182142_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410_reco_stage1_reco_stage2_20240926T182142_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727370636.0,
    "core.end_time": 1727374903.0,
    "core.events": [
      143317,
      143325,
      143333,
      143341,
      143349,
      143357,
      143365,
      143373,
      143381,
      143389,
      143397,
      143405,
      143413,
      143421,
      143429,
      143437,
      143445,
      143453,
      143461,
      143469,
      143477,
      143485,
      143493,
      143501,
      143509,
      143517,
      143525,
      143533,
      143541,
      143557
    ],
    "core.event_count": 30,
    "core.first_event_number": 143317,
    "core.last_event_number": 143557,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29125
    ],
    "core.runs_subruns": [
      2912500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410_reco_stage1_reco_stage2_20240926T182142_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727370636.0,
    "core.end_time": 1727374903.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29125
    ],
    "core.runs_subruns": [
      2912500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029125_0597_dataflow5_datawriter_0_20240911T043410.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:18:21 UTC       justIN version: 01.01.09