justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263053.146@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID263053.146@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3447
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 07:43:36
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce03
Last heartbeat2024-09-26 09:47:57
From worker nodeHostnameccwcondor0554
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 07:47:42
Input fileshd-protodune:np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913.hdf5
JobscriptExit code0
Real time58m (3519s)
CPU time56m (3394s = 96%)
Outputting started2024-09-26 08:46:22
Output fileshd-protodune-det-reco:np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913_reco_stage1_reco_stage2_20240926T084602_keepup.root
hd-protodune-det-reco:np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913_reco_stage1_reco_stage2_20240926T084602_keepup_hists.root
Finished2024-09-26 09:47:57
Saved logsjustin-logs:263053.146-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

t: gauss with 34235 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 34235 traces tagged "gauss"
FrameSaver: q=810732 n=627472 tag=gauss
wclsFrameSaver: saving 47652 traces tagged "wiener"
FrameSaver: q=904314 n=573055 tag=wiener
2468 hits in TPC 0
1835 hits in TPC 1
3518 hits in TPC 2
1821 hits in TPC 3
3058 hits in TPC 4
5156 hits in TPC 5
2928 hits in TPC 6
3045 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 16363 XUs and 23519 XVs -> 3856 XUVs
C:0 T:2 14205 XUs and 10354 XVs -> 218 XUVs
C:0 T:3 89 XUs and 151 XVs -> 5 XUVs
C:0 T:4 76 XUs and 119 XVs -> 4 XUVs
C:0 T:5 10553 XUs and 27587 XVs -> 1532 XUVs
C:0 T:6 17675 XUs and 14731 XVs -> 1216 XUVs
C:0 T:7 286 XUs and 285 XVs -> 3 XUVs
6834 XUVs total
1035 collection wire objects
6834 potential space points
Neighbour search...
1022790 tests to find 487894 neighbours
Iterating with no regularization...
Begin: 1.33029e+07
0 1.14175e+07
1 1.12286e+07
2 1.12141e+07
3 1.121e+07
Now with regularization...
Begin: 1.04828e+07
0 1.04796e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 10:46:02 CEST  Closed output file "np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913_reco_stage1_reco_stage2_20240926T084602_keepup.root"
26-Sep-2024 10:46:03 CEST  Closed input file "np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              60.641        86.2537       133.446       85.3841       15.7839        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00073118    0.00308106    0.00700614    0.00290613    0.00160384       30     
produce:fembfilter:PDHDFEMBFilter                      0.513932      0.645299      0.914411      0.627419      0.0992023       30     
produce:wclsdatahd:WireCellToolkit                      32.5053       37.4911       43.695        37.3313       3.06346        30     
produce:gaushit:GausHitFinder                          0.308365      0.627742       1.0165       0.670347      0.183607        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000199544   0.000328982   0.000476113   0.000326491   6.93527e-05      30     
produce:reco3d:SpacePointSolver                        0.222194       1.15055       3.04685      0.882632       0.79518        30     
produce:hitpdune:DisambigFromSpacePoints               0.130645      0.447971       1.19151      0.396593      0.241581        30     
produce:pandora:StandardPandora                         4.17194       10.4045       19.4601       9.72058       4.38857        30     
produce:pandoraWriter:StandardPandora                  0.0806427     0.139568       0.25759      0.129936      0.0427316       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.562519       1.72212       4.07392       1.62706      0.764961        30     
produce:pandoraShower:LArPandoraShowerCreation         0.721449       1.92494       5.78897       1.72881       1.01985        30     
produce:pandoracalo:Calorimetry                         0.30121      0.755862       1.91403      0.679166      0.342302        30     
produce:pandoracalonosce:Calorimetry                   0.288952      0.683119       1.44175       0.60905       0.29542        30     
produce:pandorapid:Chi2ParticleID                     0.00128499    0.00196344    0.00316208    0.00181483    0.000534438      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.468575       1.59927       3.56603       1.50433      0.788651        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.418772       1.52107       3.74551       1.42339      0.750139        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0606526      0.13493      0.336376      0.125439      0.0528893       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0208403     0.0466574     0.140816      0.0431742     0.0206802       30     
produce:emtrkmichelid:EmTrackMichelId                   16.5895       25.3603       42.0312       24.2933       5.9356         30     
[art]:TriggerResults:TriggerResultInserter            3.2972e-05    6.59298e-05   0.000134812   6.4696e-05    2.24088e-05      30     
end_path:out1:RootOutput                               8.817e-06    2.12612e-05   5.4402e-05    1.90405e-05   9.94213e-06      30     
end_path:michelremoving:michelremoving                 0.0227049     0.0778383     0.230677      0.0510802     0.0613466       30     
end_path:michelremovinggnocchi:michelremoving          0.018692      0.070093      0.235483      0.0494017     0.0559343       30     
end_path:calibanagnocchi:CalibAnaTree                   0.27042      0.565106       1.26977      0.501894      0.243545        30     
end_path:out1:RootOutput(write)                        0.404319      0.655957       1.07886       0.6348       0.153869        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4898.28 MB
  Peak resident set size usage (VmHWM): 2322.36 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913_reco_stage1_reco_stage2_20240926T084602_keepup.root
\tHists: np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913_reco_stage1_reco_stage2_20240926T084602_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913_reco_stage1_reco_stage2_20240926T084602_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913_reco_stage1_reco_stage2_20240926T084602_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727337734.0,
    "core.end_time": 1727340363.0,
    "core.events": [
      183107,
      183131,
      183139,
      183147,
      183155,
      183163,
      183171,
      183179,
      183187,
      183195,
      183203,
      183211,
      183219,
      183227,
      183235,
      183243,
      183251,
      183259,
      183267,
      183275,
      183283,
      183291,
      183299,
      183307,
      183315,
      183323,
      183331,
      183339,
      183347,
      183355
    ],
    "core.event_count": 30,
    "core.first_event_number": 183107,
    "core.last_event_number": 183355,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29081
    ],
    "core.runs_subruns": [
      2908100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913_reco_stage1_reco_stage2_20240926T084602_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727337734.0,
    "core.end_time": 1727340363.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29081
    ],
    "core.runs_subruns": [
      2908100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029081_0763_dataflow3_datawriter_0_20240905T045913.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:34:18 UTC       justIN version: 01.01.08