justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266114.11@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266114.11@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 01:24:18
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-29 03:38:11
From worker nodeHostnamewn1205090.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 01:26:44
Input fileshd-protodune:np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839.hdf5
JobscriptExit code0
Real time2h (7732s)
CPU time1h (6970s = 90%)
Outputting started2024-09-29 03:35:37
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839_reco_stage1_reco_stage2_20240929T033521_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839_reco_stage1_reco_stage2_20240929T033521_keepup_hists.root
Finished2024-09-29 03:38:11
Saved logsjustin-logs:266114.11-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

es, 66654 summary
Retagger: tagging trace set: gauss with 49379 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 49379 traces tagged "gauss"
FrameSaver: q=1.06116e+06 n=924694 tag=gauss
wclsFrameSaver: saving 66654 traces tagged "wiener"
FrameSaver: q=1.14137e+06 n=841530 tag=wiener
3036 hits in TPC 0
2841 hits in TPC 1
4506 hits in TPC 2
3306 hits in TPC 3
4154 hits in TPC 4
6462 hits in TPC 5
5136 hits in TPC 6
4955 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 8104 XUs and 7228 XVs -> 85 XUVs
C:0 T:2 8136 XUs and 11947 XVs -> 275 XUVs
C:0 T:3 119 XUs and 106 XVs -> 2 XUVs
C:0 T:4 112 XUs and 164 XVs -> 14 XUVs
C:0 T:5 23068 XUs and 23183 XVs -> 1033 XUVs
C:0 T:6 12757 XUs and 16726 XVs -> 546 XUVs
C:0 T:7 136 XUs and 202 XVs -> 10 XUVs
1965 XUVs total
1198 collection wire objects
1965 potential space points
Neighbour search...
31399 tests to find 18508 neighbours
Iterating with no regularization...
Begin: 5.23113e+06
0 4.96293e+06
1 4.94897e+06
2 4.94777e+06
Now with regularization...
Begin: 4.54577e+06
0 4.54528e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

29-Sep-2024 04:35:21 BST  Closed output file "np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839_reco_stage1_reco_stage2_20240929T033521_keepup.root"
29-Sep-2024 04:35:21 BST  Closed input file "np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              60.3333       149.583       300.17        145.34        46.9598        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00066809    0.00396118    0.00635784    0.00419218    0.00146603       39     
produce:fembfilter:PDHDFEMBFilter                      0.781366      0.961898       1.11627      0.972533      0.0575128       39     
produce:wclsdatahd:WireCellToolkit                      47.6918       56.834        71.6062       54.8991       5.44232        39     
produce:gaushit:GausHitFinder                          0.483642       1.19216       1.96725       1.14128      0.343494        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000319793   0.000561158   0.00121864    0.000530331   0.000161577      39     
produce:reco3d:SpacePointSolver                        0.337602       3.80356       22.4959       1.23133       5.22175        38     
produce:hitpdune:DisambigFromSpacePoints               0.296813       1.05206       3.27839      0.797208      0.689011        38     
produce:pandora:StandardPandora                         8.30286       24.0972       91.6087       19.3687       16.5488        38     
produce:pandoraWriter:StandardPandora                   0.13395      0.311481      0.571995      0.292505       0.09786        38     
produce:pandoraTrack:LArPandoraTrackCreation           0.428174       2.67371       8.73454       2.24545       1.59367        38     
produce:pandoraShower:LArPandoraShowerCreation         0.380012       3.53839       11.2042       3.04064       2.42029        38     
produce:pandoracalo:Calorimetry                        0.276778       1.32378       4.69842       1.13082      0.795562        38     
produce:pandoracalonosce:Calorimetry                   0.232602       1.22343       4.24963       1.03196      0.763774        38     
produce:pandorapid:Chi2ParticleID                     0.00207834    0.00311912    0.00529483    0.00301797    0.000678034      38     
produce:pandoraShowercalo:ShowerCalorimetry             0.33709       2.94209       7.78662       2.35324       1.83162        38     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.315128       2.89183       9.31698       2.34791       1.90024        38     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.112224      0.272897      0.423698      0.267063      0.0718933       38     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0368848     0.0935346     0.151686      0.089177      0.0260519       38     
produce:emtrkmichelid:EmTrackMichelId                   19.5023       45.9017       80.6708       45.8866       13.4992        38     
[art]:TriggerResults:TriggerResultInserter            2.9636e-05    5.97846e-05   9.9137e-05    6.0144e-05    1.53157e-05      39     
end_path:out1:RootOutput                               5.12e-06     1.00458e-05   2.9085e-05     8.997e-06    4.98118e-06      39     
end_path:michelremoving:michelremoving                4.7169e-05     0.155965      0.401867      0.0975796     0.124322        39     
end_path:michelremovinggnocchi:michelremoving         3.7761e-05     0.156763      0.424075      0.0987783     0.127169        39     
end_path:calibanagnocchi:CalibAnaTree                 4.3592e-05     0.889963       2.45527      0.746324      0.498718        39     
end_path:out1:RootOutput(write)                        0.640306       1.34584       2.29077       1.26186      0.402854        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5009.29 MB
  Peak resident set size usage (VmHWM): 2654.86 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839_reco_stage1_reco_stage2_20240929T033521_keepup.root
\tHists: np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839_reco_stage1_reco_stage2_20240929T033521_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839_reco_stage1_reco_stage2_20240929T033521_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839_reco_stage1_reco_stage2_20240929T033521_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727575024.0,
    "core.end_time": 1727580922.0,
    "core.events": [
      2498,
      2500,
      2502,
      2504,
      2506,
      2508,
      2510,
      2512,
      2514,
      2516,
      2518,
      2520,
      2522,
      2524,
      2526,
      2528,
      2530,
      2532,
      2534,
      2536,
      2538,
      2540,
      2542,
      2544,
      2546,
      2548,
      2550,
      2552,
      2554,
      2556,
      2558,
      2560,
      2562,
      2564,
      2566,
      2568,
      2570,
      2572,
      2574
    ],
    "core.event_count": 39,
    "core.first_event_number": 2498,
    "core.last_event_number": 2574,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839_reco_stage1_reco_stage2_20240929T033521_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727575024.0,
    "core.end_time": 1727580922.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0032_dataflow0_datawriter_0_20240929T002839.hdf5"
    }
  ]
}
justIN time: 2024-11-17 03:19:40 UTC       justIN version: 01.01.09