justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244815.46@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244815.46@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 08:07:00
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp_multicore
Last heartbeat2024-08-19 09:14:57
From worker nodeHostnamewn-lot-024.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 08:07:49
Input fileshd-protodune:np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951.hdf5
JobscriptExit code0
Real time1h (3959s)
CPU time1h (3674s = 92%)
Outputting started2024-08-19 09:13:49
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951_reco_stage1_reco_stage2_20240819T091339_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951_reco_stage1_reco_stage2_20240819T091339_keepup_hists.root
Finished2024-08-19 09:14:57
Saved logsjustin-logs:244815.46-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ith 89125 traces, 89125 summary
Retagger: tagging trace set: gauss with 65603 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 65603 traces tagged "gauss"
FrameSaver: q=1.50064e+06 n=1190537 tag=gauss
wclsFrameSaver: saving 89125 traces tagged "wiener"
FrameSaver: q=1.63814e+06 n=1076627 tag=wiener
2741 hits in TPC 0
1973 hits in TPC 1
7192 hits in TPC 2
4714 hits in TPC 3
6092 hits in TPC 4
5989 hits in TPC 5
10418 hits in TPC 6
6996 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 641 XUs and 192 XVs -> 23 XUVs
C:0 T:2 63445 XUs and 91466 XVs -> 6033 XUVs
C:0 T:3 94 XUs and 73 XVs -> 3 XUVs
C:0 T:4 62 XUs and 80 XVs -> 0 XUVs
C:0 T:5 63299 XUs and 69945 XVs -> 7216 XUVs
C:0 T:6 90044 XUs and 77833 XVs -> 1794 XUVs
C:0 T:7 282 XUs and 229 XVs -> 9 XUVs
15078 XUVs total
2918 collection wire objects
15078 potential space points
Neighbour search...
1811944 tests to find 796084 neighbours
Iterating with no regularization...
Begin: 1.89971e+07
0 1.61033e+07
1 1.58405e+07
2 1.57902e+07
3 1.57733e+07
4 1.57655e+07
Now with regularization...
Begin: 1.489e+07
0 1.48796e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 11:13:39 CEST  Closed output file "np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951_reco_stage1_reco_stage2_20240819T091339_keepup.root"
19-Aug-2024 11:13:39 CEST  Closed input file "np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              60.8686       93.7957       164.707       84.0071       23.0091        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000354685   0.00147437    0.00263419     0.0014337    0.000693119      30     
produce:fembfilter:PDHDFEMBFilter                      0.522848      0.572083      0.838486      0.550616      0.0637205       30     
produce:wclsdatahd:WireCellToolkit                      29.4953       34.9095       38.8489       37.0231       3.3945         30     
produce:gaushit:GausHitFinder                          0.369809      0.621786      0.926933      0.586784      0.131132        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000171552   0.000365107   0.000648957   0.000333691   0.000105979      30     
produce:reco3d:SpacePointSolver                        0.162646      0.990615       3.03809      0.618788      0.766109        30     
produce:hitpdune:DisambigFromSpacePoints               0.209493      0.512739       1.18507       0.46232      0.216431        30     
produce:pandora:StandardPandora                         4.77316       19.4005       76.743        13.6894       14.3782        30     
produce:pandoraWriter:StandardPandora                  0.0679741     0.145284      0.239748      0.138801      0.0366252       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.366766       1.16379       2.20085       1.02204      0.445286        30     
produce:pandoraShower:LArPandoraShowerCreation         0.342206       1.31075       2.52784       1.19208       0.5346         30     
produce:pandoracalo:Calorimetry                        0.210305      0.578873       1.01739      0.518388      0.190305        30     
produce:pandoracalonosce:Calorimetry                   0.186516      0.533963      0.963631      0.485598      0.183267        30     
produce:pandorapid:Chi2ParticleID                     0.00113391    0.00161497    0.00257631    0.00153683    0.000278991      30     
produce:pandoraShowercalo:ShowerCalorimetry             0.31215       1.18202       2.18465       1.09691      0.443484        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.303333       1.14636       2.11778       1.06367      0.427821        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0770236     0.127326      0.165559      0.126704      0.0198877       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0273826     0.0447779     0.0582263     0.0442021    0.00710999       30     
produce:emtrkmichelid:EmTrackMichelId                   16.1068       28.441         39.83        26.7669       5.98366        30     
[art]:TriggerResults:TriggerResultInserter            1.8054e-05    2.13437e-05   7.3608e-05    1.9737e-05    9.7282e-06       30     
end_path:out1:RootOutput                               4.117e-06    5.3059e-06     2.151e-05    4.5535e-06    3.10792e-06      30     
end_path:michelremoving:michelremoving                 0.0210072     0.0993475     0.267852      0.042782      0.0826865       30     
end_path:michelremovinggnocchi:michelremoving          0.020263      0.0959779     0.258949      0.0407642     0.0795409       30     
end_path:calibanagnocchi:CalibAnaTree                  0.225161      0.727319       1.23273      0.681917      0.247854        30     
end_path:out1:RootOutput(write)                        0.731946       1.08872       1.31537       1.09095      0.142961        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4956.2 MB
  Peak resident set size usage (VmHWM): 2634.33 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951_reco_stage1_reco_stage2_20240819T091339_keepup.root
\tHists: np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951_reco_stage1_reco_stage2_20240819T091339_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951_reco_stage1_reco_stage2_20240819T091339_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951_reco_stage1_reco_stage2_20240819T091339_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724055972.0,
    "core.end_time": 1724058819.0,
    "core.events": [
      383763,
      383771,
      383779,
      383787,
      383795,
      383803,
      383811,
      383819,
      383827,
      383835,
      383843,
      383851,
      383859,
      383867,
      383875,
      383883,
      383891,
      383899,
      383907,
      383915,
      383931,
      383939,
      383947,
      383955,
      383963,
      383971,
      383979,
      383987,
      383995,
      384003
    ],
    "core.event_count": 30,
    "core.first_event_number": 383763,
    "core.last_event_number": 384003,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951_reco_stage1_reco_stage2_20240819T091339_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724055972.0,
    "core.end_time": 1724058819.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1599_dataflow3_datawriter_0_20240819T041951.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:14:45 UTC       justIN version: 01.01.09