justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244283.3@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244283.3@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2865
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 01:20:18
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug
Last heartbeat2024-08-18 02:52:57
From worker nodeHostnamewn-sate-043.farm.nikhef.nl
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 01:22:11
Input fileshd-protodune:np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030.hdf5
Outputting started2024-08-18 02:51:42
Output files
Finished2024-08-18 02:52:57
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

auss
wclsFrameSaver: saving 121501 traces tagged "wiener"
FrameSaver: q=2.16225e+06 n=1438610 tag=wiener
9232 hits in TPC 0
6556 hits in TPC 1
8573 hits in TPC 2
3437 hits in TPC 3
5510 hits in TPC 4
9432 hits in TPC 5
13665 hits in TPC 6
7924 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3930 XUs and 3525 XVs -> 307 XUVs
C:0 T:2 85854 XUs and 84205 XVs -> 2489 XUVs
C:0 T:3 965 XUs and 1753 XVs -> 61 XUVs
C:0 T:4 30 XUs and 22 XVs -> 0 XUVs
C:0 T:5 35094 XUs and 61689 XVs -> 2299 XUVs
C:0 T:6 112807 XUs and 121569 XVs -> 4304 XUVs
C:0 T:7 602 XUs and 495 XVs -> 4 XUVs
9464 XUVs total
3605 collection wire objects
9464 potential space points
Neighbour search...
416794 tests to find 246762 neighbours
Iterating with no regularization...
Begin: 2.55577e+07
0 2.34962e+07
1 2.3387e+07
2 2.33732e+07
Now with regularization...
Begin: 2.22339e+07
0 2.22279e+07
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

18-Aug-2024 04:51:33 CEST  Closed output file "np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup.root"
18-Aug-2024 04:51:33 CEST  Closed input file "np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              93.1732       138.205       238.283       130.311       31.8106        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000583927   0.00273424    0.00507532    0.00297086    0.00134342       30     
produce:fembfilter:PDHDFEMBFilter                      0.676534      0.708396       1.37185      0.682754      0.123601        30     
produce:wclsdatahd:WireCellToolkit                      36.7212       41.0299       49.7804       38.7809       4.27569        30     
produce:gaushit:GausHitFinder                          0.579228      0.866188       1.27309      0.859762      0.168915        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000324119   0.000415592   0.00058027    0.000404555   7.17208e-05      30     
produce:reco3d:SpacePointSolver                        0.244204       1.35178       4.01832       1.09477      0.908336        30     
produce:hitpdune:DisambigFromSpacePoints               0.258038      0.654891       1.75759      0.638991       0.29832        30     
produce:pandora:StandardPandora                         8.51826       24.5504       66.6201       22.0563       12.3352        30     
produce:pandoraWriter:StandardPandora                  0.124358      0.198956      0.316671      0.203084      0.0408757       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.697176       2.67763       7.04169       2.3992        1.26537        30     
produce:pandoraShower:LArPandoraShowerCreation         0.701168       3.31771       8.95549       2.90134       1.73234        30     
produce:pandoracalo:Calorimetry                        0.390093       1.20119       3.45492       1.04184       0.59127        30     
produce:pandoracalonosce:Calorimetry                    0.3555        1.14492       3.32819       1.04962      0.571132        30     
produce:pandorapid:Chi2ParticleID                     0.00172403    0.00232507    0.00327219    0.00223888    0.000397474      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.663614       2.66857       8.52475       2.40123       1.56426        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.631946       2.54214       7.7726        2.25105       1.43891        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.109176      0.171724      0.252566      0.165564      0.037145        30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0380618     0.0614101     0.094541      0.0583936     0.0144737       30     
produce:emtrkmichelid:EmTrackMichelId                   35.0841       52.7104       79.7271       52.9858       11.0177        30     
[art]:TriggerResults:TriggerResultInserter            3.8642e-05    5.15304e-05   7.4981e-05    5.0961e-05    6.70505e-06      30     
end_path:out1:RootOutput                               8.606e-06    1.47248e-05   2.2342e-05    1.48325e-05   3.05169e-06      30     
end_path:michelremoving:michelremoving                 0.0269531     0.116644      0.334926      0.122405      0.0814178       30     
end_path:michelremovinggnocchi:michelremoving          0.0230131     0.111142      0.332964      0.115345      0.0835403       30     
end_path:calibanagnocchi:CalibAnaTree                  0.363347      0.842803       2.37571      0.732813      0.418253        30     
end_path:out1:RootOutput(write)                        0.685067       1.07039       1.64874       1.06871      0.225531        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4990.66 MB
  Peak resident set size usage (VmHWM): 2673.41 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup.root
\tHists: np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1723945300.0,
    "core.end_time": 1723949494.0,
    "core.events": [
      28308,
      28316,
      28324,
      28348,
      28356,
      28364,
      28372,
      28380,
      28388,
      28396,
      28404,
      28412,
      28420,
      28428,
      28436,
      28444,
      28452,
      28460,
      28468,
      28476,
      28484,
      28492,
      28500,
      28508,
      28516,
      28532,
      28540,
      28548,
      28556,
      28564
    ],
    "core.event_count": 30,
    "core.first_event_number": 28308,
    "core.last_event_number": 28564,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28759
    ],
    "core.runs_subruns": [
      2875900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1723945300.0,
    "core.end_time": 1723949494.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28759
    ],
    "core.runs_subruns": [
      2875900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:23:41 UTC       justIN version: 01.01.09