justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59394.112@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59394.112@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 18:21:11
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk
Last heartbeat2024-08-18 20:34:42
From worker nodeHostnamewn-choc-032.farm.nikhef.nl
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statestalled
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 19:09:21
Input fileshd-protodune:np04hd_raw_run028762_0569_dataflow4_datawriter_0_20240818T175139.hdf5
Outputting started2024-08-18 20:34:42
Output files
Finished2024-08-18 20:48:52
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

XVs -> 169 XUVs
C:0 T:7 113 XUs and 236 XVs -> 11 XUVs
4121 XUVs total
1432 collection wire objects
4121 potential space points
Neighbour search...
156633 tests to find 83986 neighbours
Iterating with no regularization...
Begin: 3.03166e+07
0 2.76261e+07
1 2.73031e+07
2 2.72535e+07
3 2.72406e+07
Now with regularization...
Begin: 2.61317e+07
0 2.61221e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 136836 TrkackID 5 startx, y, z 16.8531 583.177 404.876  wireno, peakt tpcno 1 10.2821 5 dist 0.340938min T, max_T5.3149 2713.09
no of hits closeby  0   event 136836 TrkackID 8 startx, y, z 67.3037 479.951 6.58883  wireno, peakt tpcno 175 4363.13 2 dist 278.571min T, max_T2802 4401.99
no of hits closeby  0   event 136836 TrkackID 5 startx, y, z 16.8531 583.177 404.876  wireno, peakt tpcno 1 10.2821 5 dist 0.340938min T, max_T5.3149 2713.09
no of hits closeby  0   event 136836 TrkackID 8 startx, y, z 67.3037 479.951 6.58883  wireno, peakt tpcno 175 4363.13 2 dist 278.571min T, max_T2802 4401.99
18-Aug-2024 22:34:34 CEST  Closed output file "np04hd_raw_run028762_0569_dataflow4_datawriter_0_20240818T175139_reco_stage1_reco_stage2_20240818T203434_keepup.root"
18-Aug-2024 22:34:34 CEST  Closed input file "np04hd_raw_run028762_0569_dataflow4_datawriter_0_20240818T175139_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                               88.46        123.945       166.292       119.793       23.3847        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000439358   0.00211959    0.00422338    0.00202339    0.00111657       30     
produce:fembfilter:PDHDFEMBFilter                      0.700852      0.725412      0.883275      0.710609      0.0431777       30     
produce:wclsdatahd:WireCellToolkit                      45.566        46.8039       48.5109       46.9052      0.706741        30     
produce:gaushit:GausHitFinder                          0.643802      0.967128       1.25681      0.972372      0.167861        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000338989   0.000446378   0.000555358   0.000447152   6.23304e-05      30     
produce:reco3d:SpacePointSolver                        0.315331       1.43382       2.83269       1.4184       0.707516        30     
produce:hitpdune:DisambigFromSpacePoints               0.362673      0.803277       1.34714      0.809343      0.307301        30     
produce:pandora:StandardPandora                         9.64431       28.1019       63.7091       23.0727       14.2033        30     
produce:pandoraWriter:StandardPandora                  0.134302      0.194002      0.248083      0.202287      0.0329937       30     
produce:pandoraTrack:LArPandoraTrackCreation            1.0902        2.62376       4.89163       2.78012       1.00371        30     
produce:pandoraShower:LArPandoraShowerCreation          1.21201       2.6339        4.94972       2.6338        1.05635        30     
produce:pandoracalo:Calorimetry                        0.616208       1.11696       1.84551       1.07766      0.364858        30     
produce:pandoracalonosce:Calorimetry                    0.55655       1.03357       1.77463       1.00995      0.345007        30     
produce:pandorapid:Chi2ParticleID                     0.00143592    0.00235055    0.00379822    0.00235687    0.000476156      30     
produce:pandoraShowercalo:ShowerCalorimetry             1.06264       2.15649       3.73338       2.14274      0.808196        30     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.02517       2.05313       3.68653       2.04843      0.764092        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry           0.10894      0.157998      0.216113      0.161681      0.0307898       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0375487     0.0577032     0.0804178     0.0580557     0.0114891       30     
produce:emtrkmichelid:EmTrackMichelId                   22.379        31.0417       40.1466       31.6154        5.27          30     
[art]:TriggerResults:TriggerResultInserter            2.1328e-05    3.62457e-05   8.7725e-05    3.4134e-05    1.26998e-05      30     
end_path:out1:RootOutput                               8.047e-06    1.02685e-05   2.8339e-05     9.206e-06    3.64477e-06      30     
end_path:michelremoving:michelremoving                 0.0293732     0.0683268     0.328079      0.0411219     0.0652198       30     
end_path:michelremovinggnocchi:michelremoving          0.0261615     0.0650501      0.32169      0.0356076     0.0643211       30     
end_path:calibanagnocchi:CalibAnaTree                  0.381261      0.812316       1.34367      0.771606       0.27051        30     
end_path:out1:RootOutput(write)                        0.713988      0.971277       1.2737        0.96479      0.170494        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4925.93 MB
  Peak resident set size usage (VmHWM): 2612.2 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_0569_dataflow4_datawriter_0_20240818T175139_reco_stage1_reco_stage2_20240818T203434_keepup.root
\tHists: np04hd_raw_run028762_0569_dataflow4_datawriter_0_20240818T175139_reco_stage1_reco_stage2_20240818T203434_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_0569_dataflow4_datawriter_0_20240818T175139_reco_stage1_reco_stage2_20240818T203434_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_0569_dataflow4_datawriter_0_20240818T175139_reco_stage1_reco_stage2_20240818T203434_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724009512.0,
    "core.end_time": 1724013274.0,
    "core.events": [
      136540,
      136572,
      136580,
      136588,
      136596,
      136604,
      136612,
      136620,
      136628,
      136636,
      136644,
      136652,
      136660,
      136668,
      136676,
      136684,
      136692,
      136700,
      136708,
      136716,
      136724,
      136732,
      136740,
      136748,
      136756,
      136764,
      136772,
      136780,
      136788,
      136836
    ],
    "core.event_count": 30,
    "core.first_event_number": 136540,
    "core.last_event_number": 136836,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0569_dataflow4_datawriter_0_20240818T175139.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_0569_dataflow4_datawriter_0_20240818T175139_reco_stage1_reco_stage2_20240818T203434_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724009512.0,
    "core.end_time": 1724013274.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0569_dataflow4_datawriter_0_20240818T175139.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:12:45 UTC       justIN version: 01.01.09