justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269707.109@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269707.109@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3594
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 01:57:31
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-10-05 05:53:26
From worker nodeHostnamespool0869.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 04:09:16
Input fileshd-protodune:np04hd_raw_run027937_0220_dataflow7_datawriter_0_20240709T223608.hdf5
Outputting started2024-10-05 05:51:18
Output files
Finished2024-10-05 05:53:26
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ace set: wiener with 50320 traces, 50320 summary
Retagger: tagging trace set: gauss with 38172 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 38172 traces tagged "gauss"
FrameSaver: q=1.44733e+06 n=720144 tag=gauss
wclsFrameSaver: saving 50320 traces tagged "wiener"
FrameSaver: q=1.54725e+06 n=652304 tag=wiener
2389 hits in TPC 0
2174 hits in TPC 1
7093 hits in TPC 2
3043 hits in TPC 3
2976 hits in TPC 4
2821 hits in TPC 5
5348 hits in TPC 6
3602 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 17 XUs and 9 XVs -> 0 XUVs
C:0 T:1 558 XUs and 648 XVs -> 23 XUVs
C:0 T:2 36681 XUs and 30938 XVs -> 1812 XUVs
C:0 T:3 252 XUs and 231 XVs -> 10 XUVs
C:0 T:4 183 XUs and 190 XVs -> 1 XUVs
C:0 T:5 6626 XUs and 6466 XVs -> 158 XUVs
C:0 T:6 21284 XUs and 12312 XVs -> 874 XUVs
C:0 T:7 99 XUs and 108 XVs -> 20 XUVs
2898 XUVs total
1405 collection wire objects
2898 potential space points
Neighbour search...
192522 tests to find 60240 neighbours
Iterating with no regularization...
Begin: 2.72362e+07
0 2.44705e+07
1 2.42853e+07
2 2.42716e+07
Now with regularization...
Begin: 2.23458e+07
0 2.23366e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

05-Oct-2024 05:51:05 UTC  Closed output file "np04hd_raw_run027937_0220_dataflow7_datawriter_0_20240709T223608_reco_stage1_reco_stage2_20241005T055105_keepup.root"
05-Oct-2024 05:51:05 UTC  Closed input file "np04hd_raw_run027937_0220_dataflow7_datawriter_0_20240709T223608_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              90.0189       126.518       163.727       131.816       21.0367        31     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000501161   0.00264149    0.00599512    0.00210935     0.0017182       31     
produce:fembfilter:PDHDFEMBFilter                       0.80791      0.844084       1.07917      0.822759      0.0581091       31     
produce:wclsdatahd:WireCellToolkit                      53.3314       56.9027       60.1147       56.9631       1.53713        31     
produce:gaushit:GausHitFinder                          0.559927      0.978235       1.2965        1.00181      0.198719        31     
produce:nhitsfilter:NumberOfHitsFilter                0.000361343   0.00057038    0.00102234    0.000564257   0.000113539      31     
produce:reco3d:SpacePointSolver                        0.527364       5.65043       11.8469       5.84536       3.01063        31     
produce:hitpdune:DisambigFromSpacePoints               0.415004       1.00875       1.69868       1.05099      0.346539        31     
produce:pandora:StandardPandora                         8.82976       22.8379       39.4464       21.9727       8.68999        31     
produce:pandoraWriter:StandardPandora                  0.148509      0.225687      0.318996      0.229016      0.041421        31     
produce:pandoraTrack:LArPandoraTrackCreation            1.21656       3.78889       7.73257       3.68611       1.44693        31     
produce:pandoraShower:LArPandoraShowerCreation          0.99975       3.99593       7.56361       3.77055       1.64977        31     
produce:pandoracalo:Calorimetry                        0.476394       1.53337       3.0944        1.5102       0.581816        31     
produce:pandoracalonosce:Calorimetry                   0.427036       1.43064       2.91612       1.43701      0.545465        31     
produce:pandorapid:Chi2ParticleID                     0.00147327    0.00235283     0.0040848    0.00231938    0.000495782      31     
produce:pandoraShowercalo:ShowerCalorimetry            0.716218       3.37037       6.96057       3.29009       1.48674        31     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.721896       3.23925       6.53564       2.95844       1.42643        31     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0882497     0.147651      0.192555      0.154135      0.027353        31     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0296699     0.0591548     0.0741551     0.0619026     0.0114839       31     
produce:emtrkmichelid:EmTrackMichelId                   10.8811       18.0613       26.7133       18.2807       3.57433        31     
[art]:TriggerResults:TriggerResultInserter            3.4729e-05    4.71095e-05   0.000109558   4.3492e-05    1.33537e-05      31     
end_path:out1:RootOutput                              1.0424e-05    1.45918e-05    3.683e-05    1.3406e-05    4.88076e-06      31     
end_path:michelremoving:michelremoving                 0.0313868     0.0848493     0.368842      0.0544943     0.0748198       31     
end_path:michelremovinggnocchi:michelremoving          0.0302473     0.0832973     0.428401      0.0523018     0.0824545       31     
end_path:calibanagnocchi:CalibAnaTree                  0.430231       1.01335       2.43488      0.948069      0.419222        31     
end_path:out1:RootOutput(write)                         0.57532      0.993404       1.30453       1.00313      0.202401        31     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5823.57 MB
  Peak resident set size usage (VmHWM): 2544.38 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027937_0220_dataflow7_datawriter_0_20240709T223608_reco_stage1_reco_stage2_20241005T055105_keepup.root
\tHists: np04hd_raw_run027937_0220_dataflow7_datawriter_0_20240709T223608_reco_stage1_reco_stage2_20241005T055105_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027937_0220_dataflow7_datawriter_0_20240709T223608_reco_stage1_reco_stage2_20241005T055105_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027937_0220_dataflow7_datawriter_0_20240709T223608_reco_stage1_reco_stage2_20241005T055105_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728103500.0,
    "core.end_time": 1728107467.0,
    "core.events": [
      54567,
      54575,
      54583,
      54591,
      54599,
      54607,
      54615,
      54623,
      54631,
      54639,
      54647,
      54655,
      54663,
      54671,
      54679,
      54687,
      54695,
      54703,
      54711,
      54719,
      54727,
      54735,
      54743,
      54751,
      54759,
      54767,
      54775,
      54783,
      54791,
      54799,
      54807
    ],
    "core.event_count": 31,
    "core.first_event_number": 54567,
    "core.last_event_number": 54807,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27937
    ],
    "core.runs_subruns": [
      2793700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027937_0220_dataflow7_datawriter_0_20240709T223608.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027937_0220_dataflow7_datawriter_0_20240709T223608_reco_stage1_reco_stage2_20241005T055105_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728103500.0,
    "core.end_time": 1728107467.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27937
    ],
    "core.runs_subruns": [
      2793700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027937_0220_dataflow7_datawriter_0_20240709T223608.hdf5"
    }
  ]
}
justIN time: 2024-11-21 19:28:08 UTC       justIN version: 01.01.09