justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 69535.88@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID69535.88@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3197
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-11 22:16:45
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-09-12 02:31:40
From worker nodeHostnamen192.dur.scotgrid.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-11 23:45:50
Input fileshd-protodune:np04hd_raw_run028563_1353_dataflow1_datawriter_0_20240808T062751.hdf5
Outputting started2024-09-12 02:30:03
Output files
Finished2024-09-12 02:31:40
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

agging trace set: gauss with 52297 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 52297 traces tagged "gauss"
FrameSaver: q=1.1381e+06 n=1006291 tag=gauss
wclsFrameSaver: saving 71597 traces tagged "wiener"
FrameSaver: q=1.22846e+06 n=919289 tag=wiener
4342 hits in TPC 0
2527 hits in TPC 1
7920 hits in TPC 2
4166 hits in TPC 3
1173 hits in TPC 4
2234 hits in TPC 5
11427 hits in TPC 6
6098 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 291 XUs and 765 XVs -> 25 XUVs
C:0 T:2 31865 XUs and 70979 XVs -> 784 XUVs
C:0 T:3 495 XUs and 697 XVs -> 29 XUVs
C:0 T:4 72 XUs and 99 XVs -> 5 XUVs
C:0 T:5 2292 XUs and 3634 XVs -> 186 XUVs
C:0 T:6 45630 XUs and 70446 XVs -> 1388 XUVs
C:0 T:7 331 XUs and 449 XVs -> 10 XUVs
2427 XUVs total
1613 collection wire objects
2427 potential space points
Neighbour search...
58155 tests to find 31418 neighbours
Iterating with no regularization...
Begin: 8.12791e+06
0 7.47028e+06
1 7.4154e+06
2 7.4128e+06
Now with regularization...
Begin: 6.99953e+06
0 6.99822e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

12-Sep-2024 03:29:55 BST  Closed output file "np04hd_raw_run028563_1353_dataflow1_datawriter_0_20240808T062751_reco_stage1_reco_stage2_20240912T022955_keepup.root"
12-Sep-2024 03:29:55 BST  Closed input file "np04hd_raw_run028563_1353_dataflow1_datawriter_0_20240808T062751_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              67.4442       95.1326       162.292       90.2556       18.2172        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000335146   0.00106917     0.0025594    0.000860956   0.000584753      30     
produce:fembfilter:PDHDFEMBFilter                      0.705221      0.851681       1.20036      0.782699      0.151275        30     
produce:wclsdatahd:WireCellToolkit                      43.9119       48.1733       55.9754       47.3861       3.48391        30     
produce:gaushit:GausHitFinder                          0.469041      0.829236       1.53346      0.805794       0.23571        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000263602   0.000385444   0.000599647   0.000371482   8.5904e-05       30     
produce:reco3d:SpacePointSolver                        0.287444       1.07873       3.27295      0.870679      0.777299        30     
produce:hitpdune:DisambigFromSpacePoints                0.24206      0.643704       1.62525      0.559828      0.346747        30     
produce:pandora:StandardPandora                         6.34951       13.3349       33.662        12.6949       6.04125        30     
produce:pandoraWriter:StandardPandora                  0.102297      0.164914      0.284364      0.154368      0.0423966       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.636388       1.93231       5.74168       1.57156       1.03266        30     
produce:pandoraShower:LArPandoraShowerCreation         0.428187       2.20793       10.7967       1.71765       1.8493         30     
produce:pandoracalo:Calorimetry                        0.294852      0.790962       2.64738      0.671345      0.422725        30     
produce:pandoracalonosce:Calorimetry                   0.263967      0.797793       2.90927      0.617042      0.516406        30     
produce:pandorapid:Chi2ParticleID                     0.00134125    0.00207321    0.00503267    0.00177863    0.000856518      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.363816       1.8373        8.11814       1.42171       1.45544        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.354814       1.81099       7.53105       1.35763       1.34741        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0751478     0.143806      0.284719      0.135016      0.0472877       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0304769     0.0574766     0.107916      0.0534594     0.0196125       30     
produce:emtrkmichelid:EmTrackMichelId                   11.8107       18.6207       30.354        18.3126       3.92359        30     
[art]:TriggerResults:TriggerResultInserter            3.0321e-05    4.20178e-05   7.5638e-05    3.86215e-05   9.64866e-06      30     
end_path:out1:RootOutput                               8.557e-06    1.15299e-05    2.364e-05    1.0533e-05    3.10798e-06      30     
end_path:michelremoving:michelremoving                 0.0218081     0.0734584     0.384867      0.0446336     0.0780135       30     
end_path:michelremovinggnocchi:michelremoving          0.0190315     0.0703232      0.38448      0.0409166     0.0764657       30     
end_path:calibanagnocchi:CalibAnaTree                   0.21174      0.657486       1.82059      0.567562      0.332924        30     
end_path:out1:RootOutput(write)                        0.514423      0.873276       1.50601      0.859075      0.234357        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5757.25 MB
  Peak resident set size usage (VmHWM): 2876.81 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028563_1353_dataflow1_datawriter_0_20240808T062751_reco_stage1_reco_stage2_20240912T022955_keepup.root
\tHists: np04hd_raw_run028563_1353_dataflow1_datawriter_0_20240808T062751_reco_stage1_reco_stage2_20240912T022955_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028563_1353_dataflow1_datawriter_0_20240808T062751_reco_stage1_reco_stage2_20240912T022955_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028563_1353_dataflow1_datawriter_0_20240808T062751_reco_stage1_reco_stage2_20240912T022955_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726105297.0,
    "core.end_time": 1726108195.0,
    "core.events": [
      324721,
      324729,
      324737,
      324745,
      324753,
      324761,
      324769,
      324777,
      324785,
      324793,
      324801,
      324809,
      324817,
      324825,
      324833,
      324841,
      324849,
      324857,
      324865,
      324873,
      324881,
      324889,
      324929,
      324937,
      324953,
      324961,
      324969,
      324977,
      324985,
      324993
    ],
    "core.event_count": 30,
    "core.first_event_number": 324721,
    "core.last_event_number": 324993,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28563
    ],
    "core.runs_subruns": [
      2856300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028563_1353_dataflow1_datawriter_0_20240808T062751.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028563_1353_dataflow1_datawriter_0_20240808T062751_reco_stage1_reco_stage2_20240912T022955_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726105297.0,
    "core.end_time": 1726108195.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28563
    ],
    "core.runs_subruns": [
      2856300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028563_1353_dataflow1_datawriter_0_20240808T062751.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:30:20 UTC       justIN version: 01.01.08