justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 76732.133@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID76732.133@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3385
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-24 19:47:09
SiteUK_Liverpool
EntryDUNE_UK_Liverpool_hepgrid5
Last heartbeat2024-09-24 21:45:34
From worker nodeHostnamer21-n08.ph.liv.ac.uk
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit259200 (72 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-24 20:31:49
Input fileshd-protodune:np04hd_raw_run029006_0406_dataflow4_datawriter_0_20240830T172644.hdf5
Outputting started2024-09-24 21:41:33
Output files
Finished2024-09-24 21:45:34
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

: saving 45806 traces tagged "wiener"
FrameSaver: q=829532 n=646902 tag=wiener
2748 hits in TPC 0
2044 hits in TPC 1
2114 hits in TPC 2
1454 hits in TPC 3
4743 hits in TPC 4
7298 hits in TPC 5
3846 hits in TPC 6
1956 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 86 XUs and 128 XVs -> 0 XUVs
C:0 T:2 20740 XUs and 11940 XVs -> 360 XUVs
C:0 T:3 2 XUs and 4 XVs -> 0 XUVs
C:0 T:4 194 XUs and 175 XVs -> 5 XUVs
C:0 T:5 23386 XUs and 61800 XVs -> 3072 XUVs
C:0 T:6 44434 XUs and 28808 XVs -> 990 XUVs
C:0 T:7 70 XUs and 60 XVs -> 4 XUVs
4431 XUVs total
1270 collection wire objects
4431 potential space points
Neighbour search...
266499 tests to find 159056 neighbours
Iterating with no regularization...
Begin: 7.86613e+06
0 7.27905e+06
1 7.23143e+06
2 7.22142e+06
3 7.21782e+06
Now with regularization...
Begin: 6.80317e+06
0 6.8006e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  5   event 97676 TrkackID 8 startx, y, z 43.3541 593.662 345.077  wireno, peakt tpcno 211 2944.74 5 dist 1.16833min T, max_T2885.32 4209
no of hits closeby  5   event 97676 TrkackID 8 startx, y, z 43.3541 593.662 345.077  wireno, peakt tpcno 211 2944.74 5 dist 1.16833min T, max_T2885.32 4209
24-Sep-2024 22:41:23 BST  Closed output file "np04hd_raw_run029006_0406_dataflow4_datawriter_0_20240830T172644_reco_stage1_reco_stage2_20240924T214123_keepup.root"
24-Sep-2024 22:41:23 BST  Closed input file "np04hd_raw_run029006_0406_dataflow4_datawriter_0_20240830T172644_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              51.1828       79.6115       132.349       75.939        16.169         30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000406714   0.00252531    0.00446968    0.00231642    0.00114842       30     
produce:fembfilter:PDHDFEMBFilter                      0.482932      0.510284      0.584812      0.502102      0.0243666       30     
produce:wclsdatahd:WireCellToolkit                      30.1131       31.3189       34.5565       31.3065      0.862389        30     
produce:gaushit:GausHitFinder                          0.271756      0.535158      0.956404      0.511746      0.147456        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000212258   0.000334167   0.000798939   0.000309981   0.000102909      30     
produce:reco3d:SpacePointSolver                        0.102219       1.55088       18.1477      0.789244       3.14848        30     
produce:hitpdune:DisambigFromSpacePoints               0.0957445     0.415154       1.32407      0.365581      0.255193        30     
produce:pandora:StandardPandora                         2.97805       10.6362       30.5342       9.06177       5.41784        30     
produce:pandoraWriter:StandardPandora                  0.0825511     0.133721       0.2271       0.129432      0.032461        30     
produce:pandoraTrack:LArPandoraTrackCreation           0.409384       1.44125       2.74684       1.24049      0.598913        30     
produce:pandoraShower:LArPandoraShowerCreation         0.257711       1.73805       3.95295       1.54277      0.918488        30     
produce:pandoracalo:Calorimetry                        0.215759      0.694506       1.40012      0.604526      0.277461        30     
produce:pandoracalonosce:Calorimetry                   0.180454      0.643159       1.19044      0.558543      0.260648        30     
produce:pandorapid:Chi2ParticleID                     0.00109812    0.00165788    0.00415338    0.00153457    0.000565255      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.205453       1.5028        3.48386       1.30026      0.773241        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.221042       1.45396       3.25971       1.2479       0.707309        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0490092      0.10369      0.209447      0.095388      0.0367149       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.020876      0.0366118     0.0631731     0.0353265    0.00929582       30     
produce:emtrkmichelid:EmTrackMichelId                   13.7405       25.4719       35.4282       25.3254       5.06818        30     
[art]:TriggerResults:TriggerResultInserter            1.9757e-05    5.20981e-05   0.000116108   4.3211e-05    2.5694e-05       30     
end_path:out1:RootOutput                               7.484e-06    1.93189e-05   4.0015e-05    1.67265e-05   8.05752e-06      30     
end_path:michelremoving:michelremoving                 0.013841      0.0776772     0.338989      0.0443115     0.0740793       30     
end_path:michelremovinggnocchi:michelremoving          0.013028      0.0737254     0.332596      0.0366742     0.0719611       30     
end_path:calibanagnocchi:CalibAnaTree                  0.130084      0.473388      0.988933      0.431423      0.197604        30     
end_path:out1:RootOutput(write)                        0.285242      0.589613      0.880541      0.580581      0.135519        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4967.63 MB
  Peak resident set size usage (VmHWM): 2354.34 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029006_0406_dataflow4_datawriter_0_20240830T172644_reco_stage1_reco_stage2_20240924T214123_keepup.root
\tHists: np04hd_raw_run029006_0406_dataflow4_datawriter_0_20240830T172644_reco_stage1_reco_stage2_20240924T214123_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029006_0406_dataflow4_datawriter_0_20240830T172644_reco_stage1_reco_stage2_20240924T214123_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029006_0406_dataflow4_datawriter_0_20240830T172644_reco_stage1_reco_stage2_20240924T214123_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727211661.0,
    "core.end_time": 1727214084.0,
    "core.events": [
      97396,
      97404,
      97412,
      97468,
      97476,
      97484,
      97492,
      97500,
      97508,
      97516,
      97524,
      97532,
      97540,
      97548,
      97556,
      97564,
      97572,
      97580,
      97588,
      97596,
      97604,
      97612,
      97620,
      97628,
      97636,
      97644,
      97652,
      97660,
      97668,
      97676
    ],
    "core.event_count": 30,
    "core.first_event_number": 97396,
    "core.last_event_number": 97676,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_0406_dataflow4_datawriter_0_20240830T172644.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029006_0406_dataflow4_datawriter_0_20240830T172644_reco_stage1_reco_stage2_20240924T214123_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727211661.0,
    "core.end_time": 1727214084.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_0406_dataflow4_datawriter_0_20240830T172644.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:28:53 UTC       justIN version: 01.01.08