justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 77772.139@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID77772.139@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3451
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 00:08:23
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2024-09-26 05:33:43
From worker nodeHostnamedune001-2125367.0-lcg2578.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 03:24:51
Input fileshd-protodune:np04hd_raw_run029107_1953_dataflow3_datawriter_0_20240907T233858.hdf5
Outputting started2024-09-26 04:46:15
Output files
Finished2024-09-26 05:33:43
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

wiener
2968 hits in TPC 0
2779 hits in TPC 1
8178 hits in TPC 2
4678 hits in TPC 3
5083 hits in TPC 4
8592 hits in TPC 5
8300 hits in TPC 6
3281 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1040 XUs and 824 XVs -> 48 XUVs
C:0 T:2 24382 XUs and 22297 XVs -> 583 XUVs
C:0 T:3 346 XUs and 822 XVs -> 40 XUVs
C:0 T:4 213 XUs and 286 XVs -> 9 XUVs
C:0 T:5 62927 XUs and 62811 XVs -> 2184 XUVs
C:0 T:6 21206 XUs and 37369 XVs -> 602 XUVs
C:0 T:7 15 XUs and 51 XVs -> 1 XUVs
3467 XUVs total
1662 collection wire objects
3467 potential space points
Neighbour search...
124037 tests to find 72412 neighbours
Iterating with no regularization...
Begin: 8.5687e+06
0 7.9789e+06
1 7.94721e+06
2 7.9441e+06
Now with regularization...
Begin: 7.53863e+06
0 7.53763e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 04:46:02 UTC  Closed output file "np04hd_raw_run029107_1953_dataflow3_datawriter_0_20240907T233858_reco_stage1_reco_stage2_20240926T044602_keepup.root"
26-Sep-2024 04:46:02 UTC  Closed input file "np04hd_raw_run029107_1953_dataflow3_datawriter_0_20240907T233858_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              79.887        109.459       146.41        106.376       17.7814        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000771085   0.00329911    0.00981686    0.00326972    0.00163129       30     
produce:fembfilter:PDHDFEMBFilter                       0.63168      0.841866       0.9882       0.899159      0.107126        30     
produce:wclsdatahd:WireCellToolkit                      38.617        45.7863       51.2243       46.5033       3.46423        30     
produce:gaushit:GausHitFinder                          0.457601      0.841995       1.25559      0.833643      0.200016        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000312176   0.000431605   0.000666653   0.000418744   8.16166e-05      30     
produce:reco3d:SpacePointSolver                        0.238616       1.23767       6.67292      0.750101       1.31112        30     
produce:hitpdune:DisambigFromSpacePoints               0.239617      0.658919       1.58641      0.601406      0.334037        30     
produce:pandora:StandardPandora                         7.25031       17.0865       39.3184       15.3132       7.63125        30     
produce:pandoraWriter:StandardPandora                  0.115623      0.203684      0.304006      0.203479      0.0447228       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.689345       1.51053       2.38952       1.56913      0.487743        30     
produce:pandoraShower:LArPandoraShowerCreation          0.79227       1.81209       4.9192         1.759        0.87366        30     
produce:pandoracalo:Calorimetry                        0.359419      0.759448       1.29111      0.739673      0.254922        30     
produce:pandoracalonosce:Calorimetry                   0.327468       0.68538       1.22059      0.676994      0.244597        30     
produce:pandorapid:Chi2ParticleID                     0.00136556    0.00249993    0.00387643    0.00255012    0.000596256      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.567416       1.60022       4.02875       1.54287      0.785559        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.537999       1.50373       3.28537       1.42244       0.6753         30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0947175     0.193394      0.299992       0.19049      0.0461035       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0334483     0.0654967     0.100457      0.0656629     0.0165961       30     
produce:emtrkmichelid:EmTrackMichelId                   20.6961       32.7259       46.7286       33.0415       6.28334        30     
[art]:TriggerResults:TriggerResultInserter            3.6681e-05    6.87812e-05   0.000151963   5.78065e-05   3.01277e-05      30     
end_path:out1:RootOutput                               6.18e-06     1.76447e-05   4.5361e-05    1.4461e-05    1.03194e-05      30     
end_path:michelremoving:michelremoving                 0.0230617     0.0780006     0.230535      0.0458456     0.0635846       30     
end_path:michelremovinggnocchi:michelremoving          0.020747       0.06958      0.216331      0.0396817     0.0591347       30     
end_path:calibanagnocchi:CalibAnaTree                   0.23347      0.551043      0.875646      0.566094      0.183914        30     
end_path:out1:RootOutput(write)                        0.651458       1.07874       1.45851       1.10212      0.219064        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4915.77 MB
  Peak resident set size usage (VmHWM): 2560.61 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_1953_dataflow3_datawriter_0_20240907T233858_reco_stage1_reco_stage2_20240926T044602_keepup.root
\tHists: np04hd_raw_run029107_1953_dataflow3_datawriter_0_20240907T233858_reco_stage1_reco_stage2_20240926T044602_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_1953_dataflow3_datawriter_0_20240907T233858_reco_stage1_reco_stage2_20240926T044602_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_1953_dataflow3_datawriter_0_20240907T233858_reco_stage1_reco_stage2_20240926T044602_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727322625.0,
    "core.end_time": 1727325963.0,
    "core.events": [
      468739,
      468747,
      468763,
      468771,
      468779,
      468787,
      468795,
      468803,
      468811,
      468819,
      468827,
      468835,
      468843,
      468851,
      468859,
      468867,
      468875,
      468883,
      468891,
      468899,
      468907,
      468915,
      468923,
      468931,
      468939,
      468947,
      468955,
      468963,
      468971,
      468995
    ],
    "core.event_count": 30,
    "core.first_event_number": 468739,
    "core.last_event_number": 468995,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_1953_dataflow3_datawriter_0_20240907T233858.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_1953_dataflow3_datawriter_0_20240907T233858_reco_stage1_reco_stage2_20240926T044602_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727322625.0,
    "core.end_time": 1727325963.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_1953_dataflow3_datawriter_0_20240907T233858.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:29:23 UTC       justIN version: 01.01.08