justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262979.49@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID262979.49@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3448
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 06:38:14
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2024-09-26 09:28:24
From worker nodeHostnameccwcondor0595
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 06:48:41
Input fileshd-protodune:np04hd_raw_run029097_0223_dataflow6_datawriter_0_20240906T150238.hdf5
Outputting started2024-09-26 07:56:58
Output files
Finished2024-09-26 09:28:24
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

C 4
8329 hits in TPC 5
8392 hits in TPC 6
5162 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 70 XUs and 98 XVs -> 7 XUVs
C:0 T:2 47522 XUs and 76500 XVs -> 4603 XUVs
C:0 T:3 51 XUs and 78 XVs -> 5 XUVs
C:0 T:4 208 XUs and 411 XVs -> 6 XUVs
C:0 T:5 29311 XUs and 37210 XVs -> 1180 XUVs
C:0 T:6 49814 XUs and 90555 XVs -> 2227 XUVs
C:0 T:7 109 XUs and 114 XVs -> 0 XUVs
8028 XUVs total
2143 collection wire objects
8028 potential space points
Neighbour search...
478290 tests to find 275460 neighbours
Iterating with no regularization...
Begin: 1.5821e+07
0 1.42511e+07
1 1.4105e+07
2 1.40704e+07
3 1.40565e+07
Now with regularization...
Begin: 1.33419e+07
0 1.33343e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 53766 TrkackID 14 startx, y, z 51.816 592.916 323.651  wireno, peakt tpcno 121 2306.99 6 dist 382.362min T, max_T7.19609 2320.86
no of hits closeby  0   event 53766 TrkackID 14 startx, y, z 51.816 592.916 323.651  wireno, peakt tpcno 121 2306.99 6 dist 382.362min T, max_T7.19609 2320.86
26-Sep-2024 09:56:47 CEST  Closed output file "np04hd_raw_run029097_0223_dataflow6_datawriter_0_20240906T150238_reco_stage1_reco_stage2_20240926T075647_keepup.root"
26-Sep-2024 09:56:47 CEST  Closed input file "np04hd_raw_run029097_0223_dataflow6_datawriter_0_20240906T150238_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              69.8579       103.323       145.238       103.063       17.0267        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000520135    0.0030787    0.00672949    0.00288907    0.00139906       30     
produce:fembfilter:PDHDFEMBFilter                      0.637845      0.737811      0.804298      0.744874      0.0360019       30     
produce:wclsdatahd:WireCellToolkit                      38.8709       42.3893       45.1786       42.5607       1.33013        30     
produce:gaushit:GausHitFinder                          0.440964      0.769392       1.21176      0.775359       0.17656        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000235892   0.000382021   0.000647965   0.00037881    7.3182e-05       30     
produce:reco3d:SpacePointSolver                        0.294243       1.34428       4.8119        1.03107       1.02462        30     
produce:hitpdune:DisambigFromSpacePoints               0.189458      0.615828       1.07216      0.582696      0.237869        30     
produce:pandora:StandardPandora                         4.99407       13.8335       26.3828       13.8143       5.42902        30     
produce:pandoraWriter:StandardPandora                  0.0959742     0.174277      0.272227      0.176821      0.0366584       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.685736       1.96694       3.54754       1.96751      0.828947        30     
produce:pandoraShower:LArPandoraShowerCreation         0.464951       2.34444       4.88227       2.40961       1.2909         30     
produce:pandoracalo:Calorimetry                        0.242393      0.913191       1.6612       0.908729      0.354584        30     
produce:pandoracalonosce:Calorimetry                   0.211709      0.831002       1.45689      0.829991      0.338334        30     
produce:pandorapid:Chi2ParticleID                     0.00108929    0.00220735    0.00455092     0.0021723    0.000677749      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.323026       1.80074       3.38486       1.72542      0.917113        30     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.33359       1.80501       3.94909       1.65894      0.948668        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0803242     0.161147      0.243347      0.167857      0.0399869       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0290589     0.0556762     0.0823227     0.056565      0.0131691       30     
produce:emtrkmichelid:EmTrackMichelId                   18.4987       31.6844       51.0826       31.278        6.71248        30     
[art]:TriggerResults:TriggerResultInserter            4.4213e-05    7.26675e-05   0.000150622   7.23205e-05   1.84082e-05      30     
end_path:out1:RootOutput                               1.608e-05    2.22089e-05   4.0887e-05    2.0919e-05    4.88242e-06      30     
end_path:michelremoving:michelremoving                 0.0171281      0.13209      0.450328      0.0552071      0.13034        30     
end_path:michelremovinggnocchi:michelremoving          0.0173614     0.130488      0.439395      0.0557771     0.132088        30     
end_path:calibanagnocchi:CalibAnaTree                  0.174574      0.612324       1.19644      0.585293      0.234869        30     
end_path:out1:RootOutput(write)                        0.444172      0.795016       1.07417      0.819135      0.173366        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4930.78 MB
  Peak resident set size usage (VmHWM): 2355.59 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029097_0223_dataflow6_datawriter_0_20240906T150238_reco_stage1_reco_stage2_20240926T075647_keepup.root
\tHists: np04hd_raw_run029097_0223_dataflow6_datawriter_0_20240906T150238_reco_stage1_reco_stage2_20240926T075647_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029097_0223_dataflow6_datawriter_0_20240906T150238_reco_stage1_reco_stage2_20240926T075647_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029097_0223_dataflow6_datawriter_0_20240906T150238_reco_stage1_reco_stage2_20240926T075647_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727334239.0,
    "core.end_time": 1727337407.0,
    "core.events": [
      53502,
      53534,
      53542,
      53550,
      53558,
      53566,
      53574,
      53582,
      53590,
      53598,
      53606,
      53614,
      53622,
      53630,
      53638,
      53646,
      53654,
      53662,
      53670,
      53678,
      53686,
      53694,
      53702,
      53710,
      53718,
      53726,
      53734,
      53742,
      53758,
      53766
    ],
    "core.event_count": 30,
    "core.first_event_number": 53502,
    "core.last_event_number": 53766,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29097
    ],
    "core.runs_subruns": [
      2909700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029097_0223_dataflow6_datawriter_0_20240906T150238.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029097_0223_dataflow6_datawriter_0_20240906T150238_reco_stage1_reco_stage2_20240926T075647_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727334239.0,
    "core.end_time": 1727337407.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29097
    ],
    "core.runs_subruns": [
      2909700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029097_0223_dataflow6_datawriter_0_20240906T150238.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:30:57 UTC       justIN version: 01.01.08