justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261577.110@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID261577.110@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3390
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-24 19:57:05
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2024-09-24 23:24:33
From worker nodeHostnameccwcondor0701.in2p3.fr
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-24 22:09:00
Input fileshd-protodune:np04hd_raw_run029006_2974_dataflow7_datawriter_0_20240901T171827.hdf5
Outputting started2024-09-24 23:18:44
Output files
Finished2024-09-24 23:24:33
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ng XUV coincidences...
C:0 T:1 130 XUs and 108 XVs -> 3 XUVs
C:0 T:2 11413 XUs and 8232 XVs -> 342 XUVs
C:0 T:3 111 XUs and 105 XVs -> 3 XUVs
C:0 T:4 255 XUs and 382 XVs -> 16 XUVs
C:0 T:5 5030 XUs and 5255 XVs -> 260 XUVs
C:0 T:6 54749 XUs and 37818 XVs -> 4511 XUVs
C:0 T:7 35 XUs and 56 XVs -> 4 XUVs
5139 XUVs total
1073 collection wire objects
5139 potential space points
Neighbour search...
1025341 tests to find 263514 neighbours
Iterating with no regularization...
Begin: 6.2413e+07
0 5.38659e+07
1 5.28575e+07
2 5.27728e+07
3 5.27561e+07
Now with regularization...
Begin: 5.09106e+07
0 5.08486e+07
1 5.08374e+07
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 713999 TrkackID 4 startx, y, z 56.8905 591.434 280.735  wireno, peakt tpcno 373 3559.68 2 dist 272.576min T, max_T2335.84 3559.99
no of hits closeby  0   event 713999 TrkackID 4 startx, y, z 56.8905 591.434 280.735  wireno, peakt tpcno 373 3559.68 2 dist 272.576min T, max_T2335.84 3559.99
25-Sep-2024 01:18:31 CEST  Closed output file "np04hd_raw_run029006_2974_dataflow7_datawriter_0_20240901T171827_reco_stage1_reco_stage2_20240924T231831_keepup.root"
25-Sep-2024 01:18:31 CEST  Closed input file "np04hd_raw_run029006_2974_dataflow7_datawriter_0_20240901T171827_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              57.5526       106.155       152.107       103.316       21.2508        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000666934   0.00345518    0.00805233    0.00340424    0.00172141       30     
produce:fembfilter:PDHDFEMBFilter                      0.603246      0.766869      0.893618      0.761942      0.0778364       30     
produce:wclsdatahd:WireCellToolkit                      40.947        47.3686       52.7921       47.4438       2.60325        30     
produce:gaushit:GausHitFinder                          0.461605      0.821224       2.81562      0.699974      0.411272        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000334268   0.000556189   0.00177464    0.000477698   0.00026253       30     
produce:reco3d:SpacePointSolver                        0.229957       1.52712       5.58823       1.03763       1.36972        29     
produce:hitpdune:DisambigFromSpacePoints               0.203912      0.568858       1.10565      0.604815       0.24945        29     
produce:pandora:StandardPandora                         5.53914       14.7267       39.4899       13.4967       7.24449        29     
produce:pandoraWriter:StandardPandora                  0.103438      0.178754       0.2613       0.179511      0.0457493       29     
produce:pandoraTrack:LArPandoraTrackCreation           0.553735       1.37313       3.11368       1.23125       0.64815        29     
produce:pandoraShower:LArPandoraShowerCreation         0.328537       1.63534       4.12862       1.42586      0.840228        29     
produce:pandoracalo:Calorimetry                        0.279585      0.719329       1.7859       0.657387       0.3209         29     
produce:pandoracalonosce:Calorimetry                   0.270576      0.627956        1.217       0.577155      0.254853        29     
produce:pandorapid:Chi2ParticleID                     0.00108387    0.00224371    0.00462213    0.00229504    0.000687561      29     
produce:pandoraShowercalo:ShowerCalorimetry            0.301609       1.45914       4.28344       1.3011       0.786414        29     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.278108       1.40284       3.51613       1.33361      0.671445        29     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0903513     0.167423      0.268195      0.162112      0.0414593       29     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0320358     0.057941      0.0896148     0.0565183     0.0149614       29     
produce:emtrkmichelid:EmTrackMichelId                   20.4426       32.9757       46.7376       33.8528       6.98795        29     
[art]:TriggerResults:TriggerResultInserter            2.1239e-05    5.72605e-05   0.000114735   5.6556e-05    2.45519e-05      30     
end_path:out1:RootOutput                               8.656e-06    1.42207e-05    2.647e-05    1.1366e-05    5.57535e-06      30     
end_path:michelremoving:michelremoving                7.7425e-05     0.079346      0.333544      0.0410009     0.0811843       30     
end_path:michelremovinggnocchi:michelremoving         6.0163e-05     0.074516      0.348769      0.0336833     0.0802949       30     
end_path:calibanagnocchi:CalibAnaTree                 5.6016e-05     0.476416       1.02523      0.452356      0.208652        30     
end_path:out1:RootOutput(write)                        0.506755      0.856704       1.36007      0.857708       0.19749        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4957.34 MB
  Peak resident set size usage (VmHWM): 2366.77 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029006_2974_dataflow7_datawriter_0_20240901T171827_reco_stage1_reco_stage2_20240924T231831_keepup.root
\tHists: np04hd_raw_run029006_2974_dataflow7_datawriter_0_20240901T171827_reco_stage1_reco_stage2_20240924T231831_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029006_2974_dataflow7_datawriter_0_20240901T171827_reco_stage1_reco_stage2_20240924T231831_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029006_2974_dataflow7_datawriter_0_20240901T171827_reco_stage1_reco_stage2_20240924T231831_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727216684.0,
    "core.end_time": 1727219912.0,
    "core.events": [
      713767,
      713775,
      713783,
      713791,
      713799,
      713807,
      713815,
      713823,
      713831,
      713839,
      713847,
      713855,
      713863,
      713871,
      713879,
      713887,
      713895,
      713903,
      713911,
      713919,
      713927,
      713935,
      713943,
      713951,
      713959,
      713967,
      713975,
      713983,
      713991,
      713999
    ],
    "core.event_count": 30,
    "core.first_event_number": 713767,
    "core.last_event_number": 713999,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_2974_dataflow7_datawriter_0_20240901T171827.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029006_2974_dataflow7_datawriter_0_20240901T171827_reco_stage1_reco_stage2_20240924T231831_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727216684.0,
    "core.end_time": 1727219912.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_2974_dataflow7_datawriter_0_20240901T171827.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:11:14 UTC       justIN version: 01.01.09