justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262657.153@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID262657.153@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3451
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 02:03:21
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce509
Last heartbeat2024-09-26 05:17:41
From worker nodeHostnameb9p12p6431.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 03:33:19
Input fileshd-protodune:np04hd_raw_run029107_1977_dataflow2_datawriter_0_20240907T235947.hdf5
Outputting started2024-09-26 04:25:46
Output files
Finished2024-09-26 05:17:41
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

nd 223 XVs -> 15 XUVs
C:0 T:4 181 XUs and 299 XVs -> 10 XUVs
C:0 T:5 15061 XUs and 12287 XVs -> 581 XUVs
C:0 T:6 18599 XUs and 15420 XVs -> 670 XUVs
C:0 T:7 337 XUs and 307 XVs -> 9 XUVs
1920 XUVs total
1092 collection wire objects
1920 potential space points
Neighbour search...
33400 tests to find 21614 neighbours
Iterating with no regularization...
Begin: 7.33842e+06
0 7.02258e+06
1 7.003e+06
2 6.9993e+06
Now with regularization...
Begin: 6.56455e+06
0 6.56356e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  1   event 474786 TrkackID 4 startx, y, z 46.2526 590.385 299.039  wireno, peakt tpcno 128 5 5 dist 0min T, max_T5 2759
no of hits closeby  1   event 474786 TrkackID 17 startx, y, z 24.6017 592.638 152.891  wireno, peakt tpcno 319 2720 2 dist 158.932min T, max_T2143.55 2748.14
no of hits closeby  1   event 474786 TrkackID 4 startx, y, z 46.2526 590.385 299.039  wireno, peakt tpcno 128 5 5 dist 0min T, max_T5 2759
no of hits closeby  1   event 474786 TrkackID 17 startx, y, z 24.6017 592.638 152.891  wireno, peakt tpcno 319 2720 2 dist 158.932min T, max_T2143.55 2748.14
26-Sep-2024 06:25:35 CEST  Closed output file "np04hd_raw_run029107_1977_dataflow2_datawriter_0_20240907T235947_reco_stage1_reco_stage2_20240926T042535_keepup.root"
26-Sep-2024 06:25:35 CEST  Closed input file "np04hd_raw_run029107_1977_dataflow2_datawriter_0_20240907T235947_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              53.2881       73.867        111.867       71.5441       14.5512        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000692549   0.00218632    0.00354803     0.0023089    0.000879636      30     
produce:fembfilter:PDHDFEMBFilter                      0.482309      0.665832       0.76039      0.707348      0.0930479       30     
produce:wclsdatahd:WireCellToolkit                      26.5269       33.1393       40.7631       31.7212       3.91062        30     
produce:gaushit:GausHitFinder                           0.30205      0.543284       1.02842      0.507486      0.185662        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000193933   0.000303425   0.000469096   0.000302889   6.89158e-05      30     
produce:reco3d:SpacePointSolver                        0.137771      0.585373       1.75979      0.499996       0.38924        30     
produce:hitpdune:DisambigFromSpacePoints               0.125442      0.386324       1.33639      0.285384      0.257791        30     
produce:pandora:StandardPandora                         4.15656       8.86383       21.2017       7.59054       4.13079        30     
produce:pandoraWriter:StandardPandora                  0.0582683     0.124244      0.272253      0.114375      0.0443886       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.407183      0.802279       1.71529      0.759897      0.329614        30     
produce:pandoraShower:LArPandoraShowerCreation         0.376461      0.974131       2.80555      0.747011      0.564828        30     
produce:pandoracalo:Calorimetry                        0.236976      0.479776       1.2394       0.414821      0.221588        30     
produce:pandoracalonosce:Calorimetry                   0.206011      0.421769       1.12802      0.363952      0.195062        30     
produce:pandorapid:Chi2ParticleID                     0.00106238    0.00161059    0.00296714    0.00153687    0.000436333      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.328216      0.948417       3.49545      0.752797      0.649341        30     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.31088      0.915055       3.14495      0.723462      0.606252        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0599944     0.113048      0.226316      0.104141      0.0441216       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0210793     0.0404455     0.0855199     0.0371399     0.0156512       30     
produce:emtrkmichelid:EmTrackMichelId                   15.5322       23.4435       40.9809       21.9494       6.10236        30     
[art]:TriggerResults:TriggerResultInserter             1.79e-05     3.40957e-05   8.7191e-05    3.0376e-05    1.35169e-05      30     
end_path:out1:RootOutput                               8.06e-06     1.36082e-05   3.0971e-05    1.2335e-05    5.09584e-06      30     
end_path:michelremoving:michelremoving                 0.0165323     0.0764646     0.308847      0.0319557     0.0806558       30     
end_path:michelremovinggnocchi:michelremoving          0.0153867     0.0738049     0.303785      0.0260891     0.0810024       30     
end_path:calibanagnocchi:CalibAnaTree                  0.171549      0.397241      0.808936      0.360167      0.173214        30     
end_path:out1:RootOutput(write)                        0.447467       0.77127       1.32726      0.699168      0.217066        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4941.43 MB
  Peak resident set size usage (VmHWM): 2565.72 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_1977_dataflow2_datawriter_0_20240907T235947_reco_stage1_reco_stage2_20240926T042535_keepup.root
\tHists: np04hd_raw_run029107_1977_dataflow2_datawriter_0_20240907T235947_reco_stage1_reco_stage2_20240926T042535_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_1977_dataflow2_datawriter_0_20240907T235947_reco_stage1_reco_stage2_20240926T042535_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_1977_dataflow2_datawriter_0_20240907T235947_reco_stage1_reco_stage2_20240926T042535_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727322477.0,
    "core.end_time": 1727324735.0,
    "core.events": [
      474498,
      474514,
      474522,
      474530,
      474538,
      474546,
      474554,
      474562,
      474570,
      474578,
      474586,
      474594,
      474602,
      474610,
      474618,
      474626,
      474634,
      474642,
      474650,
      474658,
      474666,
      474674,
      474682,
      474690,
      474698,
      474706,
      474714,
      474722,
      474730,
      474786
    ],
    "core.event_count": 30,
    "core.first_event_number": 474498,
    "core.last_event_number": 474786,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_1977_dataflow2_datawriter_0_20240907T235947.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_1977_dataflow2_datawriter_0_20240907T235947_reco_stage1_reco_stage2_20240926T042535_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727322477.0,
    "core.end_time": 1727324735.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_1977_dataflow2_datawriter_0_20240907T235947.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:30:52 UTC       justIN version: 01.01.08