justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 77781.2@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID77781.2@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3453
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 00:25:04
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce504
Last heartbeat2024-09-26 05:15:38
From worker nodeHostnameb9p08p1116.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 03:57:23
Input fileshd-protodune:np04hd_raw_run029107_3565_dataflow4_datawriter_0_20240909T032744.hdf5
Outputting started2024-09-26 04:48:04
Output files
Finished2024-09-26 05:15:38
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

C:0 T:3 239 XUs and 200 XVs -> 17 XUVs
C:0 T:4 54 XUs and 44 XVs -> 1 XUVs
C:0 T:5 16526 XUs and 12330 XVs -> 568 XUVs
C:0 T:6 27351 XUs and 20026 XVs -> 236 XUVs
C:0 T:7 291 XUs and 682 XVs -> 11 XUVs
1932 XUVs total
885 collection wire objects
1932 potential space points
Neighbour search...
28270 tests to find 18438 neighbours
Iterating with no regularization...
Begin: 5.57149e+06
0 5.42927e+06
1 5.42322e+06
2 5.42294e+06
Now with regularization...
Begin: 5.20237e+06
0 5.20228e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 855860 TrkackID 3 startx, y, z -135.614 591.085 52.915  wireno, peakt tpcno 423 5 2 dist 0min T, max_T5 2909.39
no of hits closeby  2   event 855860 TrkackID 5 startx, y, z 112.05 572.096 459.134  wireno, peakt tpcno 0 907.082 5 dist 0min T, max_T130 1557.25
no of hits closeby  0   event 855860 TrkackID 3 startx, y, z -135.614 591.085 52.915  wireno, peakt tpcno 423 5 2 dist 0min T, max_T5 2909.39
no of hits closeby  2   event 855860 TrkackID 5 startx, y, z 112.05 572.096 459.134  wireno, peakt tpcno 0 907.082 5 dist 0min T, max_T130 1557.25
26-Sep-2024 06:47:52 CEST  Closed output file "np04hd_raw_run029107_3565_dataflow4_datawriter_0_20240909T032744_reco_stage1_reco_stage2_20240926T044752_keepup.root"
26-Sep-2024 06:47:52 CEST  Closed input file "np04hd_raw_run029107_3565_dataflow4_datawriter_0_20240909T032744_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              48.5132       71.1132       92.6157       72.6613       10.8431        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000390703   0.00136663    0.00354684    0.00119288    0.000728146      30     
produce:fembfilter:PDHDFEMBFilter                      0.477516      0.635872      0.763296      0.641857      0.0846134       30     
produce:wclsdatahd:WireCellToolkit                      27.409        31.2265       38.7529       30.4736       3.08669        30     
produce:gaushit:GausHitFinder                          0.197416       0.56551      0.968437      0.569033      0.160744        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000136701   0.00027006    0.000349653   0.000274282   4.8069e-05       30     
produce:reco3d:SpacePointSolver                        0.0375888     0.742709       2.47652      0.450376      0.649226        30     
produce:hitpdune:DisambigFromSpacePoints               0.0465223      0.4011       0.906112      0.357545      0.193527        30     
produce:pandora:StandardPandora                          3.63         8.88167       14.8364       8.38613       3.33851        30     
produce:pandoraWriter:StandardPandora                  0.0586512      0.11056      0.217443      0.103352      0.0395893       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.251268      0.789936       1.61256       0.69653      0.341498        30     
produce:pandoraShower:LArPandoraShowerCreation          0.21459      0.919389       2.05252      0.848422      0.463112        30     
produce:pandoracalo:Calorimetry                        0.147631      0.450312      0.804417      0.439298      0.153334        30     
produce:pandoracalonosce:Calorimetry                   0.121386      0.404738      0.735046      0.376542      0.142935        30     
produce:pandorapid:Chi2ParticleID                     0.000798398   0.00159079    0.00276497    0.00159251    0.000432906      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.188721      0.878328       2.33007      0.761468      0.440967        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.186891      0.864035       2.41859       0.78899      0.453797        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0369885     0.122955      0.234136      0.111009       0.04589        30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0150308     0.0375407     0.0734727     0.0346978     0.0135428       30     
produce:emtrkmichelid:EmTrackMichelId                   13.5773       22.7333       32.8526       22.0597       4.78864        30     
[art]:TriggerResults:TriggerResultInserter             1.775e-05    3.08315e-05   0.000109061   2.63105e-05   1.88174e-05      30     
end_path:out1:RootOutput                               7.03e-06     1.05892e-05   2.9281e-05     9.215e-06    4.73726e-06      30     
end_path:michelremoving:michelremoving                 0.012248      0.0818271     0.334577      0.0309939     0.0874344       30     
end_path:michelremovinggnocchi:michelremoving          0.0117601     0.0797276     0.329216      0.0268094     0.0877769       30     
end_path:calibanagnocchi:CalibAnaTree                  0.119137      0.372484      0.627719      0.353928       0.13643        30     
end_path:out1:RootOutput(write)                        0.356039      0.730182       1.09638      0.719871      0.187723        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4973.2 MB
  Peak resident set size usage (VmHWM): 2612.84 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_3565_dataflow4_datawriter_0_20240909T032744_reco_stage1_reco_stage2_20240926T044752_keepup.root
\tHists: np04hd_raw_run029107_3565_dataflow4_datawriter_0_20240909T032744_reco_stage1_reco_stage2_20240926T044752_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_3565_dataflow4_datawriter_0_20240909T032744_reco_stage1_reco_stage2_20240926T044752_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_3565_dataflow4_datawriter_0_20240909T032744_reco_stage1_reco_stage2_20240926T044752_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727323908.0,
    "core.end_time": 1727326073.0,
    "core.events": [
      855628,
      855636,
      855644,
      855652,
      855660,
      855668,
      855676,
      855684,
      855692,
      855700,
      855708,
      855716,
      855724,
      855732,
      855740,
      855748,
      855756,
      855764,
      855772,
      855780,
      855788,
      855796,
      855804,
      855812,
      855820,
      855828,
      855836,
      855844,
      855852,
      855860
    ],
    "core.event_count": 30,
    "core.first_event_number": 855628,
    "core.last_event_number": 855860,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3565_dataflow4_datawriter_0_20240909T032744.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_3565_dataflow4_datawriter_0_20240909T032744_reco_stage1_reco_stage2_20240926T044752_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727323908.0,
    "core.end_time": 1727326073.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3565_dataflow4_datawriter_0_20240909T032744.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:15:29 UTC       justIN version: 01.01.09