justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263047.12@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID263047.12@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3448
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 07:27:36
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-09-26 09:29:51
From worker nodeHostnamedune001-2278756.0-lcg2650.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 07:35:15
Input fileshd-protodune:np04hd_raw_run029072_0374_dataflow4_datawriter_0_20240903T220845.hdf5
Outputting started2024-09-26 08:46:28
Output files
Finished2024-09-26 09:29:51
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

agged "wiener"
FrameSaver: q=1.30187e+06 n=894359 tag=wiener
4541 hits in TPC 0
4924 hits in TPC 1
4794 hits in TPC 2
3194 hits in TPC 3
2519 hits in TPC 4
4133 hits in TPC 5
8427 hits in TPC 6
4982 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1079 XUs and 1361 XVs -> 21 XUVs
C:0 T:2 27689 XUs and 41831 XVs -> 4264 XUVs
C:0 T:3 2056 XUs and 3509 XVs -> 154 XUVs
C:0 T:4 90 XUs and 84 XVs -> 6 XUVs
C:0 T:5 5898 XUs and 11933 XVs -> 615 XUVs
C:0 T:6 28481 XUs and 25603 XVs -> 674 XUVs
C:0 T:7 650 XUs and 1198 XVs -> 73 XUVs
5807 XUVs total
1544 collection wire objects
5807 potential space points
Neighbour search...
352921 tests to find 213834 neighbours
Iterating with no regularization...
Begin: 6.69037e+06
0 5.80007e+06
1 5.7056e+06
2 5.69e+06
3 5.68437e+06
Now with regularization...
Begin: 5.13998e+06
0 5.13617e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  4   event 89996 TrkackID 7 startx, y, z 85.5626 236.742 451.668  wireno, peakt tpcno 148 2911.32 5 dist 0.786574min T, max_T2878.51 3961.51
no of hits closeby  4   event 89996 TrkackID 7 startx, y, z 85.5626 236.742 451.668  wireno, peakt tpcno 148 2911.32 5 dist 0.786574min T, max_T2878.51 3961.51
26-Sep-2024 08:46:15 UTC  Closed output file "np04hd_raw_run029072_0374_dataflow4_datawriter_0_20240903T220845_reco_stage1_reco_stage2_20240926T084615_keepup.root"
26-Sep-2024 08:46:15 UTC  Closed input file "np04hd_raw_run029072_0374_dataflow4_datawriter_0_20240903T220845_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              59.269        94.6604       151.78        95.2205       17.5742        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000514361   0.00278758     0.0043475    0.00295971    0.00105101       30     
produce:fembfilter:PDHDFEMBFilter                      0.548009       0.77647      0.882133      0.807077      0.0917014       30     
produce:wclsdatahd:WireCellToolkit                      33.4568       40.3579       47.5512       40.748        2.74412        30     
produce:gaushit:GausHitFinder                          0.236687      0.828154       1.47253      0.818119      0.241479        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000195058   0.000377629   0.000686686   0.000359489   8.90139e-05      30     
produce:reco3d:SpacePointSolver                        0.124831      0.938421       2.37202       0.78963      0.610937        30     
produce:hitpdune:DisambigFromSpacePoints               0.0580702     0.632437       1.61896      0.557352      0.340969        30     
produce:pandora:StandardPandora                         5.93231       13.5942       38.6195       12.4804       6.25688        30     
produce:pandoraWriter:StandardPandora                  0.0715373     0.163181      0.283479      0.169228      0.0475075       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.318909       1.17802       2.25658       1.1996        0.45717        30     
produce:pandoraShower:LArPandoraShowerCreation         0.171873       1.4503        3.86795       1.11397      0.802954        30     
produce:pandoracalo:Calorimetry                        0.160205      0.677202       1.39089      0.652642      0.239491        30     
produce:pandoracalonosce:Calorimetry                   0.139467      0.608052       1.35045      0.575581      0.235684        30     
produce:pandorapid:Chi2ParticleID                     0.00128706    0.00235689    0.00444648    0.00243372    0.00063286       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.136412       1.34086       3.73361       1.03776      0.768342        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.129613       1.25602       3.10024       1.00937       0.67714        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0589073     0.165272       0.29894      0.171656      0.0516961       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0250697     0.0553321     0.0941802     0.0563235     0.0164805       30     
produce:emtrkmichelid:EmTrackMichelId                   13.876        28.8813       43.2362       28.9261       6.23873        30     
[art]:TriggerResults:TriggerResultInserter            3.2702e-05    5.60939e-05   0.000176123   4.64225e-05   2.64343e-05      30     
end_path:out1:RootOutput                               7.063e-06    1.33593e-05   3.9665e-05    1.2799e-05    5.59524e-06      30     
end_path:michelremoving:michelremoving                 0.0173127     0.101364      0.459282      0.0409243     0.101475        30     
end_path:michelremovinggnocchi:michelremoving          0.0135666     0.0984516     0.452598      0.0369907     0.100976        30     
end_path:calibanagnocchi:CalibAnaTree                  0.118976      0.491913      0.898861      0.476008      0.171568        30     
end_path:out1:RootOutput(write)                        0.350374      0.909612       1.46006      0.874018      0.241726        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4923.35 MB
  Peak resident set size usage (VmHWM): 2586.93 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029072_0374_dataflow4_datawriter_0_20240903T220845_reco_stage1_reco_stage2_20240926T084615_keepup.root
\tHists: np04hd_raw_run029072_0374_dataflow4_datawriter_0_20240903T220845_reco_stage1_reco_stage2_20240926T084615_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029072_0374_dataflow4_datawriter_0_20240903T220845_reco_stage1_reco_stage2_20240926T084615_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029072_0374_dataflow4_datawriter_0_20240903T220845_reco_stage1_reco_stage2_20240926T084615_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727337484.0,
    "core.end_time": 1727340376.0,
    "core.events": [
      89716,
      89772,
      89780,
      89788,
      89796,
      89804,
      89812,
      89820,
      89828,
      89836,
      89844,
      89852,
      89860,
      89868,
      89876,
      89884,
      89892,
      89900,
      89908,
      89916,
      89924,
      89932,
      89940,
      89948,
      89956,
      89964,
      89972,
      89980,
      89988,
      89996
    ],
    "core.event_count": 30,
    "core.first_event_number": 89716,
    "core.last_event_number": 89996,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29072
    ],
    "core.runs_subruns": [
      2907200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029072_0374_dataflow4_datawriter_0_20240903T220845.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029072_0374_dataflow4_datawriter_0_20240903T220845_reco_stage1_reco_stage2_20240926T084615_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727337484.0,
    "core.end_time": 1727340376.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29072
    ],
    "core.runs_subruns": [
      2907200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029072_0374_dataflow4_datawriter_0_20240903T220845.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:14:24 UTC       justIN version: 01.01.09