justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273431.152@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID273431.152@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3671
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-11 08:56:34
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce510
Last heartbeat2024-10-11 11:56:14
From worker nodeHostnameb9p09p9197.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-11 10:44:03
Input fileshd-protodune:np04hd_raw_run027973_0435_dataflow7_datawriter_0_20240711T022845.hdf5
Outputting started2024-10-11 11:55:06
Output files
Finished2024-10-11 11:56:14
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

4
7765 hits in TPC 5
5268 hits in TPC 6
2506 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1863 XUs and 2017 XVs -> 107 XUVs
C:0 T:2 27870 XUs and 37490 XVs -> 1068 XUVs
C:0 T:3 27 XUs and 32 XVs -> 1 XUVs
C:0 T:4 206 XUs and 213 XVs -> 11 XUVs
C:0 T:5 43890 XUs and 37275 XVs -> 3164 XUVs
C:0 T:6 39069 XUs and 52399 XVs -> 758 XUVs
C:0 T:7 755 XUs and 870 XVs -> 15 XUVs
5124 XUVs total
1450 collection wire objects
5124 potential space points
Neighbour search...
304502 tests to find 149308 neighbours
Iterating with no regularization...
Begin: 4.89664e+07
0 4.24243e+07
1 4.18795e+07
2 4.18149e+07
3 4.18037e+07
Now with regularization...
Begin: 3.75691e+07
0 3.74084e+07
1 3.739e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  3   event 111711 TrkackID 8 startx, y, z 68.0775 592.62 376.807  wireno, peakt tpcno 220 834.607 5 dist 7.49911min T, max_T777.109 1988.92
no of hits closeby  3   event 111711 TrkackID 8 startx, y, z 68.0775 592.62 376.807  wireno, peakt tpcno 220 834.607 5 dist 7.49911min T, max_T777.109 1988.92
11-Oct-2024 13:54:55 CEST  Closed output file "np04hd_raw_run027973_0435_dataflow7_datawriter_0_20240711T022845_reco_stage1_reco_stage2_20241011T115455_keepup.root"
11-Oct-2024 13:54:55 CEST  Closed input file "np04hd_raw_run027973_0435_dataflow7_datawriter_0_20240711T022845_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              39.7291       86.4555       160.843       82.4829       26.5328        32     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000455283   0.00159031    0.00315493    0.00155896    0.000761007      32     
produce:fembfilter:PDHDFEMBFilter                      0.479984      0.623277      0.801584      0.563942      0.125365        32     
produce:wclsdatahd:WireCellToolkit                      24.6773       30.2373       38.3629       29.6266       3.86571        32     
produce:gaushit:GausHitFinder                          0.232104      0.673064       1.42907       0.62788      0.252734        32     
produce:nhitsfilter:NumberOfHitsFilter                0.000175241   0.00031583    0.000537314   0.000303537   7.89801e-05      32     
produce:reco3d:SpacePointSolver                        0.299485       1.02697       2.86531      0.667295      0.656575        31     
produce:hitpdune:DisambigFromSpacePoints               0.0881731     0.558141       1.74939      0.419653      0.357183        31     
produce:pandora:StandardPandora                         4.77036       19.7499       65.3594       16.411        13.0575        31     
produce:pandoraWriter:StandardPandora                  0.0728164     0.119736      0.214501      0.108307      0.0386117       31     
produce:pandoraTrack:LArPandoraTrackCreation           0.655095       1.26866       2.58091       1.12952      0.500343        31     
produce:pandoraShower:LArPandoraShowerCreation         0.197397       1.35459       4.05224       1.15854      0.777024        31     
produce:pandoracalo:Calorimetry                        0.351541       0.68005       1.32788      0.609301      0.259122        31     
produce:pandoracalonosce:Calorimetry                   0.348864      0.640917       1.25612      0.558429      0.242278        31     
produce:pandorapid:Chi2ParticleID                     0.00118522    0.00177539    0.00350633    0.00156302    0.000535473      31     
produce:pandoraShowercalo:ShowerCalorimetry            0.172001       1.31938       4.72815       1.11071       0.84757        31     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.16406       1.2897        5.42129       1.03883      0.935969        31     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0640429     0.105649      0.332507      0.091733      0.0494668       31     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.021491      0.0360167     0.110959      0.0304706     0.0164768       31     
produce:emtrkmichelid:EmTrackMichelId                   14.4431       26.9289       57.233        25.1466       8.14065        31     
[art]:TriggerResults:TriggerResultInserter             1.533e-05    2.62349e-05    6.078e-05     2.456e-05    1.05226e-05      32     
end_path:out1:RootOutput                               7.63e-06     1.02044e-05    2.257e-05     9.91e-06     2.55131e-06      32     
end_path:michelremoving:michelremoving                 3.021e-05     0.0687623     0.347164      0.0253024     0.0813042       32     
end_path:michelremovinggnocchi:michelremoving         1.1751e-05     0.0674062     0.349639      0.0217282     0.0833922       32     
end_path:calibanagnocchi:CalibAnaTree                 1.1471e-05     0.546325       1.59601      0.505124      0.277569        32     
end_path:out1:RootOutput(write)                        0.441378      0.782619       1.9082       0.768095      0.283085        32     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5083.12 MB
  Peak resident set size usage (VmHWM): 2724.38 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027973_0435_dataflow7_datawriter_0_20240711T022845_reco_stage1_reco_stage2_20241011T115455_keepup.root
\tHists: np04hd_raw_run027973_0435_dataflow7_datawriter_0_20240711T022845_reco_stage1_reco_stage2_20241011T115455_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027973_0435_dataflow7_datawriter_0_20240711T022845_reco_stage1_reco_stage2_20241011T115455_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027973_0435_dataflow7_datawriter_0_20240711T022845_reco_stage1_reco_stage2_20241011T115455_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728644893.0,
    "core.end_time": 1728647695.0,
    "core.events": [
      111463,
      111471,
      111479,
      111487,
      111495,
      111503,
      111511,
      111519,
      111527,
      111535,
      111543,
      111551,
      111559,
      111567,
      111575,
      111583,
      111591,
      111599,
      111607,
      111615,
      111623,
      111631,
      111639,
      111647,
      111655,
      111663,
      111671,
      111679,
      111687,
      111695,
      111703,
      111711
    ],
    "core.event_count": 32,
    "core.first_event_number": 111463,
    "core.last_event_number": 111711,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27973
    ],
    "core.runs_subruns": [
      2797300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027973_0435_dataflow7_datawriter_0_20240711T022845.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027973_0435_dataflow7_datawriter_0_20240711T022845_reco_stage1_reco_stage2_20241011T115455_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728644893.0,
    "core.end_time": 1728647695.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27973
    ],
    "core.runs_subruns": [
      2797300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027973_0435_dataflow7_datawriter_0_20240711T022845.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:57:50 UTC       justIN version: 01.01.09