justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255330.18@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID255330.18@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3197
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-12 15:42:06
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-09-12 16:48:15
From worker nodeHostnameb9p22p4931.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-12 15:44:02
Input fileshd-protodune:np04hd_raw_run028590_0045_dataflow0_datawriter_0_20240808T160100.hdf5
Outputting started2024-09-12 16:46:44
Output files
Finished2024-09-12 16:48:15
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ith 60312 traces, 60312 summary
Retagger: tagging trace set: gauss with 46539 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 46539 traces tagged "gauss"
FrameSaver: q=982725 n=912482 tag=gauss
wclsFrameSaver: saving 60312 traces tagged "wiener"
FrameSaver: q=1.03783e+06 n=833056 tag=wiener
2838 hits in TPC 0
1710 hits in TPC 1
8393 hits in TPC 2
4371 hits in TPC 3
2290 hits in TPC 4
3135 hits in TPC 5
6537 hits in TPC 6
2885 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 109 XUs and 85 XVs -> 2 XUVs
C:0 T:2 22049 XUs and 29571 XVs -> 625 XUVs
C:0 T:3 36 XUs and 64 XVs -> 2 XUVs
C:0 T:4 56 XUs and 62 XVs -> 2 XUVs
C:0 T:5 5092 XUs and 4795 XVs -> 210 XUVs
C:0 T:6 30999 XUs and 22086 XVs -> 698 XUVs
C:0 T:7 35 XUs and 42 XVs -> 0 XUVs
1539 XUVs total
1179 collection wire objects
1539 potential space points
Neighbour search...
24411 tests to find 11578 neighbours
Iterating with no regularization...
Begin: 5.68314e+06
0 5.42559e+06
1 5.41036e+06
2 5.40942e+06
Now with regularization...
Begin: 5.12016e+06
0 5.11992e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

12-Sep-2024 18:46:30 CEST  Closed output file "np04hd_raw_run028590_0045_dataflow0_datawriter_0_20240808T160100_reco_stage1_reco_stage2_20240912T164630_keepup.root"
12-Sep-2024 18:46:30 CEST  Closed input file "np04hd_raw_run028590_0045_dataflow0_datawriter_0_20240808T160100_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              71.4155       91.5096       113.464       90.2999       12.3916        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000677013   0.00314257    0.00485481    0.00340623    0.00104611       30     
produce:fembfilter:PDHDFEMBFilter                      0.575008      0.791293      0.967555      0.804242      0.0864534       30     
produce:wclsdatahd:WireCellToolkit                      32.7443       37.3841       44.8094        37.48        2.53134        30     
produce:gaushit:GausHitFinder                          0.522431      0.786982       1.24859      0.709956      0.201282        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000299836   0.000417466   0.000556061   0.000422683   6.50791e-05      30     
produce:reco3d:SpacePointSolver                        0.156654      0.963788       3.29729      0.705676      0.762524        30     
produce:hitpdune:DisambigFromSpacePoints               0.241133      0.583337       1.02512       0.57086      0.233129        30     
produce:pandora:StandardPandora                         6.00796       13.6962       24.7008       14.5597       4.46225        30     
produce:pandoraWriter:StandardPandora                  0.0909185      0.1784       0.264944      0.175625      0.0476099       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.545478       1.14005       2.42034       1.10146      0.413071        30     
produce:pandoraShower:LArPandoraShowerCreation         0.610627       1.29594       2.24746       1.23914      0.463946        30     
produce:pandoracalo:Calorimetry                        0.328027      0.592533       1.17428      0.564714       0.18892        30     
produce:pandoracalonosce:Calorimetry                   0.310888      0.542957       1.03117      0.522835      0.170278        30     
produce:pandorapid:Chi2ParticleID                      0.0012694    0.00206399    0.00334375    0.00201711    0.000555873      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.512322       1.29911       2.29849       1.20683      0.490495        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.536136       1.27835       2.16475       1.09613      0.503035        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0808178     0.170208      0.274522      0.161753      0.0543246       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0289738     0.0559246     0.0891817     0.0525857     0.0184264       30     
produce:emtrkmichelid:EmTrackMichelId                   19.7779       28.9188       40.1085       28.2716       5.08317        30     
[art]:TriggerResults:TriggerResultInserter             2.566e-05    5.07027e-05   0.000100772   4.1896e-05    1.99957e-05      30     
end_path:out1:RootOutput                               9.11e-06     1.30924e-05   3.1911e-05    1.12605e-05   5.81477e-06      30     
end_path:michelremoving:michelremoving                 0.0243722     0.113193       0.44791      0.0506195     0.107887        30     
end_path:michelremovinggnocchi:michelremoving          0.0199272     0.109878       0.44269      0.0491476     0.108571        30     
end_path:calibanagnocchi:CalibAnaTree                  0.248103      0.520148      0.821015      0.496852      0.149472        30     
end_path:out1:RootOutput(write)                        0.638365      0.959021       1.42193      0.958076      0.173647        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4941.09 MB
  Peak resident set size usage (VmHWM): 2589.21 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028590_0045_dataflow0_datawriter_0_20240808T160100_reco_stage1_reco_stage2_20240912T164630_keepup.root
\tHists: np04hd_raw_run028590_0045_dataflow0_datawriter_0_20240808T160100_reco_stage1_reco_stage2_20240912T164630_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028590_0045_dataflow0_datawriter_0_20240808T160100_reco_stage1_reco_stage2_20240912T164630_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028590_0045_dataflow0_datawriter_0_20240808T160100_reco_stage1_reco_stage2_20240912T164630_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726156800.0,
    "core.end_time": 1726159591.0,
    "core.events": [
      10808,
      10816,
      10824,
      10832,
      10840,
      10848,
      10856,
      10864,
      10872,
      10880,
      10888,
      10896,
      10904,
      10912,
      10920,
      10928,
      10936,
      10944,
      10952,
      10960,
      10968,
      10976,
      10984,
      10992,
      11000,
      11008,
      11016,
      11024,
      11032,
      11040
    ],
    "core.event_count": 30,
    "core.first_event_number": 10808,
    "core.last_event_number": 11040,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28590
    ],
    "core.runs_subruns": [
      2859000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028590_0045_dataflow0_datawriter_0_20240808T160100.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028590_0045_dataflow0_datawriter_0_20240808T160100_reco_stage1_reco_stage2_20240912T164630_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726156800.0,
    "core.end_time": 1726159591.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28590
    ],
    "core.runs_subruns": [
      2859000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028590_0045_dataflow0_datawriter_0_20240808T160100.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:31:16 UTC       justIN version: 01.01.08