justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273403.94@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID273403.94@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3670
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-11 08:22:28
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce514
Last heartbeat2024-10-11 10:43:15
From worker nodeHostnameb9p02p4761.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-11 09:44:18
Input fileshd-protodune:np04hd_raw_run027968_0054_dataflow2_datawriter_0_20240710T160503.hdf5
Outputting started2024-10-11 10:41:35
Output files
Finished2024-10-11 10:43:15
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

110758 traces tagged "wiener"
FrameSaver: q=3.39157e+06 n=1355797 tag=wiener
8820 hits in TPC 0
7244 hits in TPC 1
8964 hits in TPC 2
5192 hits in TPC 3
7834 hits in TPC 4
11443 hits in TPC 5
7149 hits in TPC 6
5432 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 25846 XUs and 19159 XVs -> 1149 XUVs
C:0 T:2 74292 XUs and 70885 XVs -> 3158 XUVs
C:0 T:3 162 XUs and 221 XVs -> 4 XUVs
C:0 T:4 752 XUs and 1021 XVs -> 56 XUVs
C:0 T:5 69312 XUs and 72209 XVs -> 1663 XUVs
C:0 T:6 31324 XUs and 33558 XVs -> 2355 XUVs
C:0 T:7 1426 XUs and 1696 XVs -> 90 XUVs
8475 XUVs total
3296 collection wire objects
8475 potential space points
Neighbour search...
312399 tests to find 172828 neighbours
Iterating with no regularization...
Begin: 4.75066e+07
0 4.25377e+07
1 4.21586e+07
2 4.21051e+07
3 4.2093e+07
Now with regularization...
Begin: 4.00991e+07
0 4.00916e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

11-Oct-2024 12:41:19 CEST  Closed output file "np04hd_raw_run027968_0054_dataflow2_datawriter_0_20240710T160503_reco_stage1_reco_stage2_20241011T104119_keepup.root"
11-Oct-2024 12:41:19 CEST  Closed input file "np04hd_raw_run027968_0054_dataflow2_datawriter_0_20240710T160503_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.393462       68.5851        182.4        37.4355       72.7668        34     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000323882   0.00123526    0.00379166    0.000459543   0.00106148       34     
produce:fembfilter:PDHDFEMBFilter                       0.38311      0.637212      0.888378      0.642015      0.159527        34     
produce:wclsdatahd:WireCellToolkit                      30.0914       38.2539       45.445        38.2903       4.36165        17     
produce:gaushit:GausHitFinder                          0.429989      0.976168       1.48109      0.955556       0.29561        17     
produce:nhitsfilter:NumberOfHitsFilter                0.000256022   0.000436524   0.000568744   0.000447503   0.000100076      17     
produce:reco3d:SpacePointSolver                        0.500712       1.48102       3.18028       1.52179      0.756864        17     
produce:hitpdune:DisambigFromSpacePoints               0.294146       1.15185        2.156        1.12211      0.567918        17     
produce:pandora:StandardPandora                         10.4817       41.1684       77.0354       46.2111       20.9321        17     
produce:pandoraWriter:StandardPandora                  0.112509      0.235571      0.377608      0.254275      0.0792894       17     
produce:pandoraTrack:LArPandoraTrackCreation           0.652846       2.40196       3.95952       2.49177        1.07          17     
produce:pandoraShower:LArPandoraShowerCreation         0.562464       2.42039       5.13372       2.4977        1.2518         17     
produce:pandoracalo:Calorimetry                        0.372398       1.18366       2.04596       1.23167      0.487615        17     
produce:pandoracalonosce:Calorimetry                   0.436997       1.16221       2.10681       1.1465       0.498205        17     
produce:pandorapid:Chi2ParticleID                      0.0013272    0.00301761    0.00504001    0.00295301    0.00103361       17     
produce:pandoraShowercalo:ShowerCalorimetry            0.693654       2.24058       4.89773       2.37825       1.08935        17     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.593372       2.07124       4.61656       2.07485       1.03607        17     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0736041     0.168495      0.295611      0.166127      0.054745        17     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0252198     0.0561314     0.101025      0.0585022     0.0168612       17     
produce:emtrkmichelid:EmTrackMichelId                   25.356        38.6052       53.2101       41.0694       8.37858        17     
[art]:TriggerResults:TriggerResultInserter              2.5e-05     4.77338e-05    0.0001014    4.5085e-05    1.57079e-05      34     
end_path:out1:RootOutput                               4.05e-06     8.49421e-06   3.1971e-05     8.69e-06     5.05318e-06      34     
end_path:michelremoving:michelremoving                1.7681e-05     0.0401771     0.252259      0.0111589     0.066204        34     
end_path:michelremovinggnocchi:michelremoving          5.68e-06      0.0367986     0.252683     0.00991475     0.0602155       34     
end_path:calibanagnocchi:CalibAnaTree                  4.71e-06      0.459285       1.53116      0.175159      0.516097        34     
end_path:out1:RootOutput(write)                       0.000494663    0.549339        1.576       0.397427      0.573104        34     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5000.86 MB
  Peak resident set size usage (VmHWM): 2648.25 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027968_0054_dataflow2_datawriter_0_20240710T160503_reco_stage1_reco_stage2_20241011T104119_keepup.root
\tHists: np04hd_raw_run027968_0054_dataflow2_datawriter_0_20240710T160503_reco_stage1_reco_stage2_20241011T104119_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027968_0054_dataflow2_datawriter_0_20240710T160503_reco_stage1_reco_stage2_20241011T104119_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027968_0054_dataflow2_datawriter_0_20240710T160503_reco_stage1_reco_stage2_20241011T104119_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728640899.0,
    "core.end_time": 1728643280.0,
    "core.events": [
      14477,
      14485,
      14493,
      14501,
      14509,
      14517,
      14525,
      14533,
      14541,
      14549,
      14557,
      14565,
      14573,
      14581,
      14589,
      14610,
      14618,
      14621,
      14632,
      14638,
      14643,
      14645,
      14657,
      14663,
      14669,
      14677,
      14685,
      14693,
      14701,
      14709,
      14717,
      14725,
      14733,
      14741
    ],
    "core.event_count": 34,
    "core.first_event_number": 14477,
    "core.last_event_number": 14741,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27968
    ],
    "core.runs_subruns": [
      2796800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027968_0054_dataflow2_datawriter_0_20240710T160503.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027968_0054_dataflow2_datawriter_0_20240710T160503_reco_stage1_reco_stage2_20241011T104119_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728640899.0,
    "core.end_time": 1728643280.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27968
    ],
    "core.runs_subruns": [
      2796800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027968_0054_dataflow2_datawriter_0_20240710T160503.hdf5"
    }
  ]
}
justIN time: 2024-11-21 21:51:52 UTC       justIN version: 01.01.09