justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263057.98@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID263057.98@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3447
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 07:52:56
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce03
Last heartbeat2024-09-26 09:15:30
From worker nodeHostnameccwcondor0622
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statestalled
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 07:55:28
Input fileshd-protodune:np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209.hdf5
Outputting started2024-09-26 08:57:12
Output files
Finished2024-09-26 09:57:03
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

5203 traces tagged "wiener"
FrameSaver: q=1.51087e+06 n=1155712 tag=wiener
5682 hits in TPC 0
6099 hits in TPC 1
5530 hits in TPC 2
2744 hits in TPC 3
3205 hits in TPC 4
6785 hits in TPC 5
8904 hits in TPC 6
5922 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7002 XUs and 5755 XVs -> 195 XUVs
C:0 T:2 26499 XUs and 32554 XVs -> 1138 XUVs
C:0 T:3 15 XUs and 15 XVs -> 0 XUVs
C:0 T:4 192 XUs and 205 XVs -> 3 XUVs
C:0 T:5 26167 XUs and 34101 XVs -> 864 XUVs
C:0 T:6 36361 XUs and 41823 XVs -> 1045 XUVs
C:0 T:7 1254 XUs and 1025 XVs -> 43 XUVs
3288 XUVs total
1929 collection wire objects
3288 potential space points
Neighbour search...
126724 tests to find 65234 neighbours
Iterating with no regularization...
Begin: 1.13595e+07
0 1.0892e+07
1 1.08755e+07
2 1.08727e+07
Now with regularization...
Begin: 1.02434e+07
0 1.02425e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  5   event 71531 TrkackID 4 startx, y, z 116.15 598.11 247.936  wireno, peakt tpcno 424 1425.43 5 dist 0.276199min T, max_T248.423 1727.25
no of hits closeby  5   event 71531 TrkackID 4 startx, y, z 116.15 598.11 247.936  wireno, peakt tpcno 424 1425.43 5 dist 0.276199min T, max_T248.423 1727.25
26-Sep-2024 10:56:36 CEST  Closed output file "np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup.root"
26-Sep-2024 10:56:36 CEST  Closed input file "np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              61.2216       92.7985       147.515       88.3014       22.1861        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000708652   0.00294389    0.00530078    0.00283522    0.00105759       30     
produce:fembfilter:PDHDFEMBFilter                      0.485602      0.617718      0.789827      0.593473      0.102064        30     
produce:wclsdatahd:WireCellToolkit                      29.937        37.191        48.4162       36.5685       4.67867        30     
produce:gaushit:GausHitFinder                          0.282123      0.632841       1.28179      0.567137      0.223954        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000187429   0.000359549   0.00103999    0.000335235   0.000165631      30     
produce:reco3d:SpacePointSolver                         0.20323       1.20989       9.79071      0.859195       1.68792        30     
produce:hitpdune:DisambigFromSpacePoints               0.113922      0.457351       1.28083      0.403071      0.259556        30     
produce:pandora:StandardPandora                         4.32042       11.7726       24.2242       11.5265       5.15997        30     
produce:pandoraWriter:StandardPandora                  0.0912647     0.149946      0.235761      0.150606      0.0373421       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.624617       1.71337       3.37988       1.62686      0.723963        30     
produce:pandoraShower:LArPandoraShowerCreation         0.580182       2.23197       6.09119       1.81945       1.35334        30     
produce:pandoracalo:Calorimetry                        0.271742       0.81581       1.55196      0.727325      0.346508        30     
produce:pandoracalonosce:Calorimetry                    0.24305      0.775607       1.60539      0.699491      0.344973        30     
produce:pandorapid:Chi2ParticleID                     0.00122263    0.00198568     0.0035222    0.00195844    0.000544294      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.518352       1.83161       6.85901       1.49506       1.21062        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.498933       1.81701       7.9034        1.42885       1.42313        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0595376     0.129365      0.273593      0.111208      0.0555704       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0247373     0.0486632     0.108467      0.042501      0.0197257       30     
produce:emtrkmichelid:EmTrackMichelId                   17.8945       29.7523       48.0505       29.2183       7.56051        30     
[art]:TriggerResults:TriggerResultInserter             3.265e-05    6.11387e-05   0.000105787   6.1635e-05    1.82023e-05      30     
end_path:out1:RootOutput                               8.956e-06    1.6439e-05    3.3964e-05    1.5429e-05    5.08507e-06      30     
end_path:michelremoving:michelremoving                 0.0181487     0.0718075     0.472154      0.0438458     0.0867507       30     
end_path:michelremovinggnocchi:michelremoving          0.0177284     0.0689235     0.473141      0.0423862     0.0884955       30     
end_path:calibanagnocchi:CalibAnaTree                  0.185538      0.576832       1.25254      0.481902      0.263615        30     
end_path:out1:RootOutput(write)                        0.367051       0.71761       1.10004      0.662968      0.200247        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4924.09 MB
  Peak resident set size usage (VmHWM): 2344.42 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup.root
\tHists: np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727338158.0,
    "core.end_time": 1727340997.0,
    "core.events": [
      71283,
      71291,
      71299,
      71307,
      71315,
      71323,
      71331,
      71339,
      71347,
      71355,
      71363,
      71371,
      71379,
      71387,
      71395,
      71403,
      71411,
      71419,
      71427,
      71435,
      71443,
      71451,
      71459,
      71467,
      71475,
      71483,
      71491,
      71499,
      71523,
      71531
    ],
    "core.event_count": 30,
    "core.first_event_number": 71283,
    "core.last_event_number": 71531,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29092
    ],
    "core.runs_subruns": [
      2909200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727338158.0,
    "core.end_time": 1727340997.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29092
    ],
    "core.runs_subruns": [
      2909200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:31:12 UTC       justIN version: 01.01.08