justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263058.25@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID263058.25@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3447
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 07:54:16
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce03
Last heartbeat2024-09-26 09:15:53
From worker nodeHostnameccwcondor0576
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statestalled
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 07:55:51
Input fileshd-protodune:np04hd_raw_run029081_0843_dataflow3_datawriter_0_20240905T060556.hdf5
Outputting started2024-09-26 08:58:45
Output files
Finished2024-09-26 09:57:03
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

wiener"
FrameSaver: q=1.11585e+06 n=877419 tag=wiener
1829 hits in TPC 0
2146 hits in TPC 1
6814 hits in TPC 2
3878 hits in TPC 3
4036 hits in TPC 4
6007 hits in TPC 5
6200 hits in TPC 6
4516 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 100 XUs and 85 XVs -> 0 XUVs
C:0 T:2 36578 XUs and 40356 XVs -> 686 XUVs
C:0 T:3 224 XUs and 261 XVs -> 9 XUVs
C:0 T:4 237 XUs and 267 XVs -> 10 XUVs
C:0 T:5 13601 XUs and 8806 XVs -> 293 XUVs
C:0 T:6 40225 XUs and 61346 XVs -> 2206 XUVs
C:0 T:7 326 XUs and 378 XVs -> 8 XUVs
3212 XUVs total
1143 collection wire objects
3212 potential space points
Neighbour search...
265624 tests to find 135808 neighbours
Iterating with no regularization...
Begin: 4.47764e+06
0 4.12039e+06
1 4.10416e+06
2 4.10162e+06
Now with regularization...
Begin: 3.90271e+06
0 3.90186e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  4   event 202571 TrkackID 17 startx, y, z 84.6441 591.417 362.332  wireno, peakt tpcno 449 2671.01 5 dist 0min T, max_T1728.94 2810.69
no of hits closeby  4   event 202571 TrkackID 17 startx, y, z 84.6441 591.417 362.332  wireno, peakt tpcno 449 2671.01 5 dist 0min T, max_T1728.94 2810.69
26-Sep-2024 10:58:28 CEST  Closed output file "np04hd_raw_run029081_0843_dataflow3_datawriter_0_20240905T060556_reco_stage1_reco_stage2_20240926T085828_keepup.root"
26-Sep-2024 10:58:28 CEST  Closed input file "np04hd_raw_run029081_0843_dataflow3_datawriter_0_20240905T060556_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              63.521        93.8084       138.441       93.7542       21.1329        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000435805   0.00300971    0.00934501    0.00300345    0.00180011       30     
produce:fembfilter:PDHDFEMBFilter                      0.499502      0.609902      0.793655      0.569782      0.0997492       30     
produce:wclsdatahd:WireCellToolkit                      30.8248       37.0887       45.8538       35.2852       4.99117        30     
produce:gaushit:GausHitFinder                          0.284958      0.662543      0.921239      0.673319      0.176418        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000203481   0.000339491   0.000510604   0.000343798   6.71468e-05      30     
produce:reco3d:SpacePointSolver                        0.152822      0.891086       2.89897      0.671592      0.689832        30     
produce:hitpdune:DisambigFromSpacePoints               0.102432      0.471928      0.941612       0.48872      0.218799        30     
produce:pandora:StandardPandora                         4.5985        12.4619       24.413        11.7434       5.39545        30     
produce:pandoraWriter:StandardPandora                  0.0879458     0.150613      0.259763       0.14708      0.0433717       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.568475       1.66322       3.66449       1.59461      0.708777        30     
produce:pandoraShower:LArPandoraShowerCreation          0.4415        2.17627       4.78435       1.95605       1.2292         30     
produce:pandoracalo:Calorimetry                        0.342823      0.801714       1.63127      0.752035      0.333628        30     
produce:pandoracalonosce:Calorimetry                   0.242472       0.74119       1.72812      0.738868      0.353706        30     
produce:pandorapid:Chi2ParticleID                     0.00109023     0.001923      0.0033855     0.0016404    0.000643687      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.385072       1.78703       4.53081       1.79172      0.993836        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.386312       1.66956       3.85445       1.56444      0.895539        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0634206     0.132745      0.211678      0.126648      0.0437246       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.026127      0.0513764     0.0911518     0.0478211     0.0177583       30     
produce:emtrkmichelid:EmTrackMichelId                   19.7532       30.826        47.9397       30.0549       7.81847        30     
[art]:TriggerResults:TriggerResultInserter            2.9846e-05    5.65552e-05   0.000117169   5.7893e-05    1.70118e-05      30     
end_path:out1:RootOutput                               8.917e-06    1.65284e-05   4.1037e-05    1.50185e-05   5.82585e-06      30     
end_path:michelremoving:michelremoving                 0.0180495     0.0956992     0.632288      0.0420682     0.119827        30     
end_path:michelremovinggnocchi:michelremoving          0.0173293     0.0906259     0.588336      0.0456021      0.11213        30     
end_path:calibanagnocchi:CalibAnaTree                  0.188252      0.530824       1.12488      0.502178      0.231693        30     
end_path:out1:RootOutput(write)                        0.397482      0.698536       1.05774      0.672271       0.19395        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4925.41 MB
  Peak resident set size usage (VmHWM): 2347.27 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029081_0843_dataflow3_datawriter_0_20240905T060556_reco_stage1_reco_stage2_20240926T085828_keepup.root
\tHists: np04hd_raw_run029081_0843_dataflow3_datawriter_0_20240905T060556_reco_stage1_reco_stage2_20240926T085828_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029081_0843_dataflow3_datawriter_0_20240905T060556_reco_stage1_reco_stage2_20240926T085828_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029081_0843_dataflow3_datawriter_0_20240905T060556_reco_stage1_reco_stage2_20240926T085828_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727338251.0,
    "core.end_time": 1727341109.0,
    "core.events": [
      202299,
      202307,
      202339,
      202347,
      202355,
      202363,
      202371,
      202379,
      202387,
      202395,
      202403,
      202411,
      202419,
      202427,
      202435,
      202443,
      202451,
      202459,
      202467,
      202475,
      202483,
      202491,
      202499,
      202507,
      202515,
      202523,
      202531,
      202539,
      202547,
      202571
    ],
    "core.event_count": 30,
    "core.first_event_number": 202299,
    "core.last_event_number": 202571,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29081
    ],
    "core.runs_subruns": [
      2908100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029081_0843_dataflow3_datawriter_0_20240905T060556.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029081_0843_dataflow3_datawriter_0_20240905T060556_reco_stage1_reco_stage2_20240926T085828_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727338251.0,
    "core.end_time": 1727341109.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29081
    ],
    "core.runs_subruns": [
      2908100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029081_0843_dataflow3_datawriter_0_20240905T060556.hdf5"
    }
  ]
}
justIN time: 2024-11-17 03:09:54 UTC       justIN version: 01.01.09