justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269643.1@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269643.1@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3586
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 22:38:55
SiteUS_Colorado
EntryCMSHTPC_T3_US_Colorado_heposg01-colorado
Last heartbeat2024-10-05 09:44:03
From worker nodeHostnamelnxfarm144.colorado.edu
cpuinfoIntel(R) Core(TM) i7 CPU 950 @ 3.07GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 02:49:39
Input fileshd-protodune:np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002.hdf5
JobscriptExit code0
Real time6h (24073s)
CPU time3h (13900s = 57%)
Outputting started2024-10-05 09:31:01
Output fileshd-protodune-det-reco:np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002_reco_stage1_reco_stage2_20241005T092810_keepup.root
hd-protodune-det-reco:np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002_reco_stage1_reco_stage2_20241005T092810_keepup_hists.root
Finished2024-10-05 09:44:03
Saved logsjustin-logs:269643.1-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ng cooked to 5859 ticks
wclsFrameSaver: saving 34034 traces tagged "gauss"
FrameSaver: q=1.28643e+06 n=600898 tag=gauss
wclsFrameSaver: saving 46795 traces tagged "wiener"
FrameSaver: q=1.42096e+06 n=543460 tag=wiener
1845 hits in TPC 0
2105 hits in TPC 1
4302 hits in TPC 2
2971 hits in TPC 3
3223 hits in TPC 4
4828 hits in TPC 5
5695 hits in TPC 6
1650 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 4443 XUs and 2506 XVs -> 115 XUVs
C:0 T:2 21591 XUs and 7396 XVs -> 318 XUVs
C:0 T:3 14 XUs and 20 XVs -> 0 XUVs
C:0 T:4 75 XUs and 118 XVs -> 0 XUVs
C:0 T:5 30237 XUs and 29889 XVs -> 3993 XUVs
C:0 T:6 12596 XUs and 11252 XVs -> 632 XUVs
C:0 T:7 22 XUs and 16 XVs -> 0 XUVs
5058 XUVs total
1046 collection wire objects
5058 potential space points
Neighbour search...
435714 tests to find 253408 neighbours
Iterating with no regularization...
Begin: 2.23801e+07
0 2.02159e+07
1 2.00759e+07
2 2.00465e+07
3 2.00372e+07
Now with regularization...
Begin: 1.89823e+07
0 1.89733e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

05-Oct-2024 03:28:10 MDT  Closed output file "np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002_reco_stage1_reco_stage2_20241005T092810_keepup.root"
05-Oct-2024 03:28:11 MDT  Closed input file "np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              150.979       431.848       843.775       427.199       135.477        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00050192    0.00794911     0.0481914    0.00327579     0.0118262       40     
produce:fembfilter:PDHDFEMBFilter                       1.76597       2.32209       3.44026       2.29609      0.334945        40     
produce:wclsdatahd:WireCellToolkit                      86.7704       133.112       154.879       137.396       15.2505        40     
produce:gaushit:GausHitFinder                           1.36067       2.66083       7.9284        2.34993       1.15323        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000481405   0.00123016     0.0142844    0.00076128    0.00213571       40     
produce:reco3d:SpacePointSolver                        0.331136       3.7985        21.0691       1.67338       4.76337        38     
produce:hitpdune:DisambigFromSpacePoints               0.533076       2.52971       8.93091       2.20302       1.83562        38     
produce:pandora:StandardPandora                         16.3061       59.2966       197.084       45.4801       39.963         38     
produce:pandoraWriter:StandardPandora                  0.182475      0.409229      0.820925      0.395429      0.141134        38     
produce:pandoraTrack:LArPandoraTrackCreation            2.54892       6.04816       15.8623       5.5102        3.02623        38     
produce:pandoraShower:LArPandoraShowerCreation          1.87894       7.30807       20.7057       6.01414       4.50456        38     
produce:pandoracalo:Calorimetry                         1.29524       3.03008       8.89053       2.72456       1.68383        38     
produce:pandoracalonosce:Calorimetry                   0.860515       2.81362       7.47014       2.53584       1.61025        38     
produce:pandorapid:Chi2ParticleID                      0.0027063    0.00700547     0.027539     0.00435677    0.00585454       38     
produce:pandoraShowercalo:ShowerCalorimetry             1.66994       6.70319       24.2645       4.98297       4.84996        38     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.86668       6.4223        26.0693       5.00429       4.78241        38     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.156463      0.405059      0.768984      0.370385      0.160594        38     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0582393      0.14998       0.30082       0.12751      0.0642268       38     
produce:emtrkmichelid:EmTrackMichelId                   115.798       204.916       354.237       199.529       55.3179        38     
[art]:TriggerResults:TriggerResultInserter            2.9475e-05    5.30126e-05   8.2968e-05    5.52415e-05   1.1266e-05       40     
end_path:out1:RootOutput                               4.84e-06     0.000334493    0.0130356    9.1735e-06    0.00203381       40     
end_path:michelremoving:michelremoving                 3.925e-05     0.348953       2.40209      0.127692      0.455843        40     
end_path:michelremovinggnocchi:michelremoving         3.6869e-05      0.33636       2.0071       0.115029      0.423683        40     
end_path:calibanagnocchi:CalibAnaTree                 3.6639e-05      2.11763       6.82534       1.91298       1.31018        40     
end_path:out1:RootOutput(write)                        0.846713       2.06356       4.99931       2.03335      0.788324        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5042.32 MB
  Peak resident set size usage (VmHWM): 2604.84 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002_reco_stage1_reco_stage2_20241005T092810_keepup.root
\tHists: np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002_reco_stage1_reco_stage2_20241005T092810_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002_reco_stage1_reco_stage2_20241005T092810_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002_reco_stage1_reco_stage2_20241005T092810_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728102906.0,
    "core.end_time": 1728120577.0,
    "core.events": [
      1441,
      1442,
      1443,
      1444,
      1445,
      1446,
      1447,
      1448,
      1449,
      1450,
      1451,
      1452,
      1453,
      1454,
      1455,
      1456,
      1457,
      1458,
      1459,
      1460,
      1461,
      1462,
      1463,
      1464,
      1465,
      1466,
      1467,
      1468,
      1469,
      1470,
      1471,
      1472,
      1473,
      1474,
      1475,
      1476,
      1477,
      1478,
      1479,
      1480
    ],
    "core.event_count": 40,
    "core.first_event_number": 1441,
    "core.last_event_number": 1480,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27766
    ],
    "core.runs_subruns": [
      2776600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002_reco_stage1_reco_stage2_20241005T092810_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728102906.0,
    "core.end_time": 1728120577.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27766
    ],
    "core.runs_subruns": [
      2776600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027766_0036_dataflow0_datawriter_0_20240705T200002.hdf5"
    }
  ]
}
justIN time: 2024-11-24 12:49:46 UTC       justIN version: 01.01.09