justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 270098.1@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID270098.1@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3578
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 14:58:23
SiteUS_Colorado
EntryCMSHTPC_T3_US_Colorado_heposg01-colorado
Last heartbeat2024-10-05 19:03:03
From worker nodeHostnamelnxfarm156.colorado.edu
cpuinfoIntel(R) Core(TM) i7 CPU 950 @ 3.07GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 15:02:43
Input fileshd-protodune:np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458.hdf5
JobscriptExit code0
Real time3h (14323s)
CPU time3h (12388s = 86%)
Outputting started2024-10-05 19:01:28
Output fileshd-protodune-det-reco:np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458_reco_stage1_reco_stage2_20241005T190051_keepup.root
hd-protodune-det-reco:np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458_reco_stage1_reco_stage2_20241005T190051_keepup_hists.root
Finished2024-10-05 19:02:45
Saved logsjustin-logs:270098.1-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

s in TPC 0
3142 hits in TPC 1
3650 hits in TPC 2
2512 hits in TPC 3
1342 hits in TPC 4
3362 hits in TPC 5
3027 hits in TPC 6
2961 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 9559 XUs and 4216 XVs -> 77 XUVs
C:0 T:2 6141 XUs and 10080 XVs -> 176 XUVs
C:0 T:3 20 XUs and 43 XVs -> 0 XUVs
C:0 T:4 11 XUs and 6 XVs -> 0 XUVs
C:0 T:5 9445 XUs and 4162 XVs -> 63 XUVs
C:0 T:6 6936 XUs and 6240 XVs -> 173 XUVs
C:0 T:7 401 XUs and 473 XVs -> 17 XUVs
506 XUVs total
353 collection wire objects
506 potential space points
Neighbour search...
3986 tests to find 2234 neighbours
Iterating with no regularization...
Begin: 5.18708e+06
0 4.87433e+06
1 4.86671e+06
2 4.86638e+06
Now with regularization...
Begin: 4.64027e+06
0 4.6402e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 880 TrkackID 5 startx, y, z 207.772 379.986 335.779  wireno, peakt tpcno 110 2421 5 dist 0min T, max_T5.97244 2647.91
no of hits closeby  0   event 880 TrkackID 5 startx, y, z 207.772 379.986 335.779  wireno, peakt tpcno 110 2421 5 dist 0min T, max_T5.97244 2647.91
05-Oct-2024 13:00:51 MDT  Closed output file "np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458_reco_stage1_reco_stage2_20241005T190051_keepup.root"
05-Oct-2024 13:00:51 MDT  Closed input file "np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              83.6239       266.393       587.304       250.67        88.9515        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000490752   0.00320636     0.0199016    0.00263451     0.0036542       40     
produce:fembfilter:PDHDFEMBFilter                      0.785784       1.60294       2.58211       1.66131      0.332104        40     
produce:wclsdatahd:WireCellToolkit                      68.8385       85.9361       100.173       84.9505       8.00569        40     
produce:gaushit:GausHitFinder                          0.630094       1.52395       2.83428       1.40091      0.519788        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000429508   0.000763663   0.00154135    0.000754337   0.000232166      40     
produce:reco3d:SpacePointSolver                         0.23462       2.5284        16.298        1.0023        3.72683        39     
produce:hitpdune:DisambigFromSpacePoints               0.205439       1.31048       4.53081       1.00917      0.962196        39     
produce:pandora:StandardPandora                         8.53046       37.4191       211.21        26.6236       35.401         39     
produce:pandoraWriter:StandardPandora                  0.130539      0.236184      0.549083       0.22421      0.0879518       39     
produce:pandoraTrack:LArPandoraTrackCreation            1.51839       4.33545       12.578        3.78531       2.40816        39     
produce:pandoraShower:LArPandoraShowerCreation          1.12572       5.37616       16.6212       4.63802       3.34491        39     
produce:pandoracalo:Calorimetry                        0.725732       2.05036       5.90528       1.7784        1.17511        39     
produce:pandoracalonosce:Calorimetry                    0.7382        1.94777       6.1869        1.56912       1.21674        39     
produce:pandorapid:Chi2ParticleID                     0.00170081    0.00364168    0.00955516    0.00328943    0.00144032       39     
produce:pandoraShowercalo:ShowerCalorimetry            0.921241       4.6102        16.2368       4.09663       2.95272        39     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.0143        4.46652       15.0584       3.9557        2.79663        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0993275     0.235963      0.492365      0.235839      0.0827699       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0376608     0.0861668     0.175433      0.087705      0.0297624       39     
produce:emtrkmichelid:EmTrackMichelId                   55.8439       113.948       214.723       108.819       33.3823        39     
[art]:TriggerResults:TriggerResultInserter            4.2368e-05    6.01426e-05   8.6393e-05    5.92335e-05   1.00317e-05      40     
end_path:out1:RootOutput                               5.847e-06    1.01969e-05   1.8867e-05    1.0285e-05    2.44717e-06      40     
end_path:michelremoving:michelremoving                3.8972e-05     0.158037      0.857701      0.069221      0.197645        40     
end_path:michelremovinggnocchi:michelremoving         3.9746e-05     0.152749      0.831584      0.0672372     0.187602        40     
end_path:calibanagnocchi:CalibAnaTree                 3.4928e-05      1.51506       6.36131       1.30676       1.04628        40     
end_path:out1:RootOutput(write)                        0.580144       1.23578       2.74269       1.13747      0.456002        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5031.21 MB
  Peak resident set size usage (VmHWM): 2641.54 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458_reco_stage1_reco_stage2_20241005T190051_keepup.root
\tHists: np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458_reco_stage1_reco_stage2_20241005T190051_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458_reco_stage1_reco_stage2_20241005T190051_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458_reco_stage1_reco_stage2_20241005T190051_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728144105.0,
    "core.end_time": 1728154856.0,
    "core.events": [
      841,
      842,
      843,
      844,
      845,
      846,
      847,
      848,
      849,
      850,
      851,
      852,
      853,
      854,
      855,
      856,
      857,
      858,
      859,
      860,
      861,
      862,
      863,
      864,
      865,
      866,
      867,
      868,
      869,
      870,
      871,
      872,
      873,
      874,
      875,
      876,
      877,
      878,
      879,
      880
    ],
    "core.event_count": 40,
    "core.first_event_number": 841,
    "core.last_event_number": 880,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27591
    ],
    "core.runs_subruns": [
      2759100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458_reco_stage1_reco_stage2_20241005T190051_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728144105.0,
    "core.end_time": 1728154856.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27591
    ],
    "core.runs_subruns": [
      2759100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027591_0021_dataflow0_datawriter_0_20240701T180458.hdf5"
    }
  ]
}
justIN time: 2024-11-24 11:48:49 UTC       justIN version: 01.01.09