justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 270098.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID270098.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3578
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 14:58:23
SiteUS_Colorado
EntryCMSHTPC_T3_US_Colorado_heposg01-colorado
Last heartbeat2024-10-05 18:16:16
From worker nodeHostnamelnxfarm238.colorado.edu
cpuinfoIntel(R) Core(TM) i7-2600K CPU @ 3.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 15:00:42
Input fileshd-protodune:np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818.hdf5
JobscriptExit code0
Real time3h (11656s)
CPU time2h (10127s = 86%)
Outputting started2024-10-05 18:15:00
Output fileshd-protodune-det-reco:np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818_reco_stage1_reco_stage2_20241005T181403_keepup.root
hd-protodune-det-reco:np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818_reco_stage1_reco_stage2_20241005T181403_keepup_hists.root
Finished2024-10-05 18:16:16
Saved logsjustin-logs:270098.2-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

wiener"
FrameSaver: q=3.26437e+06 n=1105966 tag=wiener
2365 hits in TPC 0
2208 hits in TPC 1
11582 hits in TPC 2
4528 hits in TPC 3
5616 hits in TPC 4
9472 hits in TPC 5
12062 hits in TPC 6
6974 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1230 XUs and 500 XVs -> 16 XUVs
C:0 T:2 156433 XUs and 154375 XVs -> 4680 XUVs
C:0 T:3 79 XUs and 89 XVs -> 3 XUVs
C:0 T:4 183 XUs and 233 XVs -> 5 XUVs
C:0 T:5 31533 XUs and 29975 XVs -> 1274 XUVs
C:0 T:6 132332 XUs and 233489 XVs -> 10474 XUVs
C:0 T:7 3709 XUs and 3017 XVs -> 128 XUVs
16580 XUVs total
3483 collection wire objects
16580 potential space points
Neighbour search...
3096948 tests to find 1291872 neighbours
Iterating with no regularization...
Begin: 2.11218e+08
0 1.89128e+08
1 1.87768e+08
2 1.87681e+08
Now with regularization...
Begin: 1.84668e+08
0 1.84637e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

05-Oct-2024 12:14:03 MDT  Closed output file "np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818_reco_stage1_reco_stage2_20241005T181403_keepup.root"
05-Oct-2024 12:14:03 MDT  Closed input file "np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              100.724       227.006       316.602       231.199       51.5963        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000648573   0.00478986     0.0239448    0.00343579    0.00532923       40     
produce:fembfilter:PDHDFEMBFilter                       1.04012       1.31947       1.52119       1.33752      0.0933294       40     
produce:wclsdatahd:WireCellToolkit                      65.2214       78.4231       95.9906       80.3382       8.43652        40     
produce:gaushit:GausHitFinder                          0.575344       1.3002        2.58846       1.27751      0.347757        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000230025   0.000684591   0.00137793    0.000597999   0.000265823      40     
produce:reco3d:SpacePointSolver                        0.308221       3.08458       12.1634       1.50431       3.25707        39     
produce:hitpdune:DisambigFromSpacePoints               0.331771       1.3253        3.19071       1.17773      0.705643        39     
produce:pandora:StandardPandora                         6.88104       32.0821       94.9818       27.0552       15.6982        39     
produce:pandoraWriter:StandardPandora                  0.118505      0.252927      0.408758      0.250539      0.0625327       39     
produce:pandoraTrack:LArPandoraTrackCreation            1.22842       4.56687       10.2771       4.4793        1.7918         39     
produce:pandoraShower:LArPandoraShowerCreation          1.15768       5.72551       10.9551       5.68822       2.48306        39     
produce:pandoracalo:Calorimetry                        0.711787       2.16879       4.13012       1.94581      0.910521        39     
produce:pandoracalonosce:Calorimetry                   0.662825       2.04225       4.23122       1.80474      0.891396        39     
produce:pandorapid:Chi2ParticleID                     0.00165478    0.00334111    0.00594191    0.00316254    0.000987953      39     
produce:pandoraShowercalo:ShowerCalorimetry             1.02115       5.35033       13.5202       4.77563       2.73657        39     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.07553       5.15598       11.8983       4.60769       2.6697         39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry           0.11262      0.231177      0.364243      0.239467      0.0701353       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0411654     0.0934702     0.167469      0.0931093     0.0324493       39     
produce:emtrkmichelid:EmTrackMichelId                   28.7061       84.2081       123.111       87.999        18.9208        39     
[art]:TriggerResults:TriggerResultInserter            2.7979e-05    5.62848e-05   0.00012699    5.27635e-05   1.8099e-05       40     
end_path:out1:RootOutput                               3.978e-06    1.06425e-05   4.1799e-05    9.1675e-06    6.31166e-06      40     
end_path:michelremoving:michelremoving                3.6656e-05     0.126184      0.481661      0.0720068     0.116374        40     
end_path:michelremovinggnocchi:michelremoving         3.7155e-05     0.122837      0.487466      0.0696321     0.117618        40     
end_path:calibanagnocchi:CalibAnaTree                 3.2128e-05      1.79322       3.86745       1.6796       0.865625        40     
end_path:out1:RootOutput(write)                        0.421712       1.09522       1.97378       1.2019       0.362111        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5008.24 MB
  Peak resident set size usage (VmHWM): 2583.51 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818_reco_stage1_reco_stage2_20241005T181403_keepup.root
\tHists: np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818_reco_stage1_reco_stage2_20241005T181403_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818_reco_stage1_reco_stage2_20241005T181403_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818_reco_stage1_reco_stage2_20241005T181403_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728142883.0,
    "core.end_time": 1728152070.0,
    "core.events": [
      3441,
      3442,
      3443,
      3444,
      3445,
      3446,
      3447,
      3448,
      3449,
      3450,
      3451,
      3452,
      3453,
      3454,
      3455,
      3456,
      3457,
      3458,
      3459,
      3460,
      3461,
      3462,
      3463,
      3464,
      3465,
      3466,
      3467,
      3468,
      3469,
      3470,
      3471,
      3472,
      3473,
      3474,
      3475,
      3476,
      3477,
      3478,
      3479,
      3480
    ],
    "core.event_count": 40,
    "core.first_event_number": 3441,
    "core.last_event_number": 3480,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27591
    ],
    "core.runs_subruns": [
      2759100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818_reco_stage1_reco_stage2_20241005T181403_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728142883.0,
    "core.end_time": 1728152070.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27591
    ],
    "core.runs_subruns": [
      2759100001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027591_0086_dataflow0_datawriter_0_20240702T011818.hdf5"
    }
  ]
}
justIN time: 2024-11-24 11:29:04 UTC       justIN version: 01.01.09