justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266105.8@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266105.8@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 00:27:52
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-29 02:14:29
From worker nodeHostnamewn1904251.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 00:29:58
Input fileshd-protodune:np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324.hdf5
JobscriptExit code0
Real time1h (6144s)
CPU time1h (5468s = 88%)
Outputting started2024-09-29 02:12:22
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324_reco_stage1_reco_stage2_20240929T021208_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324_reco_stage1_reco_stage2_20240929T021208_keepup_hists.root
Finished2024-09-29 02:14:29
Saved logsjustin-logs:266105.8-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Saver saving cooked to 5859 ticks
wclsFrameSaver: saving 55100 traces tagged "gauss"
FrameSaver: q=1.18513e+06 n=1015091 tag=gauss
wclsFrameSaver: saving 73135 traces tagged "wiener"
FrameSaver: q=1.27561e+06 n=919714 tag=wiener
2645 hits in TPC 0
1865 hits in TPC 1
9159 hits in TPC 2
6727 hits in TPC 3
3081 hits in TPC 4
5482 hits in TPC 5
6913 hits in TPC 6
2579 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 33 XUs and 23 XVs -> 3 XUVs
C:0 T:2 64061 XUs and 77642 XVs -> 3552 XUVs
C:0 T:3 554 XUs and 589 XVs -> 15 XUVs
C:0 T:4 406 XUs and 634 XVs -> 11 XUVs
C:0 T:5 26447 XUs and 16048 XVs -> 853 XUVs
C:0 T:6 52880 XUs and 95078 XVs -> 5488 XUVs
C:0 T:7 49 XUs and 74 XVs -> 2 XUVs
9924 XUVs total
2373 collection wire objects
9924 potential space points
Neighbour search...
1584252 tests to find 669192 neighbours
Iterating with no regularization...
Begin: 9.19014e+06
0 7.78499e+06
1 7.69491e+06
2 7.6817e+06
3 7.67729e+06
Now with regularization...
Begin: 7.09557e+06
0 7.09255e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

29-Sep-2024 03:12:08 BST  Closed output file "np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324_reco_stage1_reco_stage2_20240929T021208_keepup.root"
29-Sep-2024 03:12:08 BST  Closed input file "np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              58.5942       116.818       195.722       111.168       31.7234        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00100902     0.0032546    0.00645679    0.00346667    0.00115614       39     
produce:fembfilter:PDHDFEMBFilter                      0.814711      0.894695       1.28192      0.862632      0.0996351       39     
produce:wclsdatahd:WireCellToolkit                      41.6584       50.4607       57.2917       51.5364       4.31134        39     
produce:gaushit:GausHitFinder                          0.342764      0.924609       1.58405      0.895661      0.258099        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000250169   0.000504071   0.00220895    0.000407555   0.000396271      39     
produce:reco3d:SpacePointSolver                        0.185809       2.51076       16.7061      0.819689       3.92664        37     
produce:hitpdune:DisambigFromSpacePoints               0.106369      0.804205       2.17994      0.670624      0.477716        37     
produce:pandora:StandardPandora                         3.02378       15.9878       44.9028       13.8693       8.87657        37     
produce:pandoraWriter:StandardPandora                  0.0820794     0.244824       0.41058      0.237216      0.0740128       37     
produce:pandoraTrack:LArPandoraTrackCreation            0.31664       1.59336       4.58207       1.44434      0.872883        37     
produce:pandoraShower:LArPandoraShowerCreation         0.217968       1.91369       6.00505       1.50413       1.29899        37     
produce:pandoracalo:Calorimetry                        0.188284      0.838139       2.41254      0.762112      0.414974        37     
produce:pandoracalonosce:Calorimetry                   0.159275      0.743329       2.17233       0.65339      0.392783        37     
produce:pandorapid:Chi2ParticleID                      0.0012565    0.00238026    0.00567116    0.00234513    0.000748014      37     
produce:pandoraShowercalo:ShowerCalorimetry            0.184655       1.71611       5.0736        1.42702       1.08727        37     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.179884       1.63957       5.08308       1.39227       1.01931        37     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0737299      0.19284      0.403707      0.187788      0.0598867       37     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0281543     0.0629532     0.104046      0.0623382     0.0163996       37     
produce:emtrkmichelid:EmTrackMichelId                   15.8382       37.6045       60.4335       37.3366       10.7728        37     
[art]:TriggerResults:TriggerResultInserter            3.1118e-05    6.31462e-05   0.000278303   5.3821e-05    4.09516e-05      39     
end_path:out1:RootOutput                               8.275e-06    1.46325e-05   5.8961e-05    1.1762e-05    8.74131e-06      39     
end_path:michelremoving:michelremoving                4.0827e-05      0.12103      0.702148      0.0420335     0.159239        39     
end_path:michelremovinggnocchi:michelremoving         1.9507e-05     0.115043      0.715717      0.0359659      0.1501         39     
end_path:calibanagnocchi:CalibAnaTree                 1.7132e-05     0.555394       1.57615      0.516854      0.308214        39     
end_path:out1:RootOutput(write)                        0.471846       1.09678       1.94351       1.10831       0.31895        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4981.54 MB
  Peak resident set size usage (VmHWM): 2628.59 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324_reco_stage1_reco_stage2_20240929T021208_keepup.root
\tHists: np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324_reco_stage1_reco_stage2_20240929T021208_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324_reco_stage1_reco_stage2_20240929T021208_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324_reco_stage1_reco_stage2_20240929T021208_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727571309.0,
    "core.end_time": 1727575930.0,
    "core.events": [
      2107,
      2109,
      2111,
      2113,
      2115,
      2117,
      2119,
      2121,
      2123,
      2125,
      2127,
      2129,
      2131,
      2133,
      2135,
      2137,
      2139,
      2141,
      2143,
      2145,
      2147,
      2149,
      2151,
      2153,
      2155,
      2157,
      2159,
      2161,
      2163,
      2165,
      2167,
      2169,
      2171,
      2173,
      2175,
      2177,
      2179,
      2181,
      2183
    ],
    "core.event_count": 39,
    "core.first_event_number": 2107,
    "core.last_event_number": 2183,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324_reco_stage1_reco_stage2_20240929T021208_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727571309.0,
    "core.end_time": 1727575930.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0027_dataflow1_datawriter_0_20240928T232324.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:29:57 UTC       justIN version: 01.01.08