justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266114.6@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266114.6@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 01:24:18
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-09-29 03:42:03
From worker nodeHostnamewn1207251.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 01:26:38
Input fileshd-protodune:np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834.hdf5
JobscriptExit code0
Real time2h (8005s)
CPU time2h (7231s = 90%)
Outputting started2024-09-29 03:40:04
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834_reco_stage1_reco_stage2_20240929T033948_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834_reco_stage1_reco_stage2_20240929T033948_keepup_hists.root
Finished2024-09-29 03:42:03
Saved logsjustin-logs:266114.6-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

mary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 51554 traces tagged "gauss"
FrameSaver: q=1.17152e+06 n=1014614 tag=gauss
wclsFrameSaver: saving 67347 traces tagged "wiener"
FrameSaver: q=1.25885e+06 n=926977 tag=wiener
4548 hits in TPC 0
3006 hits in TPC 1
7761 hits in TPC 2
4961 hits in TPC 3
3159 hits in TPC 4
6993 hits in TPC 5
3324 hits in TPC 6
3001 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 298 XUs and 509 XVs -> 11 XUVs
C:0 T:2 24058 XUs and 30728 XVs -> 1108 XUVs
C:0 T:3 244 XUs and 381 XVs -> 5 XUVs
C:0 T:4 151 XUs and 122 XVs -> 3 XUVs
C:0 T:5 50601 XUs and 74853 XVs -> 1804 XUVs
C:0 T:6 9034 XUs and 9524 XVs -> 348 XUVs
C:0 T:7 228 XUs and 310 XVs -> 7 XUVs
3286 XUVs total
1377 collection wire objects
3286 potential space points
Neighbour search...
192422 tests to find 93016 neighbours
Iterating with no regularization...
Begin: 1.34504e+07
0 1.18255e+07
1 1.17361e+07
2 1.17249e+07
Now with regularization...
Begin: 1.09855e+07
0 1.09805e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

29-Sep-2024 04:39:48 BST  Closed output file "np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834_reco_stage1_reco_stage2_20240929T033948_keepup.root"
29-Sep-2024 04:39:48 BST  Closed input file "np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                               96.59        154.626       303.605       136.457       51.1225        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000821527   0.00393098     0.0136171    0.00377279    0.00212977       39     
produce:fembfilter:PDHDFEMBFilter                      0.893111      0.982182       1.04763      0.989131      0.0333401       39     
produce:wclsdatahd:WireCellToolkit                      51.8705       58.6404       72.7758       55.9064       6.11811        39     
produce:gaushit:GausHitFinder                          0.698996       1.18107       2.00024       1.15196      0.325347        39     
produce:nhitsfilter:NumberOfHitsFilter                0.00036123    0.000781113   0.00567821    0.000647529   0.000810883      39     
produce:reco3d:SpacePointSolver                        0.307201       4.9752        43.7122      0.925979       8.63115        39     
produce:hitpdune:DisambigFromSpacePoints               0.306162      0.993357       2.78444      0.753378      0.662142        39     
produce:pandora:StandardPandora                         8.42929       23.9937       82.3082       17.9944       16.0941        39     
produce:pandoraWriter:StandardPandora                  0.168267      0.306208      0.510547      0.286614      0.0898898       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.854934       2.69963       7.21765       2.38017       1.58229        39     
produce:pandoraShower:LArPandoraShowerCreation         0.794552       3.27504       8.12839       2.20936       2.12829        39     
produce:pandoracalo:Calorimetry                        0.431428       1.31696       3.44659       1.0646        0.75931        39     
produce:pandoracalonosce:Calorimetry                   0.364087       1.20655       3.0884       0.970533      0.734281        39     
produce:pandorapid:Chi2ParticleID                     0.00206612    0.00321657    0.00548109     0.0029836    0.000751994      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.648669       2.95574       8.26505       2.13206       2.08883        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.705919       2.9145        7.82367       2.1042        2.11609        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.166312      0.265403      0.424384      0.261951      0.0701956       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0503479     0.0897334     0.159305      0.0892803     0.0265242       39     
produce:emtrkmichelid:EmTrackMichelId                   27.0023       45.9822       83.8629       41.299        15.3247        39     
[art]:TriggerResults:TriggerResultInserter            2.3124e-05    6.44887e-05   0.000103054   6.6756e-05    1.69186e-05      39     
end_path:out1:RootOutput                               5.049e-06    1.07796e-05   3.1139e-05     1.075e-05    4.87029e-06      39     
end_path:michelremoving:michelremoving                 0.0261161      0.1466       0.772915      0.0627686       0.174         39     
end_path:michelremovinggnocchi:michelremoving          0.0239273     0.141453      0.738798      0.0576818     0.170403        39     
end_path:calibanagnocchi:CalibAnaTree                  0.273105      0.987738       3.36292      0.782454      0.678559        39     
end_path:out1:RootOutput(write)                        0.741482       1.3225         2.267        1.28682       0.38142        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4999.69 MB
  Peak resident set size usage (VmHWM): 2651.16 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834_reco_stage1_reco_stage2_20240929T033948_keepup.root
\tHists: np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834_reco_stage1_reco_stage2_20240929T033948_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834_reco_stage1_reco_stage2_20240929T033948_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834_reco_stage1_reco_stage2_20240929T033948_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727575085.0,
    "core.end_time": 1727581189.0,
    "core.events": [
      2497,
      2499,
      2501,
      2503,
      2505,
      2507,
      2509,
      2511,
      2513,
      2515,
      2517,
      2519,
      2521,
      2523,
      2525,
      2527,
      2529,
      2531,
      2533,
      2535,
      2537,
      2539,
      2541,
      2543,
      2545,
      2547,
      2549,
      2551,
      2553,
      2555,
      2557,
      2559,
      2561,
      2563,
      2565,
      2567,
      2569,
      2571,
      2573
    ],
    "core.event_count": 39,
    "core.first_event_number": 2497,
    "core.last_event_number": 2573,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834_reco_stage1_reco_stage2_20240929T033948_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727575085.0,
    "core.end_time": 1727581189.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0032_dataflow1_datawriter_0_20240929T002834.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:25:29 UTC       justIN version: 01.01.08