justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266114.7@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266114.7@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 01:24:18
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-29 03:48:48
From worker nodeHostnamewn1205090.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 01:26:48
Input fileshd-protodune:np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133.hdf5
JobscriptExit code0
Real time2h (8382s)
CPU time2h (7634s = 91%)
Outputting started2024-09-29 03:46:31
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133_reco_stage1_reco_stage2_20240929T034614_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133_reco_stage1_reco_stage2_20240929T034614_keepup_hists.root
Finished2024-09-29 03:48:48
Saved logsjustin-logs:266114.7-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

in TPC 4
6246 hits in TPC 5
3984 hits in TPC 6
1511 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 361 XUs and 157 XVs -> 12 XUVs
C:0 T:2 18930 XUs and 22950 XVs -> 1011 XUVs
C:0 T:3 116 XUs and 113 XVs -> 7 XUVs
C:0 T:4 57 XUs and 75 XVs -> 6 XUVs
C:0 T:5 38277 XUs and 109330 XVs -> 4279 XUVs
C:0 T:6 14165 XUs and 16991 XVs -> 733 XUVs
C:0 T:7 6 XUs and 12 XVs -> 0 XUVs
6048 XUVs total
1208 collection wire objects
6048 potential space points
Neighbour search...
795846 tests to find 362292 neighbours
Iterating with no regularization...
Begin: 1.18454e+07
0 9.10233e+06
1 8.94315e+06
2 8.91897e+06
3 8.91074e+06
Now with regularization...
Begin: 8.50616e+06
0 8.49995e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 2651 TrkackID 7 startx, y, z 73.4343 592.089 195.805  wireno, peakt tpcno 453 1125.44 2 dist 204.222min T, max_T5.12467 1132.52
no of hits closeby  0   event 2651 TrkackID 7 startx, y, z 73.4343 592.089 195.805  wireno, peakt tpcno 453 1125.44 2 dist 204.222min T, max_T5.12467 1132.52
29-Sep-2024 04:46:14 BST  Closed output file "np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133_reco_stage1_reco_stage2_20240929T034614_keepup.root"
29-Sep-2024 04:46:15 BST  Closed input file "np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              63.3842       167.402       1325.5        126.618       191.845        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000535882   0.00345136    0.00926829    0.00333284    0.00164613       39     
produce:fembfilter:PDHDFEMBFilter                      0.941686      0.983467       1.16095       0.97717      0.0340271       39     
produce:wclsdatahd:WireCellToolkit                      50.8051       56.8857       68.4813       55.9955       4.70724        39     
produce:gaushit:GausHitFinder                          0.626349       1.12583       2.64025       1.01921      0.398889        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000289046   0.000518219   0.000958389   0.000448767   0.000164726      39     
produce:reco3d:SpacePointSolver                        0.208511       4.19235       35.2635       1.01773       7.04601        38     
produce:hitpdune:DisambigFromSpacePoints               0.215072       1.01054       4.56604      0.721219      0.885204        38     
produce:pandora:StandardPandora                         7.47981       47.9698       1066.89       15.4597       167.997        38     
produce:pandoraWriter:StandardPandora                  0.141796      0.286467      0.580135      0.249466      0.0948286       38     
produce:pandoraTrack:LArPandoraTrackCreation           0.528565       2.19644       11.513        1.62745       1.9184         38     
produce:pandoraShower:LArPandoraShowerCreation          0.50992       2.62014       11.4434       1.68824       2.36085        38     
produce:pandoracalo:Calorimetry                        0.321245       1.10648       5.56199      0.829523      0.954084        38     
produce:pandoracalonosce:Calorimetry                   0.255856       1.01268       5.51406      0.754933      0.936504        38     
produce:pandorapid:Chi2ParticleID                     0.00180574    0.00293773    0.00663266    0.00266882    0.000900193      38     
produce:pandoraShowercalo:ShowerCalorimetry            0.451504       2.31645       10.8908       1.65945       2.07121        38     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.463789       2.25472       11.0343       1.56717       2.04232        38     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.143027      0.253301      0.491585      0.240146      0.0729567       38     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0496971     0.086949      0.164464      0.0846801     0.0235175       38     
produce:emtrkmichelid:EmTrackMichelId                   23.7378       43.3823       95.3796       39.754        13.951         38     
[art]:TriggerResults:TriggerResultInserter            2.5619e-05    5.66989e-05   0.000108775   5.5294e-05    1.71808e-05      39     
end_path:out1:RootOutput                               4.429e-06    9.60749e-06   6.6285e-05     7.123e-06    9.61041e-06      39     
end_path:michelremoving:michelremoving                3.6589e-05     0.130665       0.57922      0.0465591     0.155302        39     
end_path:michelremovinggnocchi:michelremoving         2.8343e-05     0.128297      0.588421      0.0451255      0.15501        39     
end_path:calibanagnocchi:CalibAnaTree                 2.4166e-05     0.745461       3.55175      0.612082      0.587084        39     
end_path:out1:RootOutput(write)                        0.722983       1.2763        2.58967       1.14888      0.408981        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4998.46 MB
  Peak resident set size usage (VmHWM): 2664.43 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133_reco_stage1_reco_stage2_20240929T034614_keepup.root
\tHists: np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133_reco_stage1_reco_stage2_20240929T034614_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133_reco_stage1_reco_stage2_20240929T034614_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133_reco_stage1_reco_stage2_20240929T034614_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727574982.0,
    "core.end_time": 1727581576.0,
    "core.events": [
      2575,
      2577,
      2579,
      2581,
      2583,
      2585,
      2587,
      2589,
      2591,
      2593,
      2595,
      2597,
      2599,
      2601,
      2603,
      2605,
      2607,
      2609,
      2611,
      2613,
      2615,
      2617,
      2619,
      2621,
      2623,
      2625,
      2627,
      2629,
      2631,
      2633,
      2635,
      2637,
      2639,
      2641,
      2643,
      2645,
      2647,
      2649,
      2651
    ],
    "core.event_count": 39,
    "core.first_event_number": 2575,
    "core.last_event_number": 2651,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133_reco_stage1_reco_stage2_20240929T034614_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727574982.0,
    "core.end_time": 1727581576.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0033_dataflow1_datawriter_0_20240929T004133.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:38:32 UTC       justIN version: 01.01.08