justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 70414.10@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID70414.10@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3197
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-12 16:59:01
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-09-12 18:38:08
From worker nodeHostnamewn2208250.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-12 17:00:46
Input fileshd-protodune:np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712.hdf5
JobscriptExit code0
Real time1h (4909s)
CPU time51m (3119s = 63%)
Outputting started2024-09-12 18:22:36
Output fileshd-protodune-det-reco:np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712_reco_stage1_reco_stage2_20240912T182226_keepup.root
hd-protodune-det-reco:np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712_reco_stage1_reco_stage2_20240912T182226_keepup_hists.root
Finished2024-09-12 18:38:08
Saved logsjustin-logs:70414.10-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ith 43155 traces, 43155 summary
Retagger: tagging trace set: gauss with 32009 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 32009 traces tagged "gauss"
FrameSaver: q=692378 n=596773 tag=gauss
wclsFrameSaver: saving 43155 traces tagged "wiener"
FrameSaver: q=746046 n=539175 tag=wiener
1748 hits in TPC 0
1787 hits in TPC 1
6168 hits in TPC 2
4006 hits in TPC 3
1258 hits in TPC 4
2279 hits in TPC 5
3325 hits in TPC 6
1903 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3141 XUs and 4980 XVs -> 1500 XUVs
C:0 T:2 21940 XUs and 17996 XVs -> 1308 XUVs
C:0 T:3 239 XUs and 305 XVs -> 13 XUVs
C:0 T:4 190 XUs and 260 XVs -> 16 XUVs
C:0 T:5 2353 XUs and 2804 XVs -> 84 XUVs
C:0 T:6 4990 XUs and 13044 XVs -> 1379 XUVs
C:0 T:7 7 XUs and 13 XVs -> 0 XUVs
4300 XUVs total
1511 collection wire objects
4300 potential space points
Neighbour search...
172158 tests to find 106422 neighbours
Iterating with no regularization...
Begin: 7.35899e+06
0 6.77617e+06
1 6.73223e+06
2 6.7231e+06
3 6.72012e+06
Now with regularization...
Begin: 6.25368e+06
0 6.25204e+06
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

12-Sep-2024 19:22:26 BST  Closed output file "np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712_reco_stage1_reco_stage2_20240912T182226_keepup.root"
12-Sep-2024 19:22:26 BST  Closed input file "np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              46.404        73.2958       123.521       70.1034       16.5563        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000469452   0.00178205    0.00366527    0.00177635    0.000732776      30     
produce:fembfilter:PDHDFEMBFilter                      0.460458      0.630103      0.776314      0.679786      0.103148        30     
produce:wclsdatahd:WireCellToolkit                      26.0551       32.0796       39.9973       30.9469       3.87789        30     
produce:gaushit:GausHitFinder                          0.277613      0.561702      0.993872      0.546415      0.198203        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000210004   0.000299964   0.000815841   0.00028509    0.000108084      30     
produce:reco3d:SpacePointSolver                        0.117687       0.75565       2.54445       0.38074      0.680527        30     
produce:hitpdune:DisambigFromSpacePoints               0.104824      0.419148       1.05624      0.380354      0.247578        30     
produce:pandora:StandardPandora                         2.4434        10.5482       41.072        8.08367       7.50913        30     
produce:pandoraWriter:StandardPandora                  0.0548403     0.131442      0.248741      0.129606      0.0524422       30     
produce:pandoraTrack:LArPandoraTrackCreation            0.25088      0.761143       1.25952      0.728155      0.284534        30     
produce:pandoraShower:LArPandoraShowerCreation         0.309901      0.859967       1.71386      0.715985      0.386892        30     
produce:pandoracalo:Calorimetry                        0.140869      0.414874      0.657394      0.426264      0.145596        30     
produce:pandoracalonosce:Calorimetry                    0.13003      0.376227      0.617783      0.369744      0.135432        30     
produce:pandorapid:Chi2ParticleID                     0.00090035    0.00165881    0.00565844    0.00147131    0.000813673      30     
produce:pandoraShowercalo:ShowerCalorimetry             0.28716      0.808638       1.57035      0.676462      0.361097        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.261921      0.788443       1.65182      0.667209       0.3682         30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0418112     0.106149      0.215594       0.10306      0.0418838       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0167208     0.0360612     0.0655779     0.0366458     0.0125615       30     
produce:emtrkmichelid:EmTrackMichelId                   11.9312       22.7044       32.8941       22.2626       5.57724        30     
[art]:TriggerResults:TriggerResultInserter             2.158e-05    3.85543e-05   0.000149421   3.2737e-05    2.35781e-05      30     
end_path:out1:RootOutput                               9.147e-06    2.11408e-05   0.00023986    1.1722e-05    4.10715e-05      30     
end_path:michelremoving:michelremoving                 0.0156696     0.0807036     0.201573      0.0613852     0.0628596       30     
end_path:michelremovinggnocchi:michelremoving          0.0139864     0.0742409     0.194605      0.0538568     0.0593057       30     
end_path:calibanagnocchi:CalibAnaTree                  0.129574      0.328529      0.634103      0.319245      0.112261        30     
end_path:out1:RootOutput(write)                        0.310055      0.731777       1.26058      0.696054      0.231606        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4953.69 MB
  Peak resident set size usage (VmHWM): 2610.11 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712_reco_stage1_reco_stage2_20240912T182226_keepup.root
\tHists: np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712_reco_stage1_reco_stage2_20240912T182226_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712_reco_stage1_reco_stage2_20240912T182226_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712_reco_stage1_reco_stage2_20240912T182226_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726163100.0,
    "core.end_time": 1726165347.0,
    "core.events": [
      244,
      252,
      260,
      268,
      276,
      284,
      292,
      300,
      308,
      316,
      324,
      332,
      340,
      348,
      356,
      364,
      372,
      380,
      388,
      396,
      404,
      412,
      420,
      428,
      436,
      444,
      452,
      460,
      468,
      476
    ],
    "core.event_count": 30,
    "core.first_event_number": 244,
    "core.last_event_number": 476,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28590
    ],
    "core.runs_subruns": [
      2859000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712_reco_stage1_reco_stage2_20240912T182226_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726163100.0,
    "core.end_time": 1726165347.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28590
    ],
    "core.runs_subruns": [
      2859000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028590_0001_dataflow4_datawriter_0_20240808T151712.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:13:35 UTC       justIN version: 01.01.09