justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 254038.3@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID254038.3@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3162
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-11 03:41:06
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-09-11 05:09:08
From worker nodeHostnamewn2205241.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-11 03:42:21
Input fileshd-protodune:np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201.hdf5
JobscriptExit code0
Real time1h (4234s)
CPU time39m (2394s = 56%)
Outputting started2024-09-11 04:52:56
Output fileshd-protodune-det-reco:np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201_reco_stage1_reco_stage2_20240911T045249_keepup.root
hd-protodune-det-reco:np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201_reco_stage1_reco_stage2_20240911T045249_keepup_hists.root
Finished2024-09-11 05:09:08
Saved logsjustin-logs:254038.3-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 59807 traces, 59807 summary
Retagger: tagging trace set: gauss with 44133 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 44133 traces tagged "gauss"
FrameSaver: q=1.59128e+06 n=762510 tag=gauss
wclsFrameSaver: saving 59807 traces tagged "wiener"
FrameSaver: q=1.71285e+06 n=677595 tag=wiener
2190 hits in TPC 0
3348 hits in TPC 1
5438 hits in TPC 2
3731 hits in TPC 3
3444 hits in TPC 4
5592 hits in TPC 5
4166 hits in TPC 6
2821 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2809 XUs and 2647 XVs -> 73 XUVs
C:0 T:2 16636 XUs and 13377 XVs -> 608 XUVs
C:0 T:3 165 XUs and 166 XVs -> 4 XUVs
C:0 T:4 39 XUs and 14 XVs -> 0 XUVs
C:0 T:5 20884 XUs and 34892 XVs -> 2996 XUVs
C:0 T:6 10088 XUs and 6176 XVs -> 229 XUVs
C:0 T:7 198 XUs and 171 XVs -> 5 XUVs
3915 XUVs total
1004 collection wire objects
3915 potential space points
Neighbour search...
402653 tests to find 227064 neighbours
Iterating with no regularization...
Begin: 2.34252e+07
0 2.15508e+07
1 2.13984e+07
2 2.13752e+07
3 2.13676e+07
Now with regularization...
Begin: 2.00534e+07
0 2.00477e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

11-Sep-2024 05:52:49 BST  Closed output file "np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201_reco_stage1_reco_stage2_20240911T045249_keepup.root"
11-Sep-2024 05:52:49 BST  Closed input file "np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              38.7247       58.5569       85.8315       58.8294       11.1182        31     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000281498   0.000918934   0.00156746    0.000868348   0.000397951      31     
produce:fembfilter:PDHDFEMBFilter                      0.442314      0.449878      0.461651      0.449763     0.00349753       31     
produce:wclsdatahd:WireCellToolkit                      21.9517       22.8406       23.5248       22.8989      0.375072        31     
produce:gaushit:GausHitFinder                          0.278642      0.442489      0.647804      0.459894      0.0908412       31     
produce:nhitsfilter:NumberOfHitsFilter                0.000150282   0.000241565   0.000399669   0.000241623   5.38743e-05      31     
produce:reco3d:SpacePointSolver                        0.144392      0.566417       1.99948      0.452713      0.385873        31     
produce:hitpdune:DisambigFromSpacePoints               0.100877      0.384748       0.79006      0.354836      0.167802        31     
produce:pandora:StandardPandora                         3.67244       10.181        23.4281       8.69746       5.1551         31     
produce:pandoraWriter:StandardPandora                  0.0423538     0.0791951     0.113228      0.0814799     0.0170392       31     
produce:pandoraTrack:LArPandoraTrackCreation           0.302602       0.77469       1.56081      0.784169      0.263492        31     
produce:pandoraShower:LArPandoraShowerCreation         0.245252       0.99892       2.47982      0.934187      0.468539        31     
produce:pandoracalo:Calorimetry                        0.162829      0.434036      0.928813      0.421522      0.153545        31     
produce:pandoracalonosce:Calorimetry                   0.146346      0.404316      0.882418      0.399247      0.146218        31     
produce:pandorapid:Chi2ParticleID                     0.000795462   0.00117739    0.00230057    0.00112988    0.000284708      31     
produce:pandoraShowercalo:ShowerCalorimetry            0.224805        1.003        2.69188      0.925256       0.49805        31     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.218009      0.957485       2.56817       0.87515       0.47551        31     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0376665     0.0750194     0.120486      0.0739224     0.0174014       31     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0124361     0.0244696     0.0399579     0.0241912    0.00568855       31     
produce:emtrkmichelid:EmTrackMichelId                   10.0827       17.941        24.6151       18.5835       3.57332        31     
[art]:TriggerResults:TriggerResultInserter            1.1992e-05    1.50708e-05   5.1496e-05    1.3836e-05    6.76229e-06      31     
end_path:out1:RootOutput                               3.176e-06    6.32387e-06   1.7062e-05     6.292e-06    2.14162e-06      31     
end_path:michelremoving:michelremoving                0.00762838     0.0398631     0.143072      0.0159416     0.039599        31     
end_path:michelremovinggnocchi:michelremoving         0.00813636     0.0386635     0.140595      0.0150761     0.0391559       31     
end_path:calibanagnocchi:CalibAnaTree                  0.105148      0.337173      0.726799      0.334954      0.127576        31     
end_path:out1:RootOutput(write)                         0.26946      0.524946       0.76362       0.53638      0.111462        31     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4987.1 MB
  Peak resident set size usage (VmHWM): 2641.99 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201_reco_stage1_reco_stage2_20240911T045249_keepup.root
\tHists: np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201_reco_stage1_reco_stage2_20240911T045249_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201_reco_stage1_reco_stage2_20240911T045249_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201_reco_stage1_reco_stage2_20240911T045249_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726028530.0,
    "core.end_time": 1726030369.0,
    "core.events": [
      1951,
      1999,
      2007,
      2015,
      2023,
      2031,
      2039,
      2047,
      2055,
      2063,
      2071,
      2079,
      2087,
      2095,
      2103,
      2111,
      2119,
      2127,
      2135,
      2143,
      2151,
      2159,
      2167,
      2175,
      2183,
      2191,
      2199,
      2207,
      2215,
      2223,
      2231
    ],
    "core.event_count": 31,
    "core.first_event_number": 1951,
    "core.last_event_number": 2231,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28113
    ],
    "core.runs_subruns": [
      2811300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201_reco_stage1_reco_stage2_20240911T045249_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726028530.0,
    "core.end_time": 1726030369.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28113
    ],
    "core.runs_subruns": [
      2811300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028113_0008_dataflow7_datawriter_0_20240724T064201.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:25:58 UTC       justIN version: 01.01.09