justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264185.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264185.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3451
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 15:56:41
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-09-26 17:25:37
From worker nodeHostnamedune001-2280587.0-lcg2522.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 15:58:07
Input fileshd-protodune:np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654.hdf5
JobscriptExit code0
Real time1h (5129s)
CPU time1h (4666s = 90%)
Outputting started2024-09-26 17:23:37
Output fileshd-protodune-det-reco:np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654_reco_stage1_reco_stage2_20240926T172322_keepup.root
hd-protodune-det-reco:np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654_reco_stage1_reco_stage2_20240926T172322_keepup_hists.root
Finished2024-09-26 17:25:37
Saved logsjustin-logs:264185.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

tagging trace set: wiener with 81065 traces, 81065 summary
Retagger: tagging trace set: gauss with 59932 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 59932 traces tagged "gauss"
FrameSaver: q=1.26852e+06 n=1101875 tag=gauss
wclsFrameSaver: saving 81065 traces tagged "wiener"
FrameSaver: q=1.35842e+06 n=990879 tag=wiener
3536 hits in TPC 0
3983 hits in TPC 1
9831 hits in TPC 2
6072 hits in TPC 3
1937 hits in TPC 4
3583 hits in TPC 5
8532 hits in TPC 6
4605 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 673 XUs and 597 XVs -> 19 XUVs
C:0 T:2 43344 XUs and 41460 XVs -> 744 XUVs
C:0 T:3 1471 XUs and 2965 XVs -> 113 XUVs
C:0 T:4 146 XUs and 213 XVs -> 11 XUVs
C:0 T:5 11139 XUs and 61919 XVs -> 234 XUVs
C:0 T:6 32771 XUs and 25044 XVs -> 726 XUVs
C:0 T:7 903 XUs and 1017 XVs -> 31 XUVs
1878 XUVs total
1181 collection wire objects
1878 potential space points
Neighbour search...
24184 tests to find 14068 neighbours
Iterating with no regularization...
Begin: 9.92353e+06
0 9.70547e+06
1 9.69449e+06
2 9.6936e+06
Now with regularization...
Begin: 9.09524e+06
0 9.09491e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 17:23:22 UTC  Closed output file "np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654_reco_stage1_reco_stage2_20240926T172322_keepup.root"
26-Sep-2024 17:23:22 UTC  Closed input file "np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              84.5086       117.297       167.123       114.201       20.0932        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00075121    0.00368285    0.00630962    0.00340437    0.00132179       30     
produce:fembfilter:PDHDFEMBFilter                      0.737773      0.884011       1.00461      0.883566      0.0557469       30     
produce:wclsdatahd:WireCellToolkit                      44.8405       46.2452       48.2651       46.3124      0.868083        30     
produce:gaushit:GausHitFinder                          0.541673      0.970578       1.2566       0.997815      0.207805        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000303705   0.000480291   0.000845331   0.000484836   0.000120964      30     
produce:reco3d:SpacePointSolver                        0.307245       1.60416       6.02071       1.30459       1.33593        30     
produce:hitpdune:DisambigFromSpacePoints               0.254102      0.743403       1.73047      0.740461      0.353916        30     
produce:pandora:StandardPandora                         7.79472       18.0089       34.8959       17.8301       6.19193        30     
produce:pandoraWriter:StandardPandora                  0.155544      0.232415      0.340225      0.234469      0.0447625       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.829896       2.05156       3.96866       2.04917      0.813103        30     
produce:pandoraShower:LArPandoraShowerCreation         0.627268       2.48925       5.72355       2.32209       1.39956        30     
produce:pandoracalo:Calorimetry                        0.442105      0.986278       1.94785      0.974978      0.392953        30     
produce:pandoracalonosce:Calorimetry                   0.347543       0.9011        1.80521      0.867909       0.37152        30     
produce:pandorapid:Chi2ParticleID                     0.00190285    0.00291271    0.00523946    0.00282306    0.000715522      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.638117       2.13166       4.6574        2.19386       1.13282        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.608562       2.06565       4.36302       2.08182       1.0844         30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.128907      0.227559      0.364944      0.235147      0.0623382       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0431685     0.0767707     0.117821      0.0795772     0.0201592       30     
produce:emtrkmichelid:EmTrackMichelId                   21.9111       35.4663       55.2744       36.0715       7.26747        30     
[art]:TriggerResults:TriggerResultInserter            5.6211e-05    9.42649e-05   0.000146522   9.3141e-05    1.83494e-05      30     
end_path:out1:RootOutput                               1.221e-05    2.70722e-05   4.9791e-05    2.7576e-05    9.12875e-06      30     
end_path:michelremoving:michelremoving                 0.027325      0.103604      0.312576      0.0579831     0.0852285       30     
end_path:michelremovinggnocchi:michelremoving          0.0229104     0.0976498     0.311645      0.0538349     0.0863383       30     
end_path:calibanagnocchi:CalibAnaTree                   0.28429      0.660495       1.15156       0.67946      0.253546        30     
end_path:out1:RootOutput(write)                        0.661339       1.12399       1.67982       1.08797      0.272685        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4927.05 MB
  Peak resident set size usage (VmHWM): 2578.59 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654_reco_stage1_reco_stage2_20240926T172322_keepup.root
\tHists: np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654_reco_stage1_reco_stage2_20240926T172322_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654_reco_stage1_reco_stage2_20240926T172322_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654_reco_stage1_reco_stage2_20240926T172322_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727367814.0,
    "core.end_time": 1727371403.0,
    "core.events": [
      515782,
      515798,
      515806,
      515814,
      515822,
      515830,
      515838,
      515846,
      515854,
      515862,
      515870,
      515878,
      515886,
      515894,
      515902,
      515910,
      515918,
      515926,
      515934,
      515942,
      515950,
      515958,
      515966,
      515974,
      515982,
      515990,
      515998,
      516006,
      516014,
      516022
    ],
    "core.event_count": 30,
    "core.first_event_number": 515782,
    "core.last_event_number": 516022,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654_reco_stage1_reco_stage2_20240926T172322_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727367814.0,
    "core.end_time": 1727371403.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_2149_dataflow6_datawriter_0_20240908T022654.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:24:18 UTC       justIN version: 01.01.08