justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 77777.8@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID77777.8@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3458
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 00:16:08
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-09-26 06:30:56
From worker nodeHostnamen191.dur.scotgrid.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 03:43:26
Input fileshd-protodune:np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232.hdf5
JobscriptExit code0
Real time1h (7000s)
CPU time1h (5102s = 72%)
Outputting started2024-09-26 05:40:06
Output fileshd-protodune-det-reco:np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232_reco_stage1_reco_stage2_20240926T053958_keepup.root
hd-protodune-det-reco:np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232_reco_stage1_reco_stage2_20240926T053958_keepup_hists.root
Finished2024-09-26 06:30:56
Saved logsjustin-logs:77777.8-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

set: wiener with 42054 traces, 42054 summary
Retagger: tagging trace set: gauss with 31335 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 31335 traces tagged "gauss"
FrameSaver: q=666949 n=575408 tag=gauss
wclsFrameSaver: saving 42054 traces tagged "wiener"
FrameSaver: q=709733 n=517119 tag=wiener
3471 hits in TPC 0
3505 hits in TPC 1
3113 hits in TPC 2
1568 hits in TPC 3
1266 hits in TPC 4
2597 hits in TPC 5
3087 hits in TPC 6
2539 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 979 XUs and 1182 XVs -> 24 XUVs
C:0 T:2 4390 XUs and 3441 XVs -> 196 XUVs
C:0 T:3 13 XUs and 24 XVs -> 1 XUVs
C:0 T:4 0 XUs and 2 XVs -> 0 XUVs
C:0 T:5 4789 XUs and 25916 XVs -> 980 XUVs
C:0 T:6 6104 XUs and 5744 XVs -> 476 XUVs
C:0 T:7 26 XUs and 39 XVs -> 0 XUVs
1677 XUVs total
950 collection wire objects
1677 potential space points
Neighbour search...
49639 tests to find 26472 neighbours
Iterating with no regularization...
Begin: 7.72146e+06
0 7.17745e+06
1 7.13551e+06
2 7.13264e+06
Now with regularization...
Begin: 6.87047e+06
0 6.86957e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 06:39:58 BST  Closed output file "np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232_reco_stage1_reco_stage2_20240926T053958_keepup.root"
26-Sep-2024 06:39:58 BST  Closed input file "np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              68.446        106.682       154.991       108.379       23.393         39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00036832    0.00164227    0.00473042    0.00115188     0.0012821       39     
produce:fembfilter:PDHDFEMBFilter                      0.797084      0.868972       1.17874      0.828969      0.0925379       39     
produce:wclsdatahd:WireCellToolkit                      44.4377       51.4646       61.3359       52.425        4.73897        39     
produce:gaushit:GausHitFinder                          0.477202      0.848116       1.6139       0.827031      0.260003        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000251728   0.000396339   0.000741271   0.000377635   0.000100956      39     
produce:reco3d:SpacePointSolver                        0.212614       2.09524       12.8461       1.22839       2.52909        39     
produce:hitpdune:DisambigFromSpacePoints               0.219535      0.727396       1.96994      0.681027      0.436147        39     
produce:pandora:StandardPandora                         4.93286       15.1938       29.8996       14.1947       7.16327        39     
produce:pandoraWriter:StandardPandora                  0.0889072     0.176568      0.274724       0.17256      0.0500943       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.566297       2.20601       4.19957       1.85018       1.11792        39     
produce:pandoraShower:LArPandoraShowerCreation         0.524034       2.66498       6.09107       2.34538       1.67002        39     
produce:pandoracalo:Calorimetry                        0.304601      0.935846       1.79973      0.962356      0.434254        39     
produce:pandoracalonosce:Calorimetry                   0.256244       0.87068       1.71776      0.881751      0.414084        39     
produce:pandorapid:Chi2ParticleID                     0.00119068    0.00191976    0.00317135    0.00196108    0.000448418      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.449786       2.27069       4.63906       2.19266       1.26434        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.433901       2.18803       4.44382       2.10163       1.22132        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0768759     0.141556       0.21284      0.133882      0.0431505       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0295508     0.054341      0.0831651     0.0514695     0.0159337       39     
produce:emtrkmichelid:EmTrackMichelId                   11.6144       21.9723       36.2153       21.4016       6.36804        39     
[art]:TriggerResults:TriggerResultInserter            2.8127e-05    4.42728e-05   0.000102943   3.9535e-05    1.44434e-05      39     
end_path:out1:RootOutput                               6.896e-06    1.18082e-05   2.9009e-05    1.0735e-05    4.70854e-06      39     
end_path:michelremoving:michelremoving                 0.0242778     0.0926892     0.418121      0.0577699     0.0925509       39     
end_path:michelremovinggnocchi:michelremoving          0.0228653     0.0885178     0.415104      0.0506557     0.0922254       39     
end_path:calibanagnocchi:CalibAnaTree                  0.179737      0.692796       1.27585       0.59063      0.316458        39     
end_path:out1:RootOutput(write)                        0.469517      0.909764       1.69341      0.897009      0.284521        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5870.99 MB
  Peak resident set size usage (VmHWM): 2935.1 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232_reco_stage1_reco_stage2_20240926T053958_keepup.root
\tHists: np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232_reco_stage1_reco_stage2_20240926T053958_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232_reco_stage1_reco_stage2_20240926T053958_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232_reco_stage1_reco_stage2_20240926T053958_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727325000.0,
    "core.end_time": 1727329198.0,
    "core.events": [
      5383,
      5385,
      5387,
      5389,
      5391,
      5393,
      5395,
      5397,
      5399,
      5401,
      5403,
      5405,
      5407,
      5409,
      5411,
      5413,
      5415,
      5417,
      5419,
      5421,
      5423,
      5425,
      5427,
      5429,
      5431,
      5433,
      5435,
      5437,
      5439,
      5441,
      5443,
      5445,
      5447,
      5449,
      5451,
      5453,
      5455,
      5457,
      5459
    ],
    "core.event_count": 39,
    "core.first_event_number": 5383,
    "core.last_event_number": 5459,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29296
    ],
    "core.runs_subruns": [
      2929600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232_reco_stage1_reco_stage2_20240926T053958_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727325000.0,
    "core.end_time": 1727329198.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29296
    ],
    "core.runs_subruns": [
      2929600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029296_0069_dataflow1_datawriter_0_20240926T004232.hdf5"
    }
  ]
}
justIN time: 2024-11-17 03:09:03 UTC       justIN version: 01.01.09