justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269446.5@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269446.5@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3599
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 18:25:43
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-10-04 23:44:11
From worker nodeHostnamewn1207080.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-04 21:49:57
Input fileshd-protodune:np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528.hdf5
JobscriptExit code0
Real time1h (6766s)
CPU time1h (6034s = 89%)
Outputting started2024-10-04 23:42:44
Output fileshd-protodune-det-reco:np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528_reco_stage1_reco_stage2_20241004T234230_keepup.root
hd-protodune-det-reco:np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528_reco_stage1_reco_stage2_20241004T234230_keepup_hists.root
Finished2024-10-04 23:44:11
Saved logsjustin-logs:269446.5-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

5 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 40055 traces tagged "gauss"
FrameSaver: q=914543 n=741296 tag=gauss
wclsFrameSaver: saving 54445 traces tagged "wiener"
FrameSaver: q=978355 n=670437 tag=wiener
1866 hits in TPC 0
1578 hits in TPC 1
2731 hits in TPC 2
1902 hits in TPC 3
2359 hits in TPC 4
3315 hits in TPC 5
8708 hits in TPC 6
5613 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 28 XUs and 16 XVs -> 0 XUVs
C:0 T:2 7836 XUs and 11989 XVs -> 520 XUVs
C:0 T:3 133 XUs and 172 XVs -> 9 XUVs
C:0 T:4 174 XUs and 187 XVs -> 5 XUVs
C:0 T:5 10036 XUs and 7887 XVs -> 193 XUVs
C:0 T:6 27082 XUs and 28934 XVs -> 1779 XUVs
C:0 T:7 511 XUs and 523 XVs -> 26 XUVs
2532 XUVs total
1293 collection wire objects
2532 potential space points
Neighbour search...
78912 tests to find 46048 neighbours
Iterating with no regularization...
Begin: 9.20738e+06
0 8.77006e+06
1 8.74431e+06
2 8.74172e+06
Now with regularization...
Begin: 8.10223e+06
0 8.10146e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

05-Oct-2024 00:42:30 BST  Closed output file "np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528_reco_stage1_reco_stage2_20241004T234230_keepup.root"
05-Oct-2024 00:42:30 BST  Closed input file "np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              75.4629       125.265       381.151       112.588       50.2146        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00053615    0.00279127    0.00516355    0.00262562    0.00126427       39     
produce:fembfilter:PDHDFEMBFilter                      0.673711      0.930591       1.03837      0.974238       0.10223        39     
produce:wclsdatahd:WireCellToolkit                      39.8332       48.9458       54.3138       50.3441       3.67872        39     
produce:gaushit:GausHitFinder                          0.412753      0.927891       1.87445      0.926571      0.308023        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000263436   0.000407243   0.000644974   0.000400665   8.86972e-05      39     
produce:reco3d:SpacePointSolver                        0.192824       1.56619       9.58752      0.652989       2.32354        39     
produce:hitpdune:DisambigFromSpacePoints               0.185468      0.735824       2.47261      0.634457      0.503206        39     
produce:pandora:StandardPandora                         7.03905       22.4872       243.549       15.1808       37.1721        39     
produce:pandoraWriter:StandardPandora                  0.117207      0.242296      0.482006      0.231298      0.0792046       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.590176       1.79884       6.00734       1.4589        1.16531        39     
produce:pandoraShower:LArPandoraShowerCreation         0.469699       2.0246        6.89488       1.51687       1.49263        39     
produce:pandoracalo:Calorimetry                        0.334656      0.857613       2.52766       0.76121      0.506367        39     
produce:pandoracalonosce:Calorimetry                   0.220383      0.790228       2.44124      0.682707      0.504474        39     
produce:pandorapid:Chi2ParticleID                     0.00111661    0.00259206    0.00510237    0.00256365    0.000857704      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.365757       1.85428       6.57641       1.49241       1.39671        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.358163       1.74406       5.93703       1.43599       1.20846        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0863036     0.209727      0.437141      0.222577      0.0785471       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0331575     0.0717263     0.158939      0.0739508     0.0256453       39     
produce:emtrkmichelid:EmTrackMichelId                   17.4509       37.8459       75.0343       37.7514       10.4663        39     
[art]:TriggerResults:TriggerResultInserter            1.5739e-05    4.68122e-05   0.000193885   4.1719e-05    2.83888e-05      39     
end_path:out1:RootOutput                               3.888e-06    7.64226e-06   2.8123e-05     6.482e-06    4.21053e-06      39     
end_path:michelremoving:michelremoving                 0.0222679      0.11348      0.485025      0.0420886     0.126341        39     
end_path:michelremovinggnocchi:michelremoving          0.021181      0.111635      0.482793      0.0398542     0.125118        39     
end_path:calibanagnocchi:CalibAnaTree                  0.228592      0.654139       2.18148      0.578535      0.373155        39     
end_path:out1:RootOutput(write)                        0.756776       1.18659       2.03504       1.1487       0.286223        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4973.25 MB
  Peak resident set size usage (VmHWM): 2621.35 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528_reco_stage1_reco_stage2_20241004T234230_keepup.root
\tHists: np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528_reco_stage1_reco_stage2_20241004T234230_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528_reco_stage1_reco_stage2_20241004T234230_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528_reco_stage1_reco_stage2_20241004T234230_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728080400.0,
    "core.end_time": 1728085351.0,
    "core.events": [
      5929,
      5931,
      5933,
      5935,
      5937,
      5939,
      5941,
      5943,
      5945,
      5947,
      5949,
      5951,
      5953,
      5955,
      5957,
      5959,
      5961,
      5963,
      5965,
      5967,
      5969,
      5971,
      5973,
      5975,
      5977,
      5979,
      5981,
      5983,
      5985,
      5987,
      5989,
      5991,
      5993,
      5995,
      5997,
      5999,
      6001,
      6003,
      6005
    ],
    "core.event_count": 39,
    "core.first_event_number": 5929,
    "core.last_event_number": 6005,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29405
    ],
    "core.runs_subruns": [
      2940500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528_reco_stage1_reco_stage2_20241004T234230_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728080400.0,
    "core.end_time": 1728085351.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29405
    ],
    "core.runs_subruns": [
      2940500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029405_0076_dataflow1_datawriter_0_20241002T042528.hdf5"
    }
  ]
}
justIN time: 2024-11-24 09:34:13 UTC       justIN version: 01.01.09