justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79391.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79391.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3459
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 16:33:48
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-09-26 18:07:50
From worker nodeHostnamewn1207081.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 16:35:07
Input fileshd-protodune:np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555.hdf5
JobscriptExit code0
Real time1h (5459s)
CPU time1h (4803s = 87%)
Outputting started2024-09-26 18:06:07
Output fileshd-protodune-det-reco:np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555_reco_stage1_reco_stage2_20240926T180553_keepup.root
hd-protodune-det-reco:np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555_reco_stage1_reco_stage2_20240926T180553_keepup_hists.root
Finished2024-09-26 18:07:50
Saved logsjustin-logs:79391.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

e set: wiener with 92665 traces, 92665 summary
Retagger: tagging trace set: gauss with 68338 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 68338 traces tagged "gauss"
FrameSaver: q=1.47383e+06 n=1256190 tag=gauss
wclsFrameSaver: saving 92665 traces tagged "wiener"
FrameSaver: q=1.60814e+06 n=1145899 tag=wiener
4027 hits in TPC 0
2356 hits in TPC 1
11145 hits in TPC 2
5342 hits in TPC 3
4851 hits in TPC 4
6917 hits in TPC 5
8002 hits in TPC 6
4368 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 153 XUs and 116 XVs -> 4 XUVs
C:0 T:2 36425 XUs and 67888 XVs -> 2958 XUVs
C:0 T:3 445 XUs and 494 XVs -> 13 XUVs
C:0 T:4 35 XUs and 50 XVs -> 1 XUVs
C:0 T:5 69206 XUs and 85989 XVs -> 5695 XUVs
C:0 T:6 16939 XUs and 41618 XVs -> 746 XUVs
C:0 T:7 129 XUs and 281 XVs -> 3 XUVs
9420 XUVs total
2366 collection wire objects
9420 potential space points
Neighbour search...
591450 tests to find 322322 neighbours
Iterating with no regularization...
Begin: 9.13313e+06
0 7.75946e+06
1 7.60563e+06
2 7.58146e+06
3 7.57442e+06
Now with regularization...
Begin: 6.95898e+06
0 6.95436e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 19:05:53 BST  Closed output file "np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555_reco_stage1_reco_stage2_20240926T180553_keepup.root"
26-Sep-2024 19:05:53 BST  Closed input file "np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              72.4025       120.491       198.794       113.957       27.4024        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000998466   0.00280385    0.00426602    0.00293336    0.00104807       30     
produce:fembfilter:PDHDFEMBFilter                      0.664223      0.947043       1.03326      0.966642      0.0809805       30     
produce:wclsdatahd:WireCellToolkit                      38.1515       49.6444       54.6534       51.5026       4.8908         30     
produce:gaushit:GausHitFinder                          0.429253       1.05078       1.78985       1.03279       0.29146        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000275638   0.000461352   0.000810243   0.000441009   0.000121611      30     
produce:reco3d:SpacePointSolver                        0.134468       1.14073       3.66026      0.975353      0.797483        30     
produce:hitpdune:DisambigFromSpacePoints               0.144856      0.763574       2.02495      0.692314      0.414672        30     
produce:pandora:StandardPandora                         7.20731       18.8008       46.3365       15.8051       9.82395        30     
produce:pandoraWriter:StandardPandora                  0.104162      0.250249      0.460236      0.246882      0.0752967       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.323972       1.68643       3.93873       1.38215      0.866349        30     
produce:pandoraShower:LArPandoraShowerCreation         0.431697       2.04176       6.83329       1.67238       1.3826         30     
produce:pandoracalo:Calorimetry                        0.285101      0.865499       2.10887      0.764251       0.41513        30     
produce:pandoracalonosce:Calorimetry                   0.238509      0.781729       1.98209      0.692242      0.396906        30     
produce:pandorapid:Chi2ParticleID                     0.00143362    0.00262709    0.00550931    0.00255958    0.000823787      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.377618       1.82682       6.43336       1.47224       1.24722        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.400732       1.73525       5.81557       1.47388       1.14853        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry           0.10808      0.222312      0.401157      0.239316      0.0717532       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0357068     0.0746658     0.130694      0.0782949     0.0232415       30     
produce:emtrkmichelid:EmTrackMichelId                   21.4524       36.5177       59.2715       35.9931       8.47702        30     
[art]:TriggerResults:TriggerResultInserter            1.7423e-05    5.06148e-05   9.7954e-05    5.27945e-05   1.79988e-05      30     
end_path:out1:RootOutput                               3.837e-06    8.35843e-06   4.8321e-05     5.846e-06    8.20197e-06      30     
end_path:michelremoving:michelremoving                 0.0147043     0.0670165      0.21677      0.0428726     0.0586566       30     
end_path:michelremovinggnocchi:michelremoving          0.0153075     0.0657468     0.216703      0.0403648     0.0588598       30     
end_path:calibanagnocchi:CalibAnaTree                  0.152828      0.626858       1.22043      0.547988      0.261861        30     
end_path:out1:RootOutput(write)                        0.657238       1.20366       1.9763        1.16532       0.2863         30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4959.38 MB
  Peak resident set size usage (VmHWM): 2619.33 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555_reco_stage1_reco_stage2_20240926T180553_keepup.root
\tHists: np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555_reco_stage1_reco_stage2_20240926T180553_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555_reco_stage1_reco_stage2_20240926T180553_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555_reco_stage1_reco_stage2_20240926T180553_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727370275.0,
    "core.end_time": 1727373954.0,
    "core.events": [
      145466,
      145474,
      145482,
      145490,
      145498,
      145506,
      145514,
      145522,
      145530,
      145538,
      145546,
      145554,
      145562,
      145570,
      145578,
      145586,
      145594,
      145602,
      145610,
      145618,
      145626,
      145634,
      145642,
      145650,
      145658,
      145666,
      145674,
      145682,
      145690,
      145698
    ],
    "core.event_count": 30,
    "core.first_event_number": 145466,
    "core.last_event_number": 145698,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29125
    ],
    "core.runs_subruns": [
      2912500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555_reco_stage1_reco_stage2_20240926T180553_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727370275.0,
    "core.end_time": 1727373954.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29125
    ],
    "core.runs_subruns": [
      2912500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029125_0606_dataflow2_datawriter_0_20240911T044555.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:49:58 UTC       justIN version: 01.01.09