justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59503.64@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59503.64@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 23:43:04
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug_multicore
Last heartbeat2024-08-19 00:44:15
From worker nodeHostnamewn-snel-009.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 23:45:08
Input fileshd-protodune:np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457.hdf5
JobscriptExit code0
Real time57m (3440s)
CPU time52m (3159s = 91%)
Outputting started2024-08-19 00:42:39
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457_reco_stage1_reco_stage2_20240819T004219_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457_reco_stage1_reco_stage2_20240819T004219_keepup_hists.root
Finished2024-08-19 00:44:15
Saved logsjustin-logs:59503.64-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

agging trace set: wiener with 83345 traces, 83345 summary
Retagger: tagging trace set: gauss with 61377 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 61377 traces tagged "gauss"
FrameSaver: q=1.45898e+06 n=1125793 tag=gauss
wclsFrameSaver: saving 83345 traces tagged "wiener"
FrameSaver: q=1.58701e+06 n=1020736 tag=wiener
4349 hits in TPC 0
5171 hits in TPC 1
7389 hits in TPC 2
4917 hits in TPC 3
4573 hits in TPC 4
5341 hits in TPC 5
6873 hits in TPC 6
4050 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7066 XUs and 3594 XVs -> 452 XUVs
C:0 T:2 34414 XUs and 25473 XVs -> 1399 XUVs
C:0 T:3 152 XUs and 231 XVs -> 9 XUVs
C:0 T:4 79 XUs and 77 XVs -> 3 XUVs
C:0 T:5 25427 XUs and 18528 XVs -> 712 XUVs
C:0 T:6 28471 XUs and 25233 XVs -> 1267 XUVs
C:0 T:7 497 XUs and 390 XVs -> 11 XUVs
3853 XUVs total
1524 collection wire objects
3853 potential space points
Neighbour search...
105381 tests to find 61042 neighbours
Iterating with no regularization...
Begin: 1.93053e+07
0 1.85489e+07
1 1.85004e+07
2 1.84949e+07
Now with regularization...
Begin: 1.74428e+07
0 1.74398e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 02:42:19 CEST  Closed output file "np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457_reco_stage1_reco_stage2_20240819T004219_keepup.root"
19-Aug-2024 02:42:19 CEST  Closed input file "np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              58.1494       76.953        103.346       76.8849       11.5655        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000301545   0.00161372    0.00374832    0.00159276    0.000853833      30     
produce:fembfilter:PDHDFEMBFilter                      0.487834      0.533083      0.693312      0.498168      0.0532286       30     
produce:wclsdatahd:WireCellToolkit                      27.3867       28.6011       30.7303       28.4542      0.867653        30     
produce:gaushit:GausHitFinder                          0.419942      0.572836       0.8479       0.572536      0.0947596       30     
produce:nhitsfilter:NumberOfHitsFilter                0.000243386   0.000356172   0.000572402   0.000343547   8.34081e-05      30     
produce:reco3d:SpacePointSolver                        0.238436       1.03661       2.57375      0.817162      0.643646        30     
produce:hitpdune:DisambigFromSpacePoints               0.216942       0.44796      0.874278      0.402024      0.152039        30     
produce:pandora:StandardPandora                         5.81651       13.959        29.3965       13.1525       5.7496         30     
produce:pandoraWriter:StandardPandora                  0.108199      0.141497      0.186453      0.141719      0.0223196       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.565582       1.03751       1.63339       1.00312       0.29599        30     
produce:pandoraShower:LArPandoraShowerCreation         0.521957       1.22125       2.14307       1.13579      0.452699        30     
produce:pandoracalo:Calorimetry                        0.325344      0.534655       1.43406      0.505199      0.204542        30     
produce:pandoracalonosce:Calorimetry                   0.286639      0.491773       1.45258      0.463674      0.210256        30     
produce:pandorapid:Chi2ParticleID                     0.00105378    0.00151507    0.00301902    0.00147642    0.00036767       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.490646       1.11309       2.86764      0.972448      0.496203        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.478768       1.07836       2.70544      0.953203      0.470653        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0878729     0.120647       0.16634      0.120484      0.0200376       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0316386     0.042553      0.0560523     0.0432561    0.00686901       30     
produce:emtrkmichelid:EmTrackMichelId                   17.6325       23.8463       31.4098       23.7495       3.60743        30     
[art]:TriggerResults:TriggerResultInserter            1.3375e-05    2.41115e-05   7.7966e-05    2.0844e-05    1.15867e-05      30     
end_path:out1:RootOutput                               3.797e-06    5.3279e-06    2.2322e-05     4.573e-06    3.26694e-06      30     
end_path:michelremoving:michelremoving                 0.0244352     0.120038      0.661953      0.0403095     0.148241        30     
end_path:michelremovinggnocchi:michelremoving          0.0238211     0.118646      0.683303      0.0388384     0.150152        30     
end_path:calibanagnocchi:CalibAnaTree                   0.41543      0.719372       1.30972      0.672751      0.226227        30     
end_path:out1:RootOutput(write)                        0.749212       1.09991       1.30091       1.14166      0.146309        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4979.1 MB
  Peak resident set size usage (VmHWM): 2654.94 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457_reco_stage1_reco_stage2_20240819T004219_keepup.root
\tHists: np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457_reco_stage1_reco_stage2_20240819T004219_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457_reco_stage1_reco_stage2_20240819T004219_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457_reco_stage1_reco_stage2_20240819T004219_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724025796.0,
    "core.end_time": 1724028140.0,
    "core.events": [
      242853,
      242893,
      242901,
      242909,
      242917,
      242925,
      242933,
      242941,
      242949,
      242957,
      242965,
      242973,
      242981,
      242989,
      242997,
      243005,
      243013,
      243021,
      243029,
      243037,
      243045,
      243053,
      243061,
      243069,
      243077,
      243085,
      243093,
      243101,
      243109,
      243149
    ],
    "core.event_count": 30,
    "core.first_event_number": 242853,
    "core.last_event_number": 243149,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457_reco_stage1_reco_stage2_20240819T004219_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724025796.0,
    "core.end_time": 1724028140.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1012_dataflow5_datawriter_0_20240818T221457.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:13:02 UTC       justIN version: 01.01.09