justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59578.183@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59578.183@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 06:55:18
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk_multicore
Last heartbeat2024-08-19 08:15:12
From worker nodeHostnamewn-snel-009.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 07:11:10
Input fileshd-protodune:np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914.hdf5
JobscriptExit code0
Real time1h (3768s)
CPU time57m (3457s = 91%)
Outputting started2024-08-19 08:13:59
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914_reco_stage1_reco_stage2_20240819T081349_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914_reco_stage1_reco_stage2_20240819T081349_keepup_hists.root
Finished2024-08-19 08:15:12
Saved logsjustin-logs:59578.183-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

meSaver: saving 53990 traces tagged "gauss"
FrameSaver: q=1.12886e+06 n=949699 tag=gauss
wclsFrameSaver: saving 74857 traces tagged "wiener"
FrameSaver: q=1.2904e+06 n=866674 tag=wiener
8472 hits in TPC 0
6780 hits in TPC 1
2440 hits in TPC 2
1815 hits in TPC 3
6551 hits in TPC 4
9626 hits in TPC 5
2311 hits in TPC 6
1670 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2608 XUs and 2108 XVs -> 124 XUVs
C:0 T:2 3318 XUs and 3049 XVs -> 475 XUVs
C:0 T:3 272 XUs and 497 XVs -> 47 XUVs
C:0 T:4 1166 XUs and 1297 XVs -> 34 XUVs
C:0 T:5 84693 XUs and 121651 XVs -> 4408 XUVs
C:0 T:6 4017 XUs and 3469 XVs -> 527 XUVs
C:0 T:7 212 XUs and 241 XVs -> 22 XUVs
5637 XUVs total
1537 collection wire objects
5637 potential space points
Neighbour search...
419911 tests to find 187384 neighbours
Iterating with no regularization...
Begin: 8.6556e+06
0 7.57868e+06
1 7.46962e+06
2 7.45764e+06
3 7.45404e+06
Now with regularization...
Begin: 6.94353e+06
0 6.94145e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 10:13:49 CEST  Closed output file "np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914_reco_stage1_reco_stage2_20240819T081349_keepup.root"
19-Aug-2024 10:13:49 CEST  Closed input file "np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              55.8312       86.8582       147.915       84.9097       21.1942        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00032574     0.0020415    0.00424859    0.00185745    0.00110101       30     
produce:fembfilter:PDHDFEMBFilter                      0.497215      0.578483      0.867495      0.520955      0.0972657       30     
produce:wclsdatahd:WireCellToolkit                      28.1427       29.5891       31.367        29.4546      0.773473        30     
produce:gaushit:GausHitFinder                          0.321784      0.610983      0.930858       0.59098      0.151668        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000215493   0.000360888   0.000524982   0.000354078   7.94158e-05      30     
produce:reco3d:SpacePointSolver                        0.184902      0.911136       3.40379      0.842113       0.6952         30     
produce:hitpdune:DisambigFromSpacePoints                0.13098      0.493884       1.08512      0.486831      0.244707        30     
produce:pandora:StandardPandora                         7.19383       20.037        58.9425       15.0931        12.2          30     
produce:pandoraWriter:StandardPandora                  0.084082      0.157917      0.241097      0.152263      0.0367207       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.343359       1.23881       2.55122       1.19855      0.556891        30     
produce:pandoraShower:LArPandoraShowerCreation          0.36864       1.35667       3.32727       1.22457      0.760446        30     
produce:pandoracalo:Calorimetry                        0.188637       0.58136       1.1919       0.544714      0.233885        30     
produce:pandoracalonosce:Calorimetry                   0.167544      0.530737       1.07855      0.489275      0.219438        30     
produce:pandorapid:Chi2ParticleID                     0.00109873     0.0018133    0.00298868    0.00179087    0.000424215      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.295834       1.16551       3.08584       1.04149      0.668442        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.286682       1.1259        2.91083       1.01837      0.634878        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.058673       0.1182       0.166039      0.117778      0.0296486       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.022924      0.0425853     0.0599899     0.0423919     0.010325        30     
produce:emtrkmichelid:EmTrackMichelId                   14.0923       26.117        40.5812       25.5209       5.85359        30     
[art]:TriggerResults:TriggerResultInserter            1.8735e-05    2.75719e-05   7.3147e-05    2.38745e-05   1.04526e-05      30     
end_path:out1:RootOutput                               4.088e-06    5.34197e-06   2.1911e-05    4.7535e-06    3.10959e-06      30     
end_path:michelremoving:michelremoving                 0.0178483     0.105721      0.460053      0.0401664     0.112332        30     
end_path:michelremovinggnocchi:michelremoving          0.0166167     0.103031      0.445047      0.0385927     0.110225        30     
end_path:calibanagnocchi:CalibAnaTree                  0.195035      0.731818       1.35712      0.683402      0.304258        30     
end_path:out1:RootOutput(write)                        0.674005       1.11995        1.41         1.14902      0.171483        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4963.58 MB
  Peak resident set size usage (VmHWM): 2642.07 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914_reco_stage1_reco_stage2_20240819T081349_keepup.root
\tHists: np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914_reco_stage1_reco_stage2_20240819T081349_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914_reco_stage1_reco_stage2_20240819T081349_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914_reco_stage1_reco_stage2_20240819T081349_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724052589.0,
    "core.end_time": 1724055230.0,
    "core.events": [
      356645,
      356653,
      356661,
      356669,
      356677,
      356685,
      356693,
      356701,
      356709,
      356717,
      356725,
      356733,
      356741,
      356749,
      356757,
      356765,
      356773,
      356781,
      356789,
      356797,
      356805,
      356813,
      356821,
      356829,
      356837,
      356845,
      356853,
      356861,
      356869,
      356877
    ],
    "core.event_count": 30,
    "core.first_event_number": 356645,
    "core.last_event_number": 356877,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914_reco_stage1_reco_stage2_20240819T081349_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724052589.0,
    "core.end_time": 1724055230.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1486_dataflow5_datawriter_0_20240819T030914.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:13:02 UTC       justIN version: 01.01.09