justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244746.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244746.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 06:57:11
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk_multicore
Last heartbeat2024-08-19 08:34:26
From worker nodeHostnamewn-sate-024.farm.nikhef.nl
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 07:13:40
Input fileshd-protodune:np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809.hdf5
JobscriptExit code0
Real time1h (4777s)
CPU time1h (4471s = 93%)
Outputting started2024-08-19 08:33:18
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809_reco_stage1_reco_stage2_20240819T083309_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809_reco_stage1_reco_stage2_20240819T083309_keepup_hists.root
Finished2024-08-19 08:34:26
Saved logsjustin-logs:244746.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

eSaver: saving 63702 traces tagged "gauss"
FrameSaver: q=1.29095e+06 n=1123978 tag=gauss
wclsFrameSaver: saving 87561 traces tagged "wiener"
FrameSaver: q=1.40384e+06 n=1004541 tag=wiener
7974 hits in TPC 0
5656 hits in TPC 1
5518 hits in TPC 2
2581 hits in TPC 3
5911 hits in TPC 4
7853 hits in TPC 5
6084 hits in TPC 6
3061 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 8363 XUs and 11447 XVs -> 307 XUVs
C:0 T:2 28198 XUs and 38291 XVs -> 1708 XUVs
C:0 T:3 83 XUs and 137 XVs -> 3 XUVs
C:0 T:4 703 XUs and 868 XVs -> 17 XUVs
C:0 T:5 49857 XUs and 50218 XVs -> 1668 XUVs
C:0 T:6 25407 XUs and 35123 XVs -> 1899 XUVs
C:0 T:7 48 XUs and 46 XVs -> 1 XUVs
5603 XUVs total
1620 collection wire objects
5603 potential space points
Neighbour search...
384637 tests to find 213750 neighbours
Iterating with no regularization...
Begin: 7.72957e+06
0 7.01201e+06
1 6.9673e+06
2 6.9601e+06
3 6.95727e+06
Now with regularization...
Begin: 6.47173e+06
0 6.46993e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 10:33:09 CEST  Closed output file "np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809_reco_stage1_reco_stage2_20240819T083309_keepup.root"
19-Aug-2024 10:33:09 CEST  Closed input file "np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              71.7874       117.781       156.032       117.118       21.8529        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000689898   0.00288371    0.00438898    0.00342548    0.00116641       30     
produce:fembfilter:PDHDFEMBFilter                      0.669352      0.680008      0.731025      0.675818      0.0126248       30     
produce:wclsdatahd:WireCellToolkit                      35.9824       37.7156       41.0024       37.389        1.17477        30     
produce:gaushit:GausHitFinder                          0.501553      0.853705       1.12911      0.898934      0.177759        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000247645   0.00037283    0.000523164   0.000379359   6.25275e-05      30     
produce:reco3d:SpacePointSolver                        0.193295       1.23868       3.39897       1.12046      0.794406        30     
produce:hitpdune:DisambigFromSpacePoints               0.198608      0.606821       1.17116      0.595154      0.232676        30     
produce:pandora:StandardPandora                         6.03736       21.1653       47.8956       20.4258        9.487         30     
produce:pandoraWriter:StandardPandora                  0.114298      0.185664       0.2397       0.192898      0.0351164       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.636937       2.21329       3.84542       2.25668      0.840686        30     
produce:pandoraShower:LArPandoraShowerCreation         0.591563       2.49075       4.92347       2.30308       1.15839        30     
produce:pandoracalo:Calorimetry                         0.32279      0.967637       1.69128      0.976513      0.354208        30     
produce:pandoracalonosce:Calorimetry                   0.289488      0.904499       1.58079      0.956363      0.339469        30     
produce:pandorapid:Chi2ParticleID                     0.00160886    0.00229238    0.00302838    0.00230007    0.000373759      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.450529       1.98712       4.2093        1.90688      0.930065        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.445596       1.88053       3.87648       1.84401      0.865172        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0860251     0.163091      0.233518      0.165732      0.0343666       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0296409     0.0569809     0.077959      0.0587672     0.0118109       30     
produce:emtrkmichelid:EmTrackMichelId                   23.7436       42.562        54.7359       44.1611       8.16133        30     
[art]:TriggerResults:TriggerResultInserter            2.2453e-05    4.51443e-05   8.0622e-05    4.6557e-05    1.37049e-05      30     
end_path:out1:RootOutput                               7.454e-06    1.28005e-05   2.5558e-05    1.0986e-05    4.9394e-06       30     
end_path:michelremoving:michelremoving                 0.0194012     0.100178      0.338568      0.0522162     0.0924406       30     
end_path:michelremovinggnocchi:michelremoving          0.0176614     0.0967663     0.333641      0.0464026     0.0926194       30     
end_path:calibanagnocchi:CalibAnaTree                  0.222177      0.705415       1.22427      0.743857      0.272589        30     
end_path:out1:RootOutput(write)                        0.569094       1.03679       1.38528       1.07189      0.209803        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4953.96 MB
  Peak resident set size usage (VmHWM): 2630.48 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809_reco_stage1_reco_stage2_20240819T083309_keepup.root
\tHists: np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809_reco_stage1_reco_stage2_20240819T083309_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809_reco_stage1_reco_stage2_20240819T083309_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809_reco_stage1_reco_stage2_20240819T083309_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724052816.0,
    "core.end_time": 1724056390.0,
    "core.events": [
      336725,
      336733,
      336741,
      336749,
      336757,
      336765,
      336773,
      336781,
      336789,
      336797,
      336805,
      336813,
      336821,
      336829,
      336837,
      336845,
      336853,
      336861,
      336869,
      336877,
      336885,
      336893,
      336901,
      336909,
      336933,
      336941,
      336949,
      336957,
      336965,
      336973
    ],
    "core.event_count": 30,
    "core.first_event_number": 336725,
    "core.last_event_number": 336973,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809_reco_stage1_reco_stage2_20240819T083309_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724052816.0,
    "core.end_time": 1724056390.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1403_dataflow5_datawriter_0_20240819T021809.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:10:51 UTC       justIN version: 01.01.09