justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244851.14@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244851.14@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 09:10:30
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp
Last heartbeat2024-08-19 10:17:30
From worker nodeHostnamewn-snel-026.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 09:12:16
Input fileshd-protodune:np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749.hdf5
JobscriptExit code0
Real time1h (3842s)
CPU time58m (3534s = 91%)
Outputting started2024-08-19 10:16:19
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749_reco_stage1_reco_stage2_20240819T101611_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749_reco_stage1_reco_stage2_20240819T101611_keepup_hists.root
Finished2024-08-19 10:17:30
Saved logsjustin-logs:244851.14-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

909 hits in TPC 4
2803 hits in TPC 5
4084 hits in TPC 6
2535 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2998 XUs and 3295 XVs -> 59 XUVs
C:0 T:2 4119 XUs and 4358 XVs -> 153 XUVs
C:0 T:3 151 XUs and 193 XVs -> 3 XUVs
C:0 T:4 258 XUs and 366 XVs -> 11 XUVs
C:0 T:5 4245 XUs and 5979 XVs -> 117 XUVs
C:0 T:6 11028 XUs and 6422 XVs -> 107 XUVs
C:0 T:7 39 XUs and 47 XVs -> 0 XUVs
450 XUVs total
336 collection wire objects
450 potential space points
Neighbour search...
3110 tests to find 2052 neighbours
Iterating with no regularization...
Begin: 2.56645e+06
0 2.50483e+06
1 2.50369e+06
Now with regularization...
Begin: 2.38219e+06
0 2.38205e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 348475 TrkackID 20 startx, y, z 31.0483 552.218 453.445  wireno, peakt tpcno 412 1763.2 5 dist 0min T, max_T1521.31 2005.03
no of hits closeby  0   event 348475 TrkackID 20 startx, y, z 31.0483 552.218 453.445  wireno, peakt tpcno 412 1763.2 5 dist 0min T, max_T1521.31 2005.03
19-Aug-2024 12:16:11 CEST  Closed output file "np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749_reco_stage1_reco_stage2_20240819T101611_keepup.root"
19-Aug-2024 12:16:11 CEST  Closed input file "np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              53.4319       90.5831       155.684       89.9077       22.8608        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000431427   0.00211756    0.00431607    0.00216208    0.000927395      30     
produce:fembfilter:PDHDFEMBFilter                      0.524903      0.538489      0.557507      0.537023     0.00748901       30     
produce:wclsdatahd:WireCellToolkit                      30.4696       31.9653       34.5115       31.9943      0.868597        30     
produce:gaushit:GausHitFinder                          0.365902      0.645993       1.09837      0.654283      0.163269        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000189816   0.000547743   0.000968382   0.000508858   0.000171517      30     
produce:reco3d:SpacePointSolver                        0.0916178      1.12751       4.83302      0.801438       1.01682        30     
produce:hitpdune:DisambigFromSpacePoints               0.115884      0.514929       1.65256      0.469889      0.296312        30     
produce:pandora:StandardPandora                         5.4994        19.9673       43.176        20.5416       10.2196        30     
produce:pandoraWriter:StandardPandora                  0.0745704     0.172173      0.290707      0.170974      0.0463756       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.282276       1.5047        3.9632        1.35242      0.810486        30     
produce:pandoraShower:LArPandoraShowerCreation         0.316419       1.66737       5.23034       1.29772       1.14983        30     
produce:pandoracalo:Calorimetry                        0.167519       0.69812       1.69827      0.646356      0.346908        30     
produce:pandoracalonosce:Calorimetry                   0.141097      0.642153       1.59734      0.570373      0.331904        30     
produce:pandorapid:Chi2ParticleID                     0.00117099    0.00201289    0.00338579    0.00193791    0.00044055       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.286553       1.35997        4.142        1.09155      0.896065        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.278515       1.31792       4.21307       1.05187      0.876296        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0651732     0.128729      0.240253      0.119111      0.0367034       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0219221     0.0466747     0.0834594     0.0452486     0.0128194       30     
produce:emtrkmichelid:EmTrackMichelId                   13.1657       26.6534       45.836        27.0786       6.60368        30     
[art]:TriggerResults:TriggerResultInserter             1.599e-05    2.32609e-05   7.1183e-05    1.9687e-05    1.06781e-05      30     
end_path:out1:RootOutput                               3.327e-06    4.84913e-06   2.0919e-05     4.163e-06    3.05766e-06      30     
end_path:michelremoving:michelremoving                 0.0102308     0.0876225     0.448875      0.0283042     0.108193        30     
end_path:michelremovinggnocchi:michelremoving         0.00934841     0.0858749     0.439307       0.02715      0.106111        30     
end_path:calibanagnocchi:CalibAnaTree                  0.105473      0.503879       1.3972       0.462368      0.264421        30     
end_path:out1:RootOutput(write)                        0.406842      0.807633       1.43493      0.795221      0.212748        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4989.15 MB
  Peak resident set size usage (VmHWM): 2673.2 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749_reco_stage1_reco_stage2_20240819T101611_keepup.root
\tHists: np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749_reco_stage1_reco_stage2_20240819T101611_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749_reco_stage1_reco_stage2_20240819T101611_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749_reco_stage1_reco_stage2_20240819T101611_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724059823.0,
    "core.end_time": 1724062572.0,
    "core.events": [
      348195,
      348251,
      348259,
      348267,
      348275,
      348283,
      348291,
      348299,
      348307,
      348315,
      348323,
      348331,
      348339,
      348347,
      348355,
      348363,
      348371,
      348379,
      348387,
      348395,
      348403,
      348411,
      348419,
      348427,
      348435,
      348443,
      348451,
      348459,
      348467,
      348475
    ],
    "core.event_count": 30,
    "core.first_event_number": 348195,
    "core.last_event_number": 348475,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749_reco_stage1_reco_stage2_20240819T101611_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724059823.0,
    "core.end_time": 1724062572.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1451_dataflow3_datawriter_0_20240819T024749.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:19:59 UTC       justIN version: 01.01.08