justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 70414.8@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID70414.8@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3197
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-12 16:59:01
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-12 18:50:04
From worker nodeHostnamewn6219291.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-12 17:00:55
Input fileshd-protodune:np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300.hdf5
JobscriptExit code0
Real time1h (5567s)
CPU time1h (4883s = 87%)
Outputting started2024-09-12 18:33:43
Output fileshd-protodune-det-reco:np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300_reco_stage1_reco_stage2_20240912T183329_keepup.root
hd-protodune-det-reco:np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300_reco_stage1_reco_stage2_20240912T183329_keepup_hists.root
Finished2024-09-12 18:50:04
Saved logsjustin-logs:70414.8-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

wclsFrameSaver: saving 70556 traces tagged "wiener"
FrameSaver: q=1.20025e+06 n=844353 tag=wiener
4291 hits in TPC 0
4254 hits in TPC 1
5199 hits in TPC 2
3635 hits in TPC 3
2527 hits in TPC 4
3249 hits in TPC 5
8523 hits in TPC 6
4210 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 6809 XUs and 3853 XVs -> 70 XUVs
C:0 T:2 20000 XUs and 24181 XVs -> 4792 XUVs
C:0 T:3 671 XUs and 769 XVs -> 66 XUVs
C:0 T:4 77 XUs and 109 XVs -> 0 XUVs
C:0 T:5 6521 XUs and 12053 XVs -> 244 XUVs
C:0 T:6 31439 XUs and 49966 XVs -> 1108 XUVs
C:0 T:7 106 XUs and 153 XVs -> 3 XUVs
6283 XUVs total
1434 collection wire objects
6283 potential space points
Neighbour search...
749645 tests to find 389584 neighbours
Iterating with no regularization...
Begin: 1.00844e+07
0 9.14159e+06
1 9.07603e+06
2 9.06022e+06
3 9.05378e+06
Now with regularization...
Begin: 8.49134e+06
0 8.48493e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

12-Sep-2024 19:33:29 BST  Closed output file "np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300_reco_stage1_reco_stage2_20240912T183329_keepup.root"
12-Sep-2024 19:33:29 BST  Closed input file "np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              69.9102       119.88        167.231       121.017       21.8665        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000603003   0.00286994    0.00495435    0.00258277    0.00123395       30     
produce:fembfilter:PDHDFEMBFilter                      0.724855      0.969494       1.03827      0.982703      0.062241        30     
produce:wclsdatahd:WireCellToolkit                      38.7628       50.297        54.6909       51.5443       3.68579        30     
produce:gaushit:GausHitFinder                          0.558409       1.07802       1.58247       1.07544      0.276124        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000311946   0.000475021   0.000835239   0.000449475   0.000104867      30     
produce:reco3d:SpacePointSolver                        0.235207       1.37156       5.67087      0.846329       1.26439        30     
produce:hitpdune:DisambigFromSpacePoints               0.264463       0.7465        1.39947      0.705913      0.321812        30     
produce:pandora:StandardPandora                         5.33459       18.0345       39.8515       16.7491       7.9755         30     
produce:pandoraWriter:StandardPandora                  0.109232      0.240564      0.370664      0.233449      0.0659231       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.536063       1.72034       3.48038       1.71992      0.748519        30     
produce:pandoraShower:LArPandoraShowerCreation         0.620879       1.86873       4.05729       2.01514       0.91903        30     
produce:pandoracalo:Calorimetry                        0.297341      0.842947       1.57355      0.855233      0.313483        30     
produce:pandoracalonosce:Calorimetry                   0.258468      0.773958       1.44797      0.801178      0.319964        30     
produce:pandorapid:Chi2ParticleID                     0.00130056    0.00275127    0.00561471    0.00272307    0.000799341      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.526871       1.71379       3.96122       1.8138       0.842105        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.511794       1.65948       3.38824       1.73881      0.809405        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.102731      0.231208      0.365348      0.227811      0.0654461       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0354604     0.0756049     0.120179      0.0733846     0.0203869       30     
produce:emtrkmichelid:EmTrackMichelId                   19.2164       36.0428       53.052        36.4619       7.55217        30     
[art]:TriggerResults:TriggerResultInserter            2.8193e-05    4.62609e-05   0.000115678   4.0852e-05    1.68564e-05      30     
end_path:out1:RootOutput                               4.849e-06    7.55977e-06   2.8143e-05     6.151e-06    4.85875e-06      30     
end_path:michelremoving:michelremoving                 0.0245226     0.108438      0.568073      0.0377893     0.139638        30     
end_path:michelremovinggnocchi:michelremoving          0.0238423      0.10675      0.541081      0.0384204     0.136027        30     
end_path:calibanagnocchi:CalibAnaTree                  0.222907      0.616022       1.02737      0.581532      0.233155        30     
end_path:out1:RootOutput(write)                        0.844016       1.21418       1.75727       1.19261      0.254055        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4946.26 MB
  Peak resident set size usage (VmHWM): 2595.93 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300_reco_stage1_reco_stage2_20240912T183329_keepup.root
\tHists: np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300_reco_stage1_reco_stage2_20240912T183329_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300_reco_stage1_reco_stage2_20240912T183329_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300_reco_stage1_reco_stage2_20240912T183329_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726162344.0,
    "core.end_time": 1726166010.0,
    "core.events": [
      15366,
      15374,
      15382,
      15390,
      15398,
      15406,
      15414,
      15422,
      15430,
      15438,
      15446,
      15454,
      15462,
      15470,
      15478,
      15486,
      15494,
      15502,
      15510,
      15518,
      15526,
      15534,
      15542,
      15550,
      15558,
      15566,
      15574,
      15582,
      15590,
      15598
    ],
    "core.event_count": 30,
    "core.first_event_number": 15366,
    "core.last_event_number": 15598,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28590
    ],
    "core.runs_subruns": [
      2859000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300_reco_stage1_reco_stage2_20240912T183329_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726162344.0,
    "core.end_time": 1726166010.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28590
    ],
    "core.runs_subruns": [
      2859000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028590_0064_dataflow6_datawriter_0_20240808T162300.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:40:33 UTC       justIN version: 01.01.09