justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79940.6@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79940.6@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3515
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 07:57:23
SiteUS_Wisconsin
EntryHCCHTPC_US_Wisconsin_osg01_rhel7
Last heartbeat2024-09-27 15:50:59
From worker nodeHostnameherringa2001
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit82800 (23 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 13:28:13
Input fileshd-protodune:np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529.hdf5
JobscriptExit code0
Real time2h (7282s)
CPU time1h (5533s = 75%)
Outputting started2024-09-27 15:29:37
Output fileshd-protodune-det-reco:np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529_reco_stage1_reco_stage2_20240927T152903_keepup.root
hd-protodune-det-reco:np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529_reco_stage1_reco_stage2_20240927T152903_keepup_hists.root
Finished2024-09-27 15:50:59
Saved logsjustin-logs:79940.6-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

s in TPC 1
4199 hits in TPC 2
905 hits in TPC 3
4640 hits in TPC 4
7863 hits in TPC 5
7503 hits in TPC 6
5709 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 15970 XUs and 14768 XVs -> 530 XUVs
C:0 T:2 34697 XUs and 54753 XVs -> 1214 XUVs
C:0 T:3 115 XUs and 82 XVs -> 8 XUVs
C:0 T:4 211 XUs and 277 XVs -> 14 XUVs
C:0 T:5 31640 XUs and 24077 XVs -> 1006 XUVs
C:0 T:6 45058 XUs and 61492 XVs -> 2325 XUVs
C:0 T:7 398 XUs and 475 XVs -> 12 XUVs
5109 XUVs total
1998 collection wire objects
5109 potential space points
Neighbour search...
278601 tests to find 147016 neighbours
Iterating with no regularization...
Begin: 3.98184e+07
0 3.60406e+07
1 3.58797e+07
2 3.58606e+07
Now with regularization...
Begin: 3.4056e+07
0 3.40476e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 10:29:03 CDT  Closed output file "np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529_reco_stage1_reco_stage2_20240927T152903_keepup.root"
27-Sep-2024 10:29:03 CDT  Closed input file "np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              55.2892       128.845       184.771       126.475       26.5312        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000727657   0.00260478    0.00505224    0.00222105    0.00135296       35     
produce:fembfilter:PDHDFEMBFilter                      0.876754      0.974025       1.06351      0.983399      0.0365656       35     
produce:wclsdatahd:WireCellToolkit                       44.66        49.7287       53.1041       49.9857       1.72514        35     
produce:gaushit:GausHitFinder                          0.637468       1.09356       1.67852       1.03053      0.244034        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000324779   0.000478535   0.000766429   0.000483538   9.90179e-05      35     
produce:reco3d:SpacePointSolver                        0.219319       1.64271       3.73658       1.48156      0.993455        34     
produce:hitpdune:DisambigFromSpacePoints               0.271977       1.01898       1.74855       1.05394      0.371991        34     
produce:pandora:StandardPandora                         8.68405       22.9325       46.0105       21.2011       9.61823        34     
produce:pandoraWriter:StandardPandora                  0.140776      0.213716      0.316002      0.214452      0.0459868       34     
produce:pandoraTrack:LArPandoraTrackCreation            1.0565        2.05413       4.2113        1.83421      0.792333        34     
produce:pandoraShower:LArPandoraShowerCreation         0.861961       2.39981       4.96958       2.18804       1.0468         34     
produce:pandoracalo:Calorimetry                        0.593591       1.06467       2.03441      0.999775      0.356451        34     
produce:pandoracalonosce:Calorimetry                   0.505284      0.966517       1.9814       0.877756      0.354158        34     
produce:pandorapid:Chi2ParticleID                     0.00210248    0.00282273      0.00396     0.00282399    0.000427309      34     
produce:pandoraShowercalo:ShowerCalorimetry            0.723517       2.22365       4.09732       2.02494      0.936303        34     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.726667       2.12855       3.93849       1.93473      0.903359        34     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.086565      0.202697      0.302991      0.202761      0.0551366       34     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0314051     0.0688715     0.0985879     0.0674493     0.0172714       34     
produce:emtrkmichelid:EmTrackMichelId                   24.6358       40.1705       55.7929       41.2632       8.3691         34     
[art]:TriggerResults:TriggerResultInserter            3.0306e-05    5.10021e-05   0.000173727   4.5816e-05    2.41565e-05      35     
end_path:out1:RootOutput                               9.558e-06    1.5328e-05    3.5917e-05    1.3646e-05    5.06921e-06      35     
end_path:michelremoving:michelremoving                3.9404e-05     0.0944876     0.331183      0.0460749     0.0876044       35     
end_path:michelremovinggnocchi:michelremoving         1.6542e-05     0.090009      0.326461      0.0398521     0.0866806       35     
end_path:calibanagnocchi:CalibAnaTree                 1.5349e-05     0.730612       1.32395      0.692664      0.277707        35     
end_path:out1:RootOutput(write)                        0.485953       1.0868        1.48362       1.13174      0.243837        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5003.7 MB
  Peak resident set size usage (VmHWM): 2631.52 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529_reco_stage1_reco_stage2_20240927T152903_keepup.root
\tHists: np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529_reco_stage1_reco_stage2_20240927T152903_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529_reco_stage1_reco_stage2_20240927T152903_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529_reco_stage1_reco_stage2_20240927T152903_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727446369.0,
    "core.end_time": 1727450944.0,
    "core.events": [
      124183,
      124187,
      124191,
      124195,
      124199,
      124203,
      124207,
      124211,
      124215,
      124219,
      124223,
      124227,
      124231,
      124235,
      124239,
      124243,
      124247,
      124251,
      124255,
      124259,
      124263,
      124267,
      124271,
      124275,
      124279,
      124283,
      124287,
      124291,
      124295,
      124299,
      124303,
      124307,
      124311,
      124315,
      124319
    ],
    "core.event_count": 35,
    "core.first_event_number": 124183,
    "core.last_event_number": 124319,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27388
    ],
    "core.runs_subruns": [
      2738800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529_reco_stage1_reco_stage2_20240927T152903_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727446369.0,
    "core.end_time": 1727450944.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27388
    ],
    "core.runs_subruns": [
      2738800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027388_0887_dataflow3_datawriter_0_20240623T035529.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:30:31 UTC       justIN version: 01.01.08