justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264522.4@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264522.4@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3519
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 01:10:31
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-09-27 07:30:21
From worker nodeHostnamespool1580.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 03:40:22
Input fileshd-protodune:np04hd_raw_run027409_0202_dataflow3_datawriter_0_20240625T003212.hdf5
Outputting started2024-09-27 05:16:07
Output files
Finished2024-09-27 07:30:21
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ummary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 51761 traces tagged "gauss"
FrameSaver: q=2.02037e+06 n=969611 tag=gauss
wclsFrameSaver: saving 67369 traces tagged "wiener"
FrameSaver: q=2.18858e+06 n=891739 tag=wiener
2934 hits in TPC 0
4277 hits in TPC 1
5959 hits in TPC 2
3423 hits in TPC 3
3585 hits in TPC 4
7109 hits in TPC 5
6715 hits in TPC 6
5116 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3347 XUs and 3222 XVs -> 91 XUVs
C:0 T:2 20286 XUs and 22217 XVs -> 1177 XUVs
C:0 T:3 177 XUs and 112 XVs -> 4 XUVs
C:0 T:4 1052 XUs and 1473 XVs -> 162 XUVs
C:0 T:5 16509 XUs and 22446 XVs -> 507 XUVs
C:0 T:6 28434 XUs and 26963 XVs -> 1503 XUVs
C:0 T:7 1699 XUs and 2058 XVs -> 43 XUVs
3487 XUVs total
1783 collection wire objects
3487 potential space points
Neighbour search...
122399 tests to find 54264 neighbours
Iterating with no regularization...
Begin: 3.30869e+07
0 2.84868e+07
1 2.81913e+07
2 2.81719e+07
Now with regularization...
Begin: 2.54771e+07
0 2.54676e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 05:15:57 UTC  Closed output file "np04hd_raw_run027409_0202_dataflow3_datawriter_0_20240625T003212_reco_stage1_reco_stage2_20240927T051557_keepup.root"
27-Sep-2024 05:15:57 UTC  Closed input file "np04hd_raw_run027409_0202_dataflow3_datawriter_0_20240625T003212_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              80.6302       108.656       193.862       104.339       22.6896        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00033487    0.00245534    0.00906716    0.00191278    0.00190031       35     
produce:fembfilter:PDHDFEMBFilter                      0.693837      0.762778       1.03889      0.720103      0.0941118       35     
produce:wclsdatahd:WireCellToolkit                      50.541        56.6452       66.4727       56.0709       3.52641        35     
produce:gaushit:GausHitFinder                          0.523919      0.873504       1.52559      0.850039      0.205425        35     
produce:nhitsfilter:NumberOfHitsFilter                0.00032931    0.000611953   0.00119386    0.000586819   0.000165762      35     
produce:reco3d:SpacePointSolver                        0.303445       1.13328       4.77259      0.926124      0.898871        35     
produce:hitpdune:DisambigFromSpacePoints               0.160076       0.50983       1.23356      0.440632      0.259448        35     
produce:pandora:StandardPandora                         4.6768        14.3144       42.4882       12.1483       8.01396        35     
produce:pandoraWriter:StandardPandora                  0.101578      0.188591       0.35266      0.186071      0.0516853       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.08624       2.97983       9.33208       2.68244       1.59752        35     
produce:pandoraShower:LArPandoraShowerCreation         0.948589       3.72142       14.0376       3.07688       2.42026        35     
produce:pandoracalo:Calorimetry                        0.379891       1.18071       3.10258       1.07255      0.573442        35     
produce:pandoracalonosce:Calorimetry                   0.318744       1.0989        2.68708       1.00367      0.518993        35     
produce:pandorapid:Chi2ParticleID                     0.00129481    0.00224022    0.00479406    0.00214145    0.000678606      35     
produce:pandoraShowercalo:ShowerCalorimetry             0.63189       2.73822       9.92457       2.28013       1.7509         35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.589389       2.58431       9.78974       2.25505       1.73099        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.055887      0.122932      0.242391      0.110425      0.0429636       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0290668     0.0587714     0.108742      0.0521489     0.020011        35     
produce:emtrkmichelid:EmTrackMichelId                   11.4735       17.6416       25.2501       17.1039       3.70481        35     
[art]:TriggerResults:TriggerResultInserter            3.0105e-05    6.1929e-05    0.000154627   5.8535e-05    2.12497e-05      35     
end_path:out1:RootOutput                              1.0736e-05    1.8487e-05    6.3412e-05    1.7045e-05    8.87155e-06      35     
end_path:michelremoving:michelremoving                 0.0200943     0.0845274     0.353376      0.050652      0.0730821       35     
end_path:michelremovinggnocchi:michelremoving          0.0197767     0.081097       0.35448      0.0546027     0.0727444       35     
end_path:calibanagnocchi:CalibAnaTree                   0.32912      0.854478       2.45094      0.757645       0.41944        35     
end_path:out1:RootOutput(write)                         0.42402      0.754051       1.23467      0.754677      0.210469        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5796.33 MB
  Peak resident set size usage (VmHWM): 2623.9 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027409_0202_dataflow3_datawriter_0_20240625T003212_reco_stage1_reco_stage2_20240927T051557_keepup.root
\tHists: np04hd_raw_run027409_0202_dataflow3_datawriter_0_20240625T003212_reco_stage1_reco_stage2_20240927T051557_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027409_0202_dataflow3_datawriter_0_20240625T003212_reco_stage1_reco_stage2_20240927T051557_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027409_0202_dataflow3_datawriter_0_20240625T003212_reco_stage1_reco_stage2_20240927T051557_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727410298.0,
    "core.end_time": 1727414158.0,
    "core.events": [
      28439,
      28443,
      28447,
      28451,
      28455,
      28459,
      28463,
      28467,
      28471,
      28475,
      28479,
      28483,
      28487,
      28491,
      28495,
      28499,
      28503,
      28507,
      28511,
      28515,
      28519,
      28523,
      28527,
      28531,
      28535,
      28539,
      28543,
      28547,
      28551,
      28555,
      28559,
      28563,
      28567,
      28571,
      28575
    ],
    "core.event_count": 35,
    "core.first_event_number": 28439,
    "core.last_event_number": 28575,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27409
    ],
    "core.runs_subruns": [
      2740900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027409_0202_dataflow3_datawriter_0_20240625T003212.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027409_0202_dataflow3_datawriter_0_20240625T003212_reco_stage1_reco_stage2_20240927T051557_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727410298.0,
    "core.end_time": 1727414158.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27409
    ],
    "core.runs_subruns": [
      2740900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027409_0202_dataflow3_datawriter_0_20240625T003212.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:28:54 UTC       justIN version: 01.01.08