justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269879.137@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269879.137@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3592
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 05:33:31
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-10-05 07:48:23
From worker nodeHostnamespool0869.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 06:00:42
Input fileshd-protodune:np04hd_raw_run027885_0015_dataflow6_datawriter_0_20240708T213146.hdf5
Outputting started2024-10-05 07:46:06
Output files
Finished2024-10-05 07:48:23
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

agged "gauss"
FrameSaver: q=3.23557e+06 n=1203760 tag=gauss
wclsFrameSaver: saving 95148 traces tagged "wiener"
FrameSaver: q=3.49712e+06 n=1089633 tag=wiener
2148 hits in TPC 0
3219 hits in TPC 1
10811 hits in TPC 2
7664 hits in TPC 3
3177 hits in TPC 4
7782 hits in TPC 5
11148 hits in TPC 6
7578 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 10 XUs and 36 XVs -> 1 XUVs
C:0 T:1 2506 XUs and 2681 XVs -> 347 XUVs
C:0 T:2 90995 XUs and 268030 XVs -> 5619 XUVs
C:0 T:3 1582 XUs and 2665 XVs -> 70 XUVs
C:0 T:4 363 XUs and 431 XVs -> 23 XUVs
C:0 T:5 27450 XUs and 27931 XVs -> 1346 XUVs
C:0 T:6 116339 XUs and 183098 XVs -> 5213 XUVs
C:0 T:7 1156 XUs and 1211 XVs -> 38 XUVs
12657 XUVs total
3466 collection wire objects
12657 potential space points
Neighbour search...
835847 tests to find 421898 neighbours
Iterating with no regularization...
Begin: 1.33975e+08
0 1.18418e+08
1 1.17485e+08
2 1.17399e+08
Now with regularization...
Begin: 1.15008e+08
0 1.1497e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

05-Oct-2024 07:45:52 UTC  Closed output file "np04hd_raw_run027885_0015_dataflow6_datawriter_0_20240708T213146_reco_stage1_reco_stage2_20241005T074552_keepup.root"
05-Oct-2024 07:45:52 UTC  Closed input file "np04hd_raw_run027885_0015_dataflow6_datawriter_0_20240708T213146_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              87.6257       141.721       229.62        133.511       31.1584        31     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000431788   0.00232133    0.00740059    0.00136588    0.00192966       31     
produce:fembfilter:PDHDFEMBFilter                      0.814436      0.928254       1.51083       0.8717       0.158296        31     
produce:wclsdatahd:WireCellToolkit                      55.0295       60.2451       70.1213       59.7214       3.31745        31     
produce:gaushit:GausHitFinder                          0.659856       1.11952       1.70289       1.11364      0.244046        31     
produce:nhitsfilter:NumberOfHitsFilter                0.000388603   0.000667703   0.00105924    0.000619108   0.00018334       31     
produce:reco3d:SpacePointSolver                        0.279687       6.11457       19.934        5.3291        3.98669        31     
produce:hitpdune:DisambigFromSpacePoints               0.341673       1.24202       2.8758        1.14594      0.622568        31     
produce:pandora:StandardPandora                         10.2837       26.7919       58.2976       23.5506       12.7482        31     
produce:pandoraWriter:StandardPandora                  0.135306      0.250568      0.363771      0.241445      0.049253        31     
produce:pandoraTrack:LArPandoraTrackCreation            1.35525       4.36936       8.73708       3.9212        1.97788        31     
produce:pandoraShower:LArPandoraShowerCreation          1.33393       4.84698       11.1349       4.42876       2.32664        31     
produce:pandoracalo:Calorimetry                        0.549808       1.80078       3.56123       1.53578      0.787777        31     
produce:pandoracalonosce:Calorimetry                   0.519319       1.67084       3.59594       1.43639      0.744679        31     
produce:pandorapid:Chi2ParticleID                     0.00149872    0.00259738    0.00435022    0.00236646    0.000631622      31     
produce:pandoraShowercalo:ShowerCalorimetry            0.936264       4.05535       9.79196       3.42007       2.10368        31     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.962766       4.02926       9.21322       3.71245       1.94328        31     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.112569      0.177346      0.294395       0.16333       0.04525        31     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0335909     0.0702923     0.140293      0.0643318     0.0200527       31     
produce:emtrkmichelid:EmTrackMichelId                   12.2304       21.1833       32.126        21.1166       4.31612        31     
[art]:TriggerResults:TriggerResultInserter            3.8093e-05    5.80055e-05   0.000165101   5.2235e-05    2.2728e-05       31     
end_path:out1:RootOutput                               9.327e-06    1.5281e-05     4.344e-05    1.3356e-05    6.57862e-06      31     
end_path:michelremoving:michelremoving                 0.0319616     0.105796      0.428213      0.0654918     0.092127        31     
end_path:michelremovinggnocchi:michelremoving          0.0290667     0.0914927      0.30971      0.0597425     0.0721977       31     
end_path:calibanagnocchi:CalibAnaTree                  0.482563       1.21659       2.61624       1.09901      0.525549        31     
end_path:out1:RootOutput(write)                        0.626667       1.11974       1.94121       1.0901       0.269265        31     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 6093.82 MB
  Peak resident set size usage (VmHWM): 2702.67 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027885_0015_dataflow6_datawriter_0_20240708T213146_reco_stage1_reco_stage2_20241005T074552_keepup.root
\tHists: np04hd_raw_run027885_0015_dataflow6_datawriter_0_20240708T213146_reco_stage1_reco_stage2_20241005T074552_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027885_0015_dataflow6_datawriter_0_20240708T213146_reco_stage1_reco_stage2_20241005T074552_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027885_0015_dataflow6_datawriter_0_20240708T213146_reco_stage1_reco_stage2_20241005T074552_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728109914.0,
    "core.end_time": 1728114353.0,
    "core.events": [
      3726,
      3734,
      3742,
      3750,
      3758,
      3766,
      3774,
      3782,
      3790,
      3798,
      3806,
      3814,
      3822,
      3830,
      3838,
      3846,
      3854,
      3862,
      3870,
      3878,
      3886,
      3894,
      3902,
      3910,
      3918,
      3926,
      3934,
      3942,
      3950,
      3958,
      3966
    ],
    "core.event_count": 31,
    "core.first_event_number": 3726,
    "core.last_event_number": 3966,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27885
    ],
    "core.runs_subruns": [
      2788500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027885_0015_dataflow6_datawriter_0_20240708T213146.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027885_0015_dataflow6_datawriter_0_20240708T213146_reco_stage1_reco_stage2_20241005T074552_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728109914.0,
    "core.end_time": 1728114353.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27885
    ],
    "core.runs_subruns": [
      2788500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027885_0015_dataflow6_datawriter_0_20240708T213146.hdf5"
    }
  ]
}
justIN time: 2024-11-21 19:42:26 UTC       justIN version: 01.01.09