justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 254656.11@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID254656.11@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3195
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-12 01:57:24
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-09-12 03:40:49
From worker nodeHostnameb9p06p4981.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-12 02:45:34
Input fileshd-protodune:np04hd_raw_run028558_0102_dataflow6_datawriter_0_20240807T080314.hdf5
Outputting started2024-09-12 03:39:19
Output files
Finished2024-09-12 03:40:49
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ving cooked to 5859 ticks
wclsFrameSaver: saving 44725 traces tagged "gauss"
FrameSaver: q=908787 n=825075 tag=gauss
wclsFrameSaver: saving 61603 traces tagged "wiener"
FrameSaver: q=995818 n=741588 tag=wiener
3461 hits in TPC 0
3413 hits in TPC 1
5306 hits in TPC 2
3821 hits in TPC 3
2044 hits in TPC 4
5729 hits in TPC 5
7577 hits in TPC 6
3275 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 271 XUs and 181 XVs -> 15 XUVs
C:0 T:2 23783 XUs and 47452 XVs -> 2385 XUVs
C:0 T:3 1273 XUs and 14657 XVs -> 63 XUVs
C:0 T:4 78 XUs and 143 XVs -> 3 XUVs
C:0 T:5 32386 XUs and 37317 XVs -> 1927 XUVs
C:0 T:6 28410 XUs and 42698 XVs -> 1195 XUVs
C:0 T:7 17283 XUs and 66271 XVs -> 2395 XUVs
7983 XUVs total
1960 collection wire objects
7983 potential space points
Neighbour search...
824325 tests to find 374758 neighbours
Iterating with no regularization...
Begin: 7.47234e+06
0 6.24405e+06
1 6.15707e+06
2 6.14061e+06
3 6.13517e+06
Now with regularization...
Begin: 5.80015e+06
0 5.79641e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

12-Sep-2024 05:39:06 CEST  Closed output file "np04hd_raw_run028558_0102_dataflow6_datawriter_0_20240807T080314_reco_stage1_reco_stage2_20240912T033906_keepup.root"
12-Sep-2024 05:39:06 CEST  Closed input file "np04hd_raw_run028558_0102_dataflow6_datawriter_0_20240807T080314_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              57.6934       77.9468       102.624       74.0614       13.6373        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000399497   0.00183794    0.00501604    0.00168419     0.0010282       30     
produce:fembfilter:PDHDFEMBFilter                       0.47916      0.627517      0.770791      0.658355      0.109461        30     
produce:wclsdatahd:WireCellToolkit                      27.9631       32.2017       39.2941       32.0257       3.42735        30     
produce:gaushit:GausHitFinder                          0.214496       0.63135      0.972354      0.616914      0.178534        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000167563   0.00031502    0.000709363   0.000300235   0.000101839      30     
produce:reco3d:SpacePointSolver                        0.139458      0.874638       2.92512      0.772948      0.616066        30     
produce:hitpdune:DisambigFromSpacePoints               0.0880421     0.500921       1.01635      0.459534      0.249263        30     
produce:pandora:StandardPandora                         3.93968       11.1934       26.4723       10.5086       4.77462        30     
produce:pandoraWriter:StandardPandora                  0.0702958     0.118407      0.192924      0.106205      0.0369799       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.437806       0.86676       1.55032       0.79681      0.328422        30     
produce:pandoraShower:LArPandoraShowerCreation          0.32898       1.06261       2.14239      0.817811      0.499816        30     
produce:pandoracalo:Calorimetry                        0.267226      0.497469      0.940844      0.432223      0.176494        30     
produce:pandoracalonosce:Calorimetry                   0.242964      0.450839      0.775704      0.400659      0.150543        30     
produce:pandorapid:Chi2ParticleID                     0.00104546    0.00167542    0.00275375    0.00149674    0.000431812      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.308406       1.00289       1.89043      0.809427      0.415122        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.309296      0.965211       1.85049      0.791006      0.399202        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0698089     0.122645      0.257823      0.118105      0.0463247       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0232342     0.0411295     0.0824924     0.0379749     0.0145772       30     
produce:emtrkmichelid:EmTrackMichelId                   17.5912       25.2877       35.0315       25.1214       5.18139        30     
[art]:TriggerResults:TriggerResultInserter            2.1891e-05    3.13209e-05   7.6021e-05    2.95805e-05   9.69737e-06      30     
end_path:out1:RootOutput                               8.101e-06    1.04426e-05   2.5211e-05     9.86e-06     2.99476e-06      30     
end_path:michelremoving:michelremoving                 0.015147      0.0769269     0.366743      0.0305927     0.0816971       30     
end_path:michelremovinggnocchi:michelremoving          0.014053      0.0752274     0.364795      0.0282199     0.0819798       30     
end_path:calibanagnocchi:CalibAnaTree                  0.197497      0.421029      0.668281      0.408192      0.135972        30     
end_path:out1:RootOutput(write)                        0.480417      0.819063       1.24871      0.798415      0.213287        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4967.28 MB
  Peak resident set size usage (VmHWM): 2609.23 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028558_0102_dataflow6_datawriter_0_20240807T080314_reco_stage1_reco_stage2_20240912T033906_keepup.root
\tHists: np04hd_raw_run028558_0102_dataflow6_datawriter_0_20240807T080314_reco_stage1_reco_stage2_20240912T033906_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028558_0102_dataflow6_datawriter_0_20240807T080314_reco_stage1_reco_stage2_20240912T033906_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028558_0102_dataflow6_datawriter_0_20240807T080314_reco_stage1_reco_stage2_20240912T033906_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726109969.0,
    "core.end_time": 1726112347.0,
    "core.events": [
      24470,
      24478,
      24486,
      24494,
      24502,
      24510,
      24534,
      24542,
      24550,
      24558,
      24566,
      24574,
      24582,
      24590,
      24598,
      24606,
      24614,
      24622,
      24630,
      24638,
      24646,
      24654,
      24662,
      24670,
      24678,
      24686,
      24694,
      24702,
      24710,
      24750
    ],
    "core.event_count": 30,
    "core.first_event_number": 24470,
    "core.last_event_number": 24750,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28558
    ],
    "core.runs_subruns": [
      2855800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028558_0102_dataflow6_datawriter_0_20240807T080314.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028558_0102_dataflow6_datawriter_0_20240807T080314_reco_stage1_reco_stage2_20240912T033906_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726109969.0,
    "core.end_time": 1726112347.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28558
    ],
    "core.runs_subruns": [
      2855800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028558_0102_dataflow6_datawriter_0_20240807T080314.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:00:27 UTC       justIN version: 01.01.09