justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 70381.6@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID70381.6@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3196
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-12 15:51:34
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2024-09-12 18:17:09
From worker nodeHostnamen250.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-12 16:59:59
Input fileshd-protodune:np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317.hdf5
Outputting started2024-09-12 18:14:55
Output files
Finished2024-09-12 18:17:09
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

: tagging trace set: gauss with 23305 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 23305 traces tagged "gauss"
FrameSaver: q=515907 n=447533 tag=gauss
wclsFrameSaver: saving 30855 traces tagged "wiener"
FrameSaver: q=564259 n=416640 tag=wiener
2529 hits in TPC 0
1627 hits in TPC 1
1265 hits in TPC 2
898 hits in TPC 3
3345 hits in TPC 4
4818 hits in TPC 5
1596 hits in TPC 6
510 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 172 XUs and 175 XVs -> 38 XUVs
C:0 T:2 775 XUs and 1056 XVs -> 103 XUVs
C:0 T:3 85 XUs and 164 XVs -> 1 XUVs
C:0 T:4 322 XUs and 530 XVs -> 14 XUVs
C:0 T:5 21142 XUs and 26180 XVs -> 2987 XUVs
C:0 T:6 1362 XUs and 1507 XVs -> 81 XUVs
C:0 T:7 14 XUs and 10 XVs -> 0 XUVs
3224 XUVs total
895 collection wire objects
3224 potential space points
Neighbour search...
134558 tests to find 81510 neighbours
Iterating with no regularization...
Begin: 5.75002e+06
0 4.92548e+06
1 4.84005e+06
2 4.82653e+06
3 4.82299e+06
Now with regularization...
Begin: 4.36654e+06
0 4.36447e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

12-Sep-2024 19:14:48 BST  Closed output file "np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup.root"
12-Sep-2024 19:14:48 BST  Closed input file "np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                               40.24        61.2721       108.317       60.5492       12.8371        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000436394   0.00130994    0.00260981    0.00117433    0.000553087      30     
produce:fembfilter:PDHDFEMBFilter                      0.445131      0.479036      0.666262      0.451034      0.0696958       30     
produce:wclsdatahd:WireCellToolkit                      24.6934       26.4052       34.6484       25.4652       2.59549        30     
produce:gaushit:GausHitFinder                          0.209145      0.457136      0.766604      0.440273      0.126786        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000138692   0.000243858   0.000341955   0.000236532   4.40609e-05      30     
produce:reco3d:SpacePointSolver                        0.145799      0.627948       1.85003      0.501552      0.437971        30     
produce:hitpdune:DisambigFromSpacePoints               0.0732958      0.34564      0.888871      0.334977      0.182044        30     
produce:pandora:StandardPandora                         3.25578       9.32915       46.1189       7.74114       7.37609        30     
produce:pandoraWriter:StandardPandora                  0.0395017     0.0968108      0.15427      0.0986016     0.0268707       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.160168      0.715171       1.56354       0.68905      0.277149        30     
produce:pandoraShower:LArPandoraShowerCreation         0.177286      0.863062       1.73445      0.880669      0.354205        30     
produce:pandoracalo:Calorimetry                        0.117791      0.401786      0.796102      0.398501      0.142091        30     
produce:pandoracalonosce:Calorimetry                   0.0941988     0.365073      0.717851      0.361905      0.129202        30     
produce:pandorapid:Chi2ParticleID                     0.000760315   0.00125959    0.00186004    0.00119049    0.00025668       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.163326      0.839951       1.62653      0.870183      0.337833        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.161054      0.800943       1.52204      0.835533      0.323328        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0412766     0.0860888     0.194815      0.0856703     0.0277255       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0142187     0.0297764     0.0621477     0.0308264    0.00952323       30     
produce:emtrkmichelid:EmTrackMichelId                   8.61781       18.3514       27.137        18.5043       4.2356         30     
[art]:TriggerResults:TriggerResultInserter            1.4428e-05    2.04965e-05   7.4551e-05    1.8099e-05    1.05255e-05      30     
end_path:out1:RootOutput                               6.492e-06    9.2192e-06    2.7983e-05     8.571e-06    3.71935e-06      30     
end_path:michelremoving:michelremoving                 0.0112758     0.0574196     0.263496      0.0199558     0.0635171       30     
end_path:michelremovinggnocchi:michelremoving          0.0100542     0.0554871     0.260946      0.0188706     0.0633162       30     
end_path:calibanagnocchi:CalibAnaTree                  0.0867417     0.317826      0.560874       0.32266      0.113841        30     
end_path:out1:RootOutput(write)                        0.265837      0.564538      0.784898      0.589379      0.125822        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4920.44 MB
  Peak resident set size usage (VmHWM): 2586.37 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup.root
\tHists: np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726163019.0,
    "core.end_time": 1726164889.0,
    "core.events": [
      205926,
      205934,
      205942,
      205950,
      205958,
      205966,
      205974,
      205982,
      205990,
      205998,
      206006,
      206014,
      206022,
      206030,
      206038,
      206046,
      206054,
      206062,
      206070,
      206078,
      206086,
      206094,
      206102,
      206110,
      206118,
      206126,
      206134,
      206142,
      206150,
      206158
    ],
    "core.event_count": 30,
    "core.first_event_number": 205926,
    "core.last_event_number": 206158,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28563
    ],
    "core.runs_subruns": [
      2856300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726163019.0,
    "core.end_time": 1726164889.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28563
    ],
    "core.runs_subruns": [
      2856300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:50:32 UTC       justIN version: 01.01.09