justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 253645.116@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID253645.116@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3163
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-10 07:08:13
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2024-09-10 09:25:37
From worker nodeHostnamenode2a05.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-10 08:06:00
Input fileshd-protodune:np04hd_raw_run028550_1546_dataflow5_datawriter_0_20240806T032650.hdf5
Outputting started2024-09-10 09:23:51
Output files
Finished2024-09-10 09:25:37
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ng trace set: gauss with 54888 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 54888 traces tagged "gauss"
FrameSaver: q=1.18024e+06 n=1007161 tag=gauss
wclsFrameSaver: saving 72698 traces tagged "wiener"
FrameSaver: q=1.25238e+06 n=900701 tag=wiener
1534 hits in TPC 0
1593 hits in TPC 1
7388 hits in TPC 2
3378 hits in TPC 3
5671 hits in TPC 4
9095 hits in TPC 5
6042 hits in TPC 6
3472 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 11 XUs and 9 XVs -> 0 XUVs
C:0 T:2 60451 XUs and 51946 XVs -> 1537 XUVs
C:0 T:3 99 XUs and 110 XVs -> 1 XUVs
C:0 T:4 106 XUs and 127 XVs -> 6 XUVs
C:0 T:5 42567 XUs and 37070 XVs -> 1228 XUVs
C:0 T:6 33285 XUs and 61164 XVs -> 2069 XUVs
C:0 T:7 527 XUs and 988 XVs -> 94 XUVs
4935 XUVs total
1880 collection wire objects
4935 potential space points
Neighbour search...
349971 tests to find 170738 neighbours
Iterating with no regularization...
Begin: 8.09154e+06
0 7.55023e+06
1 7.52557e+06
2 7.52068e+06
Now with regularization...
Begin: 7.09511e+06
0 7.09329e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

10-Sep-2024 10:23:42 BST  Closed output file "np04hd_raw_run028550_1546_dataflow5_datawriter_0_20240806T032650_reco_stage1_reco_stage2_20240910T092342_keepup.root"
10-Sep-2024 10:23:42 BST  Closed input file "np04hd_raw_run028550_1546_dataflow5_datawriter_0_20240806T032650_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              70.2753       99.8581       140.462       97.581        18.1915        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000490957   0.00268681    0.00416294    0.00296672    0.00110093       30     
produce:fembfilter:PDHDFEMBFilter                      0.637237      0.694123      0.733872      0.699693      0.0227414       30     
produce:wclsdatahd:WireCellToolkit                      43.235        45.2964       46.4545       45.3537      0.799281        30     
produce:gaushit:GausHitFinder                          0.503259      0.790301       1.1327       0.765832      0.168543        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000345701   0.00866894     0.245385     0.000506426    0.0439572       30     
produce:reco3d:SpacePointSolver                        0.211159       1.51186       4.36169       1.43156       1.04863        30     
produce:hitpdune:DisambigFromSpacePoints                0.22889      0.640415       1.51506      0.556808      0.304396        30     
produce:pandora:StandardPandora                         6.29226       14.2095       33.9142       13.526        6.41078        30     
produce:pandoraWriter:StandardPandora                  0.105901      0.169395      0.248785      0.161672      0.0391772       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.617105       1.8337        4.33776       1.71658      0.890558        30     
produce:pandoraShower:LArPandoraShowerCreation         0.464447       2.06406       4.66825       1.89805       1.11909        30     
produce:pandoracalo:Calorimetry                        0.314472      0.835485       2.00298      0.803566      0.357575        30     
produce:pandoracalonosce:Calorimetry                   0.276114      0.778873       1.96742      0.733182      0.355343        30     
produce:pandorapid:Chi2ParticleID                     0.00113454    0.00181027    0.00262203    0.00174309    0.00037468       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.377577       1.85245       4.35279       1.78277      0.989553        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.366534       1.7963        4.18712       1.6462       0.960733        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0705672     0.137673      0.201206      0.137323      0.0328019       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0292655     0.0517951     0.0729332     0.0506948     0.0121285       30     
produce:emtrkmichelid:EmTrackMichelId                   15.2416       25.4579       35.9045       25.6202       5.65123        30     
[art]:TriggerResults:TriggerResultInserter            2.9248e-05    3.9148e-05    7.0875e-05    3.89805e-05   7.70489e-06      30     
end_path:out1:RootOutput                               7.114e-06    9.40317e-06   2.0476e-05    8.9335e-06    2.41147e-06      30     
end_path:michelremoving:michelremoving                 0.0226884     0.0775214     0.310445      0.0476031     0.0669852       30     
end_path:michelremovinggnocchi:michelremoving          0.0201796     0.072184      0.302811      0.038899      0.0662504       30     
end_path:calibanagnocchi:CalibAnaTree                  0.206826      0.598593       1.30336       0.55501       0.25084        30     
end_path:out1:RootOutput(write)                        0.460254      0.831195       1.21393      0.838482      0.193564        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4893.02 MB
  Peak resident set size usage (VmHWM): 2565.48 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028550_1546_dataflow5_datawriter_0_20240806T032650_reco_stage1_reco_stage2_20240910T092342_keepup.root
\tHists: np04hd_raw_run028550_1546_dataflow5_datawriter_0_20240806T032650_reco_stage1_reco_stage2_20240910T092342_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028550_1546_dataflow5_datawriter_0_20240806T032650_reco_stage1_reco_stage2_20240910T092342_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028550_1546_dataflow5_datawriter_0_20240806T032650_reco_stage1_reco_stage2_20240910T092342_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1725957190.0,
    "core.end_time": 1725960223.0,
    "core.events": [
      371045,
      371053,
      371061,
      371069,
      371077,
      371085,
      371093,
      371101,
      371109,
      371117,
      371125,
      371133,
      371141,
      371149,
      371157,
      371165,
      371173,
      371181,
      371189,
      371197,
      371205,
      371213,
      371221,
      371245,
      371253,
      371261,
      371269,
      371277,
      371285,
      371293
    ],
    "core.event_count": 30,
    "core.first_event_number": 371045,
    "core.last_event_number": 371293,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28550
    ],
    "core.runs_subruns": [
      2855000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028550_1546_dataflow5_datawriter_0_20240806T032650.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028550_1546_dataflow5_datawriter_0_20240806T032650_reco_stage1_reco_stage2_20240910T092342_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1725957190.0,
    "core.end_time": 1725960223.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28550
    ],
    "core.runs_subruns": [
      2855000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028550_1546_dataflow5_datawriter_0_20240806T032650.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:23:20 UTC       justIN version: 01.01.08