justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59597.134@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59597.134@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2868
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 07:31:43
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp
Last heartbeat2024-08-19 08:59:29
From worker nodeHostnamewn-sate-040.farm.nikhef.nl
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 07:39:28
Input fileshd-protodune:np04hd_raw_run028765_0006_dataflow6_datawriter_0_20240819T062413.hdf5
Outputting started2024-08-19 08:58:09
Output files
Finished2024-08-19 08:59:20
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

bjects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 67495 traces, 67495 summary
Retagger: tagging trace set: gauss with 51017 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 51017 traces tagged "gauss"
FrameSaver: q=1.09391e+06 n=960079 tag=gauss
wclsFrameSaver: saving 67495 traces tagged "wiener"
FrameSaver: q=1.18685e+06 n=878572 tag=wiener
5919 hits in TPC 0
3321 hits in TPC 1
5711 hits in TPC 2
4253 hits in TPC 3
2565 hits in TPC 4
4673 hits in TPC 5
5189 hits in TPC 6
3597 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1217 XUs and 873 XVs -> 52 XUVs
C:0 T:2 29157 XUs and 59480 XVs -> 1654 XUVs
C:0 T:3 525 XUs and 1059 XVs -> 77 XUVs
C:0 T:4 389 XUs and 819 XVs -> 27 XUVs
C:0 T:5 14076 XUs and 14107 XVs -> 392 XUVs
C:0 T:6 25517 XUs and 71332 XVs -> 2577 XUVs
C:0 T:7 98 XUs and 134 XVs -> 5 XUVs
4784 XUVs total
1556 collection wire objects
4784 potential space points
Neighbour search...
201588 tests to find 105420 neighbours
Iterating with no regularization...
Begin: 9.67555e+06
0 8.31393e+06
1 8.1948e+06
2 8.18003e+06
3 8.17548e+06
Now with regularization...
Begin: 7.76562e+06
0 7.76285e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 10:58:00 CEST  Closed output file "np04hd_raw_run028765_0006_dataflow6_datawriter_0_20240819T062413_reco_stage1_reco_stage2_20240819T085800_keepup.root"
19-Aug-2024 10:58:00 CEST  Closed input file "np04hd_raw_run028765_0006_dataflow6_datawriter_0_20240819T062413_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              78.2696       114.694       182.502       113.252       20.8772        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000441419   0.00251836    0.00421966    0.00250682    0.00101398       30     
produce:fembfilter:PDHDFEMBFilter                      0.672067      0.678112      0.695516      0.677889     0.00417569       30     
produce:wclsdatahd:WireCellToolkit                      36.4446       38.1381       40.9243       37.939       0.998081        30     
produce:gaushit:GausHitFinder                          0.509194      0.805156       1.1397       0.808463      0.153009        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000284273   0.000380833   0.000539272   0.000376937   5.20341e-05      30     
produce:reco3d:SpacePointSolver                        0.428955       1.25824       3.2886        1.03629      0.646515        30     
produce:hitpdune:DisambigFromSpacePoints               0.207537      0.545715       1.07673      0.518117      0.195831        30     
produce:pandora:StandardPandora                         7.64273       20.7738       55.6368       20.1332       9.59005        30     
produce:pandoraWriter:StandardPandora                  0.123958      0.187232      0.267932      0.183248      0.0315785       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.764403       2.01032       4.39107       1.94839      0.829844        30     
produce:pandoraShower:LArPandoraShowerCreation         0.678113       2.1321        4.95108       2.12776      0.955486        30     
produce:pandoracalo:Calorimetry                        0.336842       0.86321       1.87427      0.839062      0.316759        30     
produce:pandoracalonosce:Calorimetry                   0.332222      0.775571       1.59414      0.743212      0.283486        30     
produce:pandorapid:Chi2ParticleID                     0.00143593    0.00211573    0.00298294    0.00208948    0.000363911      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.575897       1.64623       3.38287       1.68566      0.673023        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.466716       1.64738       3.4456        1.62198      0.661965        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0993207     0.159375      0.215281      0.154883      0.0279428       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0362128     0.0563443     0.0761325     0.0552974    0.00987615       30     
produce:emtrkmichelid:EmTrackMichelId                   26.7698       41.084        60.0106       40.8145       7.09491        30     
[art]:TriggerResults:TriggerResultInserter            2.4396e-05    4.48905e-05    9.076e-05    4.2244e-05    1.36854e-05      30     
end_path:out1:RootOutput                               7.814e-06    1.10839e-05   2.6229e-05    1.0129e-05    3.47428e-06      30     
end_path:michelremoving:michelremoving                 0.0207043     0.0843092     0.330463      0.0393206     0.0736215       30     
end_path:michelremovinggnocchi:michelremoving          0.0198173     0.079339       0.3145       0.0360574     0.0712682       30     
end_path:calibanagnocchi:CalibAnaTree                  0.243765      0.601379       1.22247      0.567557      0.212792        30     
end_path:out1:RootOutput(write)                         0.63164      0.993091       1.39545      0.981129      0.176195        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4939.66 MB
  Peak resident set size usage (VmHWM): 2622.3 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028765_0006_dataflow6_datawriter_0_20240819T062413_reco_stage1_reco_stage2_20240819T085800_keepup.root
\tHists: np04hd_raw_run028765_0006_dataflow6_datawriter_0_20240819T062413_reco_stage1_reco_stage2_20240819T085800_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028765_0006_dataflow6_datawriter_0_20240819T062413_reco_stage1_reco_stage2_20240819T085800_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028765_0006_dataflow6_datawriter_0_20240819T062413_reco_stage1_reco_stage2_20240819T085800_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724054398.0,
    "core.end_time": 1724057881.0,
    "core.events": [
      1446,
      1454,
      1462,
      1470,
      1478,
      1486,
      1494,
      1502,
      1510,
      1518,
      1526,
      1534,
      1542,
      1550,
      1558,
      1566,
      1574,
      1582,
      1590,
      1598,
      1606,
      1614,
      1622,
      1630,
      1638,
      1646,
      1654,
      1662,
      1702,
      1710
    ],
    "core.event_count": 30,
    "core.first_event_number": 1446,
    "core.last_event_number": 1710,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28765
    ],
    "core.runs_subruns": [
      2876500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028765_0006_dataflow6_datawriter_0_20240819T062413.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028765_0006_dataflow6_datawriter_0_20240819T062413_reco_stage1_reco_stage2_20240819T085800_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724054398.0,
    "core.end_time": 1724057881.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28765
    ],
    "core.runs_subruns": [
      2876500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028765_0006_dataflow6_datawriter_0_20240819T062413.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:20:54 UTC       justIN version: 01.01.08