justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264410.179@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264410.179@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3518
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 20:50:11
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-09-27 03:14:03
From worker nodeHostnamespool1585.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 00:38:56
Input fileshd-protodune:np04hd_raw_run027399_0251_dataflow1_datawriter_0_20240624T070513.hdf5
Outputting started2024-09-27 03:10:13
Output files
Finished2024-09-27 03:14:03
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

with 53188 traces, 53188 summary
Retagger: tagging trace set: gauss with 40757 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 40757 traces tagged "gauss"
FrameSaver: q=1.59545e+06 n=765427 tag=gauss
wclsFrameSaver: saving 53188 traces tagged "wiener"
FrameSaver: q=1.68589e+06 n=689833 tag=wiener
2244 hits in TPC 0
3074 hits in TPC 1
3655 hits in TPC 2
3061 hits in TPC 3
3642 hits in TPC 4
7557 hits in TPC 5
3982 hits in TPC 6
3566 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 751 XUs and 553 XVs -> 6 XUVs
C:0 T:2 9900 XUs and 10654 XVs -> 421 XUVs
C:0 T:3 519 XUs and 712 XVs -> 12 XUVs
C:0 T:4 450 XUs and 672 XVs -> 19 XUVs
C:0 T:5 20906 XUs and 20875 XVs -> 1018 XUVs
C:0 T:6 8080 XUs and 11898 XVs -> 1112 XUVs
C:0 T:7 116 XUs and 185 XVs -> 2 XUVs
2590 XUVs total
1388 collection wire objects
2590 potential space points
Neighbour search...
39502 tests to find 23196 neighbours
Iterating with no regularization...
Begin: 2.04672e+07
0 1.9311e+07
1 1.92428e+07
2 1.92368e+07
Now with regularization...
Begin: 1.73577e+07
0 1.73561e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 03:09:53 UTC  Closed output file "np04hd_raw_run027399_0251_dataflow1_datawriter_0_20240624T070513_reco_stage1_reco_stage2_20240927T030953_keepup.root"
27-Sep-2024 03:09:53 UTC  Closed input file "np04hd_raw_run027399_0251_dataflow1_datawriter_0_20240624T070513_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              75.2289       134.621       351.792       121.324       48.1373        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000683253   0.00201356    0.00695089    0.00161575    0.00137857       35     
produce:fembfilter:PDHDFEMBFilter                      0.697451      0.930617       1.34971       0.93335      0.126411        35     
produce:wclsdatahd:WireCellToolkit                      44.9997       64.9922       76.2069       67.175        7.94569        35     
produce:gaushit:GausHitFinder                          0.585924       1.04949       1.65246      0.936708      0.301742        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000424966   0.000701027   0.00155785    0.000656869   0.000232574      35     
produce:reco3d:SpacePointSolver                        0.247183       1.80844       18.3728       1.0036        3.02457        35     
produce:hitpdune:DisambigFromSpacePoints                0.16914      0.763592       3.82366      0.602367      0.641793        35     
produce:pandora:StandardPandora                         6.88806       20.9249       136.605       14.1648       23.1882        35     
produce:pandoraWriter:StandardPandora                  0.119662      0.242673      0.482256      0.217895      0.0765997       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.67687       5.23589       17.6667       4.39433       3.18099        35     
produce:pandoraShower:LArPandoraShowerCreation          1.21147       6.07709       23.8781       4.82438       4.64581        35     
produce:pandoracalo:Calorimetry                        0.523106       1.81153       7.06924       1.41425       1.22159        35     
produce:pandoracalonosce:Calorimetry                   0.534068       1.67909       6.68126       1.34344       1.1317         35     
produce:pandorapid:Chi2ParticleID                     0.00165723    0.00354388     0.0151506    0.00307069    0.00233144       35     
produce:pandoraShowercalo:ShowerCalorimetry            0.969393       4.09855       12.5099       3.03594       2.86152        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.936043       3.92873       12.9959       2.74688       2.91164        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0874615     0.183976      0.444305      0.165935      0.0698057       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0322502     0.0784251     0.146473       0.07679      0.026872        35     
produce:emtrkmichelid:EmTrackMichelId                   11.0166       17.9815       31.9983       16.2192       5.03719        35     
[art]:TriggerResults:TriggerResultInserter             4.699e-05    9.51303e-05   0.000236584    9.021e-05    3.31246e-05      35     
end_path:out1:RootOutput                              1.2425e-05    2.5787e-05    4.6157e-05    2.3862e-05    7.71852e-06      35     
end_path:michelremoving:michelremoving                 0.0249601     0.125952      0.392159      0.0998815     0.0782853       35     
end_path:michelremovinggnocchi:michelremoving          0.0241411     0.127546      0.437556      0.0956568     0.0884475       35     
end_path:calibanagnocchi:CalibAnaTree                  0.303091       1.17778       2.96965       1.08118      0.657632        35     
end_path:out1:RootOutput(write)                        0.516154       0.96468       1.55705      0.883836      0.290068        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5822.91 MB
  Peak resident set size usage (VmHWM): 2562.56 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027399_0251_dataflow1_datawriter_0_20240624T070513_reco_stage1_reco_stage2_20240927T030953_keepup.root
\tHists: np04hd_raw_run027399_0251_dataflow1_datawriter_0_20240624T070513_reco_stage1_reco_stage2_20240927T030953_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027399_0251_dataflow1_datawriter_0_20240624T070513_reco_stage1_reco_stage2_20240927T030953_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027399_0251_dataflow1_datawriter_0_20240624T070513_reco_stage1_reco_stage2_20240927T030953_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727401835.0,
    "core.end_time": 1727406595.0,
    "core.events": [
      35145,
      35149,
      35153,
      35157,
      35161,
      35165,
      35169,
      35173,
      35177,
      35181,
      35185,
      35189,
      35193,
      35197,
      35201,
      35205,
      35209,
      35213,
      35217,
      35221,
      35225,
      35229,
      35233,
      35237,
      35241,
      35245,
      35249,
      35253,
      35257,
      35261,
      35265,
      35269,
      35273,
      35277,
      35281
    ],
    "core.event_count": 35,
    "core.first_event_number": 35145,
    "core.last_event_number": 35281,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27399
    ],
    "core.runs_subruns": [
      2739900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027399_0251_dataflow1_datawriter_0_20240624T070513.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027399_0251_dataflow1_datawriter_0_20240624T070513_reco_stage1_reco_stage2_20240927T030953_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727401835.0,
    "core.end_time": 1727406595.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27399
    ],
    "core.runs_subruns": [
      2739900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027399_0251_dataflow1_datawriter_0_20240624T070513.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:23:53 UTC       justIN version: 01.01.08