justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79880.11@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79880.11@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3517
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 06:42:54
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-09-27 15:32:28
From worker nodeHostnamespool0752.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 10:40:33
Input fileshd-protodune:np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709.hdf5
Outputting started2024-09-27 12:57:57
Output files
Finished2024-09-27 15:32:28
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ked to 5859 ticks
wclsFrameSaver: saving 63431 traces tagged "gauss"
FrameSaver: q=2.37577e+06 n=1116351 tag=gauss
wclsFrameSaver: saving 87464 traces tagged "wiener"
FrameSaver: q=2.60357e+06 n=1013852 tag=wiener
3706 hits in TPC 0
3271 hits in TPC 1
6798 hits in TPC 2
4502 hits in TPC 3
6757 hits in TPC 4
11704 hits in TPC 5
8018 hits in TPC 6
3617 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 0 XUs and 0 XVs -> 0 XUVs
C:0 T:1 7781 XUs and 3794 XVs -> 486 XUVs
C:0 T:2 19857 XUs and 25127 XVs -> 595 XUVs
C:0 T:3 659 XUs and 1018 XVs -> 48 XUVs
C:0 T:4 306 XUs and 264 XVs -> 6 XUVs
C:0 T:5 60491 XUs and 53390 XVs -> 2577 XUVs
C:0 T:6 57866 XUs and 40519 XVs -> 891 XUVs
C:0 T:7 186 XUs and 184 XVs -> 3 XUVs
4606 XUVs total
2283 collection wire objects
4606 potential space points
Neighbour search...
101108 tests to find 53940 neighbours
Iterating with no regularization...
Begin: 4.76773e+07
0 4.32723e+07
1 4.30112e+07
2 4.29764e+07
Now with regularization...
Begin: 4.09475e+07
0 4.0935e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 12:57:12 UTC  Closed output file "np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup.root"
27-Sep-2024 12:57:12 UTC  Closed input file "np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              100.749       165.877       264.102       163.151       34.3454        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000538059   0.00362401     0.0239628    0.00328514    0.00385815       35     
produce:fembfilter:PDHDFEMBFilter                      0.729295       1.06514       1.35369       1.07422      0.153744        35     
produce:wclsdatahd:WireCellToolkit                      63.4173        73.03        78.2809       74.5871       4.58472        35     
produce:gaushit:GausHitFinder                          0.497674       1.09327       1.65536       1.13127       0.27839        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000324876   0.000463429   0.000759292   0.000453863   9.95497e-05      35     
produce:reco3d:SpacePointSolver                        0.200176       1.56642       7.67583       1.09117       1.42146        35     
produce:hitpdune:DisambigFromSpacePoints               0.166793       1.02894       3.35378      0.913848      0.643185        35     
produce:pandora:StandardPandora                         7.58888       29.6909       105.282       24.9143       17.1633        35     
produce:pandoraWriter:StandardPandora                  0.0895473      0.20843      0.309735      0.210146      0.0478678       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.04333       2.4552        6.96102       2.15708       1.0998         35     
produce:pandoraShower:LArPandoraShowerCreation         0.782965       2.69987       7.52175       2.60905       1.33223        35     
produce:pandoracalo:Calorimetry                        0.616702       1.2454        3.4777        1.12364      0.497065        35     
produce:pandoracalonosce:Calorimetry                   0.451943       1.14433       3.61189       1.08173      0.527223        35     
produce:pandorapid:Chi2ParticleID                      0.0016243    0.00271982    0.00575391    0.00267073    0.000769182      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.712605       2.68046       7.76396       2.49372       1.31982        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.611379       2.58918       7.47938       2.42866       1.27611        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0717734     0.174738      0.298974      0.165747      0.0517839       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0256157     0.0615343     0.110541      0.0599231     0.0176726       35     
produce:emtrkmichelid:EmTrackMichelId                   20.9283       42.8652       66.9843       44.7016       10.0417        35     
[art]:TriggerResults:TriggerResultInserter            2.6249e-05    4.14955e-05   0.000107466   3.9052e-05    1.37332e-05      35     
end_path:out1:RootOutput                               9.176e-06    1.1877e-05    3.9442e-05    1.0873e-05    4.85031e-06      35     
end_path:michelremoving:michelremoving                 0.0289068     0.0860079     0.490191      0.0461048     0.102767        35     
end_path:michelremovinggnocchi:michelremoving          0.0197876     0.0753368     0.404076      0.0411585     0.0847207       35     
end_path:calibanagnocchi:CalibAnaTree                  0.423584      0.921324       2.76525      0.869824      0.399187        35     
end_path:out1:RootOutput(write)                        0.547479       1.06972       2.03237       1.00083      0.282907        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4950.38 MB
  Peak resident set size usage (VmHWM): 2349.36 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup.root
\tHists: np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727435964.0,
    "core.end_time": 1727441835.0,
    "core.events": [
      81342,
      81346,
      81350,
      81354,
      81358,
      81362,
      81366,
      81370,
      81374,
      81378,
      81382,
      81386,
      81390,
      81394,
      81398,
      81402,
      81406,
      81410,
      81414,
      81418,
      81422,
      81426,
      81430,
      81434,
      81438,
      81442,
      81446,
      81450,
      81454,
      81458,
      81462,
      81466,
      81470,
      81474,
      81478
    ],
    "core.event_count": 35,
    "core.first_event_number": 81342,
    "core.last_event_number": 81478,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727435964.0,
    "core.end_time": 1727441835.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:30:42 UTC       justIN version: 01.01.08