justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269872.38@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269872.38@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3593
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 04:56:40
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-10-05 07:49:46
From worker nodeHostnamespool1482.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 05:57:33
Input fileshd-protodune:np04hd_raw_run027897_0211_dataflow3_datawriter_0_20240709T095212.hdf5
Outputting started2024-10-05 07:47:01
Output files
Finished2024-10-05 07:49:46
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

"
FrameSaver: q=3.50791e+06 n=1320942 tag=wiener
6377 hits in TPC 0
8069 hits in TPC 1
10872 hits in TPC 2
3793 hits in TPC 3
6450 hits in TPC 4
8677 hits in TPC 5
13901 hits in TPC 6
7946 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 28976 XUs and 24046 XVs -> 740 XUVs
C:0 T:2 151920 XUs and 152807 XVs -> 6903 XUVs
C:0 T:3 14 XUs and 4 XVs -> 0 XUVs
C:0 T:4 801 XUs and 829 XVs -> 63 XUVs
C:0 T:5 57095 XUs and 64729 XVs -> 1732 XUVs
C:0 T:6 162072 XUs and 233598 XVs -> 8427 XUVs
C:0 T:7 739 XUs and 734 XVs -> 15 XUVs
17880 XUVs total
4143 collection wire objects
17880 potential space points
Neighbour search...
1510852 tests to find 803318 neighbours
Iterating with no regularization...
Begin: 7.85511e+07
0 6.8139e+07
1 6.75618e+07
2 6.7458e+07
3 6.74223e+07
Now with regularization...
Begin: 6.52901e+07
0 6.52675e+07
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

05-Oct-2024 07:46:50 UTC  Closed output file "np04hd_raw_run027897_0211_dataflow3_datawriter_0_20240709T095212_reco_stage1_reco_stage2_20241005T074650_keepup.root"
05-Oct-2024 07:46:50 UTC  Closed input file "np04hd_raw_run027897_0211_dataflow3_datawriter_0_20240709T095212_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              82.2692       121.757       205.049       110.98        32.8468        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00038989    0.00310456    0.00645308    0.00271042    0.00198058       39     
produce:fembfilter:PDHDFEMBFilter                      0.676812      0.742323       1.14202      0.718224      0.091346        39     
produce:wclsdatahd:WireCellToolkit                      46.6899       49.7076       55.0117       49.5091       1.93321        39     
produce:gaushit:GausHitFinder                          0.548907      0.955112       1.41727      0.981623      0.231033        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000376883   0.000676425   0.00143479    0.000673217   0.000186638      39     
produce:reco3d:SpacePointSolver                        0.749795       5.48382       21.737        4.41573       4.31379        39     
produce:hitpdune:DisambigFromSpacePoints               0.314499      0.801608       2.85833      0.727229      0.479058        39     
produce:pandora:StandardPandora                         9.05966       23.0701       74.5264       18.7315       15.4537        39     
produce:pandoraWriter:StandardPandora                  0.124659      0.211933      0.321391      0.209663      0.0472584       39     
produce:pandoraTrack:LArPandoraTrackCreation            1.22592       4.19989       9.43288       3.65148       1.95557        39     
produce:pandoraShower:LArPandoraShowerCreation          1.08247       5.12065       15.1783       4.16496       3.23646        39     
produce:pandoracalo:Calorimetry                        0.474262       1.54633       2.87168       1.3874        0.64371        39     
produce:pandoracalonosce:Calorimetry                   0.437112       1.46917       3.13174       1.31792      0.650941        39     
produce:pandorapid:Chi2ParticleID                     0.00135181    0.00255857    0.00340013    0.00258895    0.000496199      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.753189       3.72195       9.13857       3.25032       2.0597         39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.808751       3.61249       9.21441       3.0166        2.08399        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.079923      0.141978      0.242328       0.13862      0.0326038       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0358473     0.0665984     0.114398      0.0659954     0.0177148       39     
produce:emtrkmichelid:EmTrackMichelId                   11.4864       18.3999       29.8061       18.1977       4.80431        39     
[art]:TriggerResults:TriggerResultInserter            3.6016e-05    6.67009e-05   0.000142021   5.8733e-05    2.19847e-05      39     
end_path:out1:RootOutput                              1.0588e-05    1.91434e-05   3.6974e-05     1.737e-05     6.429e-06       39     
end_path:michelremoving:michelremoving                 0.0260875     0.0906422     0.337253      0.058558      0.0719804       39     
end_path:michelremovinggnocchi:michelremoving          0.0271895     0.0927015     0.354483      0.0642212     0.0776306       39     
end_path:calibanagnocchi:CalibAnaTree                  0.311925       1.07248       2.25012      0.991761      0.458019        39     
end_path:out1:RootOutput(write)                        0.513618      0.878741       1.36038      0.836766       0.22865        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5916.54 MB
  Peak resident set size usage (VmHWM): 2522.04 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027897_0211_dataflow3_datawriter_0_20240709T095212_reco_stage1_reco_stage2_20241005T074650_keepup.root
\tHists: np04hd_raw_run027897_0211_dataflow3_datawriter_0_20240709T095212_reco_stage1_reco_stage2_20241005T074650_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027897_0211_dataflow3_datawriter_0_20240709T095212_reco_stage1_reco_stage2_20241005T074650_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027897_0211_dataflow3_datawriter_0_20240709T095212_reco_stage1_reco_stage2_20241005T074650_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728109626.0,
    "core.end_time": 1728114411.0,
    "core.events": [
      65867,
      65875,
      65883,
      65891,
      65899,
      65907,
      65915,
      65923,
      65931,
      65939,
      65947,
      65955,
      65963,
      65971,
      65979,
      65987,
      65995,
      66003,
      66011,
      66019,
      66027,
      66035,
      66043,
      66051,
      66059,
      66067,
      66075,
      66083,
      66091,
      66099,
      66107,
      66115,
      66123,
      66131,
      66139,
      66147,
      66155,
      66163,
      66171
    ],
    "core.event_count": 39,
    "core.first_event_number": 65867,
    "core.last_event_number": 66171,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27897
    ],
    "core.runs_subruns": [
      2789700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027897_0211_dataflow3_datawriter_0_20240709T095212.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027897_0211_dataflow3_datawriter_0_20240709T095212_reco_stage1_reco_stage2_20241005T074650_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728109626.0,
    "core.end_time": 1728114411.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27897
    ],
    "core.runs_subruns": [
      2789700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027897_0211_dataflow3_datawriter_0_20240709T095212.hdf5"
    }
  ]
}
justIN time: 2024-11-21 19:49:37 UTC       justIN version: 01.01.09