justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 72660.57@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID72660.57@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3245
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-16 12:15:49
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-09-16 14:19:52
From worker nodeHostnameb9p20p9170.cern.ch
cpuinfoIntel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-16 12:20:46
Input fileshd-protodune:np04hd_raw_run029186_0221_dataflow1_datawriter_0_20240914T175334.hdf5
Outputting started2024-09-16 14:16:35
Output files
Finished2024-09-16 14:19:52
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

to 5859 ticks
wclsFrameSaver: saving 32380 traces tagged "gauss"
FrameSaver: q=643228 n=569801 tag=gauss
wclsFrameSaver: saving 43444 traces tagged "wiener"
FrameSaver: q=699501 n=515472 tag=wiener
2299 hits in TPC 0
2817 hits in TPC 1
4447 hits in TPC 2
2527 hits in TPC 3
1858 hits in TPC 4
3077 hits in TPC 5
2710 hits in TPC 6
2282 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1 XUs and 0 XVs -> 0 XUVs
C:0 T:1 1251 XUs and 1143 XVs -> 12 XUVs
C:0 T:2 25158 XUs and 22201 XVs -> 502 XUVs
C:0 T:3 82 XUs and 92 XVs -> 5 XUVs
C:0 T:4 183 XUs and 103 XVs -> 5 XUVs
C:0 T:5 8151 XUs and 8719 XVs -> 209 XUVs
C:0 T:6 13655 XUs and 16088 XVs -> 602 XUVs
C:0 T:7 43 XUs and 58 XVs -> 2 XUVs
1337 XUVs total
707 collection wire objects
1337 potential space points
Neighbour search...
56425 tests to find 31824 neighbours
Iterating with no regularization...
Begin: 2.63271e+06
0 2.46513e+06
1 2.4538e+06
2 2.45255e+06
Now with regularization...
Begin: 2.33514e+06
0 2.33475e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

16-Sep-2024 16:16:16 CEST  Closed output file "np04hd_raw_run029186_0221_dataflow1_datawriter_0_20240914T175334_reco_stage1_reco_stage2_20240916T141616_keepup.root"
16-Sep-2024 16:16:16 CEST  Closed input file "np04hd_raw_run029186_0221_dataflow1_datawriter_0_20240914T175334_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              99.492        164.392       234.464       160.221       34.1334        31     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000592228   0.00181717    0.00497584    0.00132345    0.00126079       31     
produce:fembfilter:PDHDFEMBFilter                      0.732068       1.15212       1.39309       1.15182      0.153617        31     
produce:wclsdatahd:WireCellToolkit                      52.494        74.8095       92.0338       74.3201       10.2972        31     
produce:gaushit:GausHitFinder                          0.733567       1.28889       2.50013       1.18433      0.373222        31     
produce:nhitsfilter:NumberOfHitsFilter                0.000384517   0.000634374   0.00198937    0.000597839   0.000279224      31     
produce:reco3d:SpacePointSolver                         0.39111       1.66242       4.44168       1.20835       1.05732        31     
produce:hitpdune:DisambigFromSpacePoints                0.3049        1.11519       2.85032      0.978661      0.600427        31     
produce:pandora:StandardPandora                         10.7637       23.7648       52.7917       20.1186       11.0708        31     
produce:pandoraWriter:StandardPandora                  0.154641      0.282189      0.462304      0.278872      0.0798535       31     
produce:pandoraTrack:LArPandoraTrackCreation            1.55026       4.16773       7.11173       4.00522       1.5248         31     
produce:pandoraShower:LArPandoraShowerCreation          1.0462        5.28537       12.3451       4.36711       2.7313         31     
produce:pandoracalo:Calorimetry                        0.519372       1.7902        3.13602       1.75955      0.681869        31     
produce:pandoracalonosce:Calorimetry                   0.511515       1.66527       2.87305       1.66127      0.636027        31     
produce:pandorapid:Chi2ParticleID                     0.00175156     0.0031966    0.00471596    0.00332081    0.000736828      31     
produce:pandoraShowercalo:ShowerCalorimetry            0.994573       4.27988        9.583        3.64349       2.29957        31     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.958951       4.21288       9.41493       3.56181       2.23369        31     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.112666      0.265435      0.471344      0.268116      0.0868031       31     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0447614     0.102233      0.175649      0.106756      0.0318193       31     
produce:emtrkmichelid:EmTrackMichelId                   21.2807       35.0502       53.2735       33.369        8.37531        31     
[art]:TriggerResults:TriggerResultInserter            4.2416e-05    7.30873e-05   0.000119062   7.2419e-05    1.30938e-05      31     
end_path:out1:RootOutput                               9.744e-06    1.92512e-05   3.5019e-05    1.9035e-05    3.98845e-06      31     
end_path:michelremoving:michelremoving                 0.0382629     0.200859      0.746135      0.105673      0.175587        31     
end_path:michelremovinggnocchi:michelremoving          0.0380404     0.202356      0.887835      0.102409      0.188746        31     
end_path:calibanagnocchi:CalibAnaTree                  0.472641       1.38253       2.65411       1.33179      0.604983        31     
end_path:out1:RootOutput(write)                        0.809319       1.41855       2.08293       1.4188       0.319365        31     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5806.39 MB
  Peak resident set size usage (VmHWM): 2856.57 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029186_0221_dataflow1_datawriter_0_20240914T175334_reco_stage1_reco_stage2_20240916T141616_keepup.root
\tHists: np04hd_raw_run029186_0221_dataflow1_datawriter_0_20240914T175334_reco_stage1_reco_stage2_20240916T141616_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029186_0221_dataflow1_datawriter_0_20240914T175334_reco_stage1_reco_stage2_20240916T141616_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029186_0221_dataflow1_datawriter_0_20240914T175334_reco_stage1_reco_stage2_20240916T141616_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726491018.0,
    "core.end_time": 1726496177.0,
    "core.events": [
      54801,
      54809,
      54825,
      54833,
      54841,
      54849,
      54857,
      54865,
      54873,
      54881,
      54889,
      54897,
      54905,
      54913,
      54921,
      54929,
      54937,
      54945,
      54953,
      54961,
      54969,
      54977,
      54985,
      54993,
      55001,
      55009,
      55017,
      55025,
      55033,
      55041,
      55049
    ],
    "core.event_count": 31,
    "core.first_event_number": 54801,
    "core.last_event_number": 55049,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29186
    ],
    "core.runs_subruns": [
      2918600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029186_0221_dataflow1_datawriter_0_20240914T175334.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029186_0221_dataflow1_datawriter_0_20240914T175334_reco_stage1_reco_stage2_20240916T141616_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726491018.0,
    "core.end_time": 1726496177.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29186
    ],
    "core.runs_subruns": [
      2918600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029186_0221_dataflow1_datawriter_0_20240914T175334.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:58:31 UTC       justIN version: 01.01.09