justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269642.187@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269642.187@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3593
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 22:36:30
SiteCA_SFU
EntryDUNE_CA_SFU_lcg-ce3
Last heartbeat2024-10-05 05:16:15
From worker nodeHostnamecdr2057.int.cedar.computecanada.ca
cpuinfoIntel(R) Xeon(R) Platinum 8260 CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit84598 (23 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 02:47:31
Input fileshd-protodune:np04hd_raw_run027897_0233_dataflow5_datawriter_0_20240709T100607.hdf5
Outputting started2024-10-05 05:15:11
Output files
Finished2024-10-05 05:16:15
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

XUVs
C:0 T:3 490 XUs and 551 XVs -> 14 XUVs
C:0 T:4 819 XUs and 989 XVs -> 44 XUVs
C:0 T:5 64461 XUs and 68273 XVs -> 1922 XUVs
C:0 T:6 105698 XUs and 165512 XVs -> 3386 XUVs
C:0 T:7 1796 XUs and 1017 XVs -> 29 XUVs
8783 XUVs total
3245 collection wire objects
8783 potential space points
Neighbour search...
421257 tests to find 222094 neighbours
Iterating with no regularization...
Begin: 4.7721e+07
0 4.15518e+07
1 4.11467e+07
2 4.10949e+07
3 4.10781e+07
Now with regularization...
Begin: 3.92743e+07
0 3.92633e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 73069 TrkackID 5 startx, y, z 239.557 358.246 382.274  wireno, peakt tpcno 261 2577.76 5 dist 0min T, max_T6.20384 3078.47
no of hits closeby  0   event 73069 TrkackID 5 startx, y, z 239.557 358.246 382.274  wireno, peakt tpcno 261 2577.76 5 dist 0min T, max_T6.20384 3078.47
04-Oct-2024 22:15:03 PDT  Closed output file "np04hd_raw_run027897_0233_dataflow5_datawriter_0_20240709T100607_reco_stage1_reco_stage2_20241005T051503_keepup.root"
04-Oct-2024 22:15:03 PDT  Closed input file "np04hd_raw_run027897_0233_dataflow5_datawriter_0_20240709T100607_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              52.421        107.99        172.598       102.73        24.9213        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000315525   0.00139683    0.00378084    0.00104653    0.00103247       39     
produce:fembfilter:PDHDFEMBFilter                      0.846933      0.859522      0.898674      0.858299     0.00834287       39     
produce:wclsdatahd:WireCellToolkit                      47.4549       49.3356       50.7318       49.4013      0.810221        39     
produce:gaushit:GausHitFinder                          0.650827       1.04684       1.65061       1.01846      0.240753        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000287372   0.000466182   0.000665846   0.000450607   8.72969e-05      39     
produce:reco3d:SpacePointSolver                        0.366497       3.82837       11.4534       3.30079       2.66625        38     
produce:hitpdune:DisambigFromSpacePoints                0.38525       1.14333       2.5074       0.993412       0.51264        38     
produce:pandora:StandardPandora                         9.93437       24.7096       75.9152       21.2886       13.9151        38     
produce:pandoraWriter:StandardPandora                  0.119484      0.190953      0.285544      0.186915      0.0426814       38     
produce:pandoraTrack:LArPandoraTrackCreation            1.11686       2.27053       4.68879       2.20605      0.769302        38     
produce:pandoraShower:LArPandoraShowerCreation          1.13457       2.78934       7.29927       2.5536        1.28394        38     
produce:pandoracalo:Calorimetry                        0.510565       1.07165       2.18798       1.01668      0.365528        38     
produce:pandoracalonosce:Calorimetry                   0.478741       1.01055       2.11579      0.948765      0.351476        38     
produce:pandorapid:Chi2ParticleID                     0.00142747    0.00224836    0.00340605    0.00219616    0.000386957      38     
produce:pandoraShowercalo:ShowerCalorimetry             1.01902       2.46536       7.0568        2.1068        1.24026        38     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.01889       2.4224        6.80954       2.08017       1.20881        38     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0876679      0.15885      0.234707      0.156523      0.0354028       38     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0335214     0.0597123     0.082813      0.0593274     0.0125981       38     
produce:emtrkmichelid:EmTrackMichelId                   8.95553       13.8112       20.4773       13.6762       2.84231        38     
[art]:TriggerResults:TriggerResultInserter            2.4641e-05    3.01406e-05   7.2093e-05     2.788e-05    7.60479e-06      39     
end_path:out1:RootOutput                               7.534e-06    9.3971e-06    2.2822e-05     9.021e-06    2.37394e-06      39     
end_path:michelremoving:michelremoving                2.7174e-05     0.0988417     0.484662      0.0404739      0.10737        39     
end_path:michelremovinggnocchi:michelremoving          1.167e-05     0.0958357      0.48538      0.0366402     0.107828        39     
end_path:calibanagnocchi:CalibAnaTree                 1.0968e-05      0.81806       1.80603      0.750504      0.324135        39     
end_path:out1:RootOutput(write)                         0.44403       1.08264       1.69704       1.08802      0.259117        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5923.07 MB
  Peak resident set size usage (VmHWM): 2987.34 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027897_0233_dataflow5_datawriter_0_20240709T100607_reco_stage1_reco_stage2_20241005T051503_keepup.root
\tHists: np04hd_raw_run027897_0233_dataflow5_datawriter_0_20240709T100607_reco_stage1_reco_stage2_20241005T051503_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027897_0233_dataflow5_datawriter_0_20240709T100607_reco_stage1_reco_stage2_20241005T051503_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027897_0233_dataflow5_datawriter_0_20240709T100607_reco_stage1_reco_stage2_20241005T051503_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728101056.0,
    "core.end_time": 1728105303.0,
    "core.events": [
      72765,
      72773,
      72781,
      72789,
      72797,
      72805,
      72813,
      72821,
      72829,
      72837,
      72845,
      72853,
      72861,
      72869,
      72877,
      72885,
      72893,
      72901,
      72909,
      72917,
      72925,
      72933,
      72941,
      72949,
      72957,
      72965,
      72973,
      72981,
      72989,
      72997,
      73005,
      73013,
      73021,
      73029,
      73037,
      73045,
      73053,
      73061,
      73069
    ],
    "core.event_count": 39,
    "core.first_event_number": 72765,
    "core.last_event_number": 73069,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27897
    ],
    "core.runs_subruns": [
      2789700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027897_0233_dataflow5_datawriter_0_20240709T100607.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027897_0233_dataflow5_datawriter_0_20240709T100607_reco_stage1_reco_stage2_20241005T051503_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728101056.0,
    "core.end_time": 1728105303.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27897
    ],
    "core.runs_subruns": [
      2789700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027897_0233_dataflow5_datawriter_0_20240709T100607.hdf5"
    }
  ]
}
justIN time: 2024-11-21 18:05:22 UTC       justIN version: 01.01.09