justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 77715.22@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID77715.22@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3460
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-25 21:58:34
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-09-26 01:40:32
From worker nodeHostnameb9p07p9712.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 00:34:08
Input fileshd-protodune:np04hd_raw_run029197_1619_dataflow1_datawriter_0_20240917T074717.hdf5
Outputting started2024-09-26 01:19:25
Output files
Finished2024-09-26 01:40:32
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

TPC 1
2308 hits in TPC 2
1654 hits in TPC 3
2987 hits in TPC 4
5326 hits in TPC 5
3416 hits in TPC 6
1924 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 6795 XUs and 2282 XVs -> 16 XUVs
C:0 T:2 4693 XUs and 12147 XVs -> 250 XUVs
C:0 T:3 445 XUs and 614 XVs -> 29 XUVs
C:0 T:4 39 XUs and 82 XVs -> 3 XUVs
C:0 T:5 14921 XUs and 13793 XVs -> 838 XUVs
C:0 T:6 6264 XUs and 7043 XVs -> 364 XUVs
C:0 T:7 80 XUs and 113 XVs -> 7 XUVs
1507 XUVs total
935 collection wire objects
1507 potential space points
Neighbour search...
39783 tests to find 19284 neighbours
Iterating with no regularization...
Begin: 6.0557e+06
0 5.14797e+06
1 5.10356e+06
2 5.09922e+06
Now with regularization...
Begin: 4.62083e+06
0 4.61893e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 401769 TrkackID 5 startx, y, z -119.771 433.455 195.774  wireno, peakt tpcno 16 353.876 2 dist 0min T, max_T9.45606 1548.08
no of hits closeby  0   event 401769 TrkackID 5 startx, y, z -119.771 433.455 195.774  wireno, peakt tpcno 16 353.876 2 dist 0min T, max_T9.45606 1548.08
26-Sep-2024 03:19:14 CEST  Closed output file "np04hd_raw_run029197_1619_dataflow1_datawriter_0_20240917T074717_reco_stage1_reco_stage2_20240926T011914_keepup.root"
26-Sep-2024 03:19:14 CEST  Closed input file "np04hd_raw_run029197_1619_dataflow1_datawriter_0_20240917T074717_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              44.8639       60.0129       78.5026       59.9569       7.52589        31     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000335305   0.00133439    0.00238561    0.00137917    0.000500588      31     
produce:fembfilter:PDHDFEMBFilter                      0.455393      0.531033      0.719171      0.487366      0.0815969       31     
produce:wclsdatahd:WireCellToolkit                      25.9598       28.6148       31.7354       28.4161       1.40054        31     
produce:gaushit:GausHitFinder                           0.25775      0.448836      0.951056      0.405357      0.146254        31     
produce:nhitsfilter:NumberOfHitsFilter                0.000167313   0.000255861   0.000429815   0.000244133   5.8548e-05       31     
produce:reco3d:SpacePointSolver                        0.0732546     0.322292      0.929058      0.299485      0.195086        31     
produce:hitpdune:DisambigFromSpacePoints               0.0953123     0.288469       0.8599       0.232302      0.171299        31     
produce:pandora:StandardPandora                         2.47887       6.72443       13.3197       6.81414       2.42001        31     
produce:pandoraWriter:StandardPandora                  0.0454572     0.0887611     0.136575      0.0874794     0.0207622       31     
produce:pandoraTrack:LArPandoraTrackCreation           0.316507      0.572339      0.909186      0.577881      0.158982        31     
produce:pandoraShower:LArPandoraShowerCreation         0.257135      0.686124       1.58491      0.652055      0.268013        31     
produce:pandoracalo:Calorimetry                        0.181885      0.342598       0.55625      0.357301      0.0982089       31     
produce:pandoracalonosce:Calorimetry                   0.159139      0.295918      0.476878       0.29762      0.0782383       31     
produce:pandorapid:Chi2ParticleID                     0.000841222   0.00125999    0.00261692     0.0012055    0.000363531      31     
produce:pandoraShowercalo:ShowerCalorimetry            0.173963      0.681447       1.53823      0.685834      0.287055        31     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.1717       0.664519       1.40984      0.651009      0.277432        31     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.043284      0.0877152     0.172934      0.0848149     0.025078        31     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0135191     0.0291447     0.049008      0.0298979    0.00746352       31     
produce:emtrkmichelid:EmTrackMichelId                   11.1648       18.6179       25.2926       18.3522       3.3306         31     
[art]:TriggerResults:TriggerResultInserter            1.5771e-05    2.45278e-05   7.4221e-05    2.2321e-05    1.03548e-05      31     
end_path:out1:RootOutput                               3.44e-06     1.03421e-05   2.3881e-05     9.14e-06     4.13047e-06      31     
end_path:michelremoving:michelremoving                0.00808435     0.0664166      0.31283      0.0272724     0.0692591       31     
end_path:michelremovinggnocchi:michelremoving         0.00700718     0.0649464      0.31075      0.0241158     0.0695586       31     
end_path:calibanagnocchi:CalibAnaTree                  0.126937      0.267263      0.449922        0.25        0.079005        31     
end_path:out1:RootOutput(write)                        0.285686      0.537652      0.828601      0.526396      0.125654        31     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4947.19 MB
  Peak resident set size usage (VmHWM): 2590.22 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029197_1619_dataflow1_datawriter_0_20240917T074717_reco_stage1_reco_stage2_20240926T011914_keepup.root
\tHists: np04hd_raw_run029197_1619_dataflow1_datawriter_0_20240917T074717_reco_stage1_reco_stage2_20240926T011914_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029197_1619_dataflow1_datawriter_0_20240917T074717_reco_stage1_reco_stage2_20240926T011914_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029197_1619_dataflow1_datawriter_0_20240917T074717_reco_stage1_reco_stage2_20240926T011914_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727311659.0,
    "core.end_time": 1727313555.0,
    "core.events": [
      401529,
      401537,
      401545,
      401553,
      401561,
      401569,
      401577,
      401585,
      401593,
      401601,
      401609,
      401617,
      401625,
      401633,
      401641,
      401649,
      401657,
      401665,
      401673,
      401681,
      401689,
      401697,
      401705,
      401713,
      401721,
      401729,
      401737,
      401745,
      401753,
      401761,
      401769
    ],
    "core.event_count": 31,
    "core.first_event_number": 401529,
    "core.last_event_number": 401769,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29197
    ],
    "core.runs_subruns": [
      2919700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029197_1619_dataflow1_datawriter_0_20240917T074717.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029197_1619_dataflow1_datawriter_0_20240917T074717_reco_stage1_reco_stage2_20240926T011914_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727311659.0,
    "core.end_time": 1727313555.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29197
    ],
    "core.runs_subruns": [
      2919700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029197_1619_dataflow1_datawriter_0_20240917T074717.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:15:47 UTC       justIN version: 01.01.08