justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273394.67@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID273394.67@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3671
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-11 08:16:10
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce510
Last heartbeat2024-10-11 10:41:10
From worker nodeHostnameb9p03p4784.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-11 09:15:53
Input fileshd-protodune:np04hd_raw_run027973_0307_dataflow1_datawriter_0_20240711T013149.hdf5
Outputting started2024-10-11 10:39:27
Output files
Finished2024-10-11 10:41:10
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

PC 3
6725 hits in TPC 4
9538 hits in TPC 5
8481 hits in TPC 6
4149 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 32 XUs and 14 XVs -> 1 XUVs
C:0 T:1 3629 XUs and 2502 XVs -> 107 XUVs
C:0 T:2 69037 XUs and 25519 XVs -> 894 XUVs
C:0 T:3 800 XUs and 1044 XVs -> 43 XUVs
C:0 T:4 738 XUs and 528 XVs -> 41 XUVs
C:0 T:5 68455 XUs and 50075 XVs -> 1402 XUVs
C:0 T:6 39704 XUs and 38208 XVs -> 2133 XUVs
C:0 T:7 270 XUs and 224 XVs -> 2 XUVs
4623 XUVs total
2142 collection wire objects
4623 potential space points
Neighbour search...
176935 tests to find 87084 neighbours
Iterating with no regularization...
Begin: 4.74363e+07
0 4.38043e+07
1 4.35381e+07
2 4.35131e+07
Now with regularization...
Begin: 4.17474e+07
0 4.17393e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  18   event 78937 TrkackID 8 startx, y, z 10.7322 593.802 358.722  wireno, peakt tpcno 456 2283.07 5 dist 15.039min T, max_T2231.84 3389.37
no of hits closeby  18   event 78937 TrkackID 8 startx, y, z 10.7322 593.802 358.722  wireno, peakt tpcno 456 2283.07 5 dist 15.039min T, max_T2231.84 3389.37
11-Oct-2024 12:39:11 CEST  Closed output file "np04hd_raw_run027973_0307_dataflow1_datawriter_0_20240711T013149_reco_stage1_reco_stage2_20241011T103911_keepup.root"
11-Oct-2024 12:39:11 CEST  Closed input file "np04hd_raw_run027973_0307_dataflow1_datawriter_0_20240711T013149_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              34.1539       98.4572       166.804       96.1524       28.0114        32     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000530954   0.00180785    0.00409931    0.00182205    0.000841108      32     
produce:fembfilter:PDHDFEMBFilter                       0.51548      0.675738      0.875689      0.632649      0.130814        32     
produce:wclsdatahd:WireCellToolkit                      26.6806       33.0411       42.2363       31.9376       4.58189        32     
produce:gaushit:GausHitFinder                          0.392199      0.838424       1.73854      0.751699      0.312279        32     
produce:nhitsfilter:NumberOfHitsFilter                0.000220272   0.000351468   0.000679585   0.000315947   0.000111411      32     
produce:reco3d:SpacePointSolver                        0.210948       1.23188       4.01299      0.974966      0.865402        31     
produce:hitpdune:DisambigFromSpacePoints               0.266636      0.734493       1.8685       0.657102      0.376988        31     
produce:pandora:StandardPandora                         7.61414       22.299        50.1616       18.5429       11.2326        31     
produce:pandoraWriter:StandardPandora                  0.065563      0.175613      0.374463      0.149956      0.0666752       31     
produce:pandoraTrack:LArPandoraTrackCreation           0.532129       1.6143        3.26046       1.38289       0.60745        31     
produce:pandoraShower:LArPandoraShowerCreation         0.533098       1.77328       4.86092       1.4943       0.884692        31     
produce:pandoracalo:Calorimetry                        0.368455      0.864589       1.6476       0.864453      0.288444        31     
produce:pandoracalonosce:Calorimetry                   0.314775      0.792886       1.44376      0.785823      0.260499        31     
produce:pandorapid:Chi2ParticleID                     0.00135261    0.00224369     0.0036773     0.0020901    0.00059626       31     
produce:pandoraShowercalo:ShowerCalorimetry            0.490301       1.68965       4.47606       1.45024      0.785329        31     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.37791       1.63629       4.60336       1.44964      0.814614        31     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0486741     0.149254      0.282409      0.142819      0.0594086       31     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0159451     0.0481436     0.0862869     0.0431517     0.0190789       31     
produce:emtrkmichelid:EmTrackMichelId                   17.3704       31.1308       51.442        31.363        7.75549        31     
[art]:TriggerResults:TriggerResultInserter             1.978e-05    2.97248e-05   8.3791e-05    2.67355e-05   1.18089e-05      32     
end_path:out1:RootOutput                               8.26e-06     1.10817e-05    2.586e-05     1.011e-05    3.60479e-06      32     
end_path:michelremoving:michelremoving                2.0351e-05     0.0583556     0.301162      0.0269079     0.0709083       32     
end_path:michelremovinggnocchi:michelremoving           8.5e-06      0.0551696     0.268014      0.025033      0.0673458       32     
end_path:calibanagnocchi:CalibAnaTree                  7.79e-06      0.639437       1.3951       0.643348       0.27333        32     
end_path:out1:RootOutput(write)                        0.351532      0.904292       1.73627      0.883001      0.292817        32     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5010.86 MB
  Peak resident set size usage (VmHWM): 2653.26 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027973_0307_dataflow1_datawriter_0_20240711T013149_reco_stage1_reco_stage2_20241011T103911_keepup.root
\tHists: np04hd_raw_run027973_0307_dataflow1_datawriter_0_20240711T013149_reco_stage1_reco_stage2_20241011T103911_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027973_0307_dataflow1_datawriter_0_20240711T013149_reco_stage1_reco_stage2_20241011T103911_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027973_0307_dataflow1_datawriter_0_20240711T013149_reco_stage1_reco_stage2_20241011T103911_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728639956.0,
    "core.end_time": 1728643152.0,
    "core.events": [
      78689,
      78697,
      78705,
      78713,
      78721,
      78729,
      78737,
      78745,
      78753,
      78761,
      78769,
      78777,
      78785,
      78793,
      78801,
      78809,
      78817,
      78825,
      78833,
      78841,
      78849,
      78857,
      78865,
      78873,
      78881,
      78889,
      78897,
      78905,
      78913,
      78921,
      78929,
      78937
    ],
    "core.event_count": 32,
    "core.first_event_number": 78689,
    "core.last_event_number": 78937,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27973
    ],
    "core.runs_subruns": [
      2797300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027973_0307_dataflow1_datawriter_0_20240711T013149.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027973_0307_dataflow1_datawriter_0_20240711T013149_reco_stage1_reco_stage2_20241011T103911_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728639956.0,
    "core.end_time": 1728643152.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27973
    ],
    "core.runs_subruns": [
      2797300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027973_0307_dataflow1_datawriter_0_20240711T013149.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:28:46 UTC       justIN version: 01.01.09