justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262992.47@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID262992.47@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3448
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 06:57:03
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce514
Last heartbeat2024-09-26 09:29:52
From worker nodeHostnameb9p21p2717.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 07:09:42
Input fileshd-protodune:np04hd_raw_run029097_0224_dataflow4_datawriter_0_20240906T150341.hdf5
Outputting started2024-09-26 08:09:22
Output files
Finished2024-09-26 09:29:49
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

aving 23059 traces tagged "gauss"
FrameSaver: q=500487 n=469246 tag=gauss
wclsFrameSaver: saving 29679 traces tagged "wiener"
FrameSaver: q=538425 n=431634 tag=wiener
1971 hits in TPC 0
2440 hits in TPC 1
3453 hits in TPC 2
2008 hits in TPC 3
1947 hits in TPC 4
3146 hits in TPC 5
1001 hits in TPC 6
932 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 169 XUs and 181 XVs -> 0 XUVs
C:0 T:2 6621 XUs and 8437 XVs -> 457 XUVs
C:0 T:3 34 XUs and 30 XVs -> 3 XUVs
C:0 T:4 10 XUs and 5 XVs -> 0 XUVs
C:0 T:5 8142 XUs and 11503 XVs -> 1131 XUVs
C:0 T:6 1603 XUs and 835 XVs -> 15 XUVs
C:0 T:7 6 XUs and 2 XVs -> 0 XUVs
1606 XUVs total
586 collection wire objects
1606 potential space points
Neighbour search...
88132 tests to find 52950 neighbours
Iterating with no regularization...
Begin: 4.0183e+06
0 3.45596e+06
1 3.41233e+06
2 3.4057e+06
3 3.40287e+06
Now with regularization...
Begin: 3.16795e+06
0 3.16581e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 10:09:09 CEST  Closed output file "np04hd_raw_run029097_0224_dataflow4_datawriter_0_20240906T150341_reco_stage1_reco_stage2_20240926T080909_keepup.root"
26-Sep-2024 10:09:09 CEST  Closed input file "np04hd_raw_run029097_0224_dataflow4_datawriter_0_20240906T150341_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              60.2778       86.972        115.25        87.0318       14.2495        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000594756   0.00239298    0.00396789    0.00233984    0.000827665      30     
produce:fembfilter:PDHDFEMBFilter                      0.516523      0.700939      0.775304      0.731879      0.071236        30     
produce:wclsdatahd:WireCellToolkit                      30.5085       35.4524       39.8808       35.985        2.56138        30     
produce:gaushit:GausHitFinder                          0.363953      0.707893       1.08677       0.6758        0.17985        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000218883   0.000440429   0.00174773    0.000377504   0.000261031      30     
produce:reco3d:SpacePointSolver                         0.14229       1.18269       7.80664      0.728032       1.61206        30     
produce:hitpdune:DisambigFromSpacePoints               0.0842296      0.5042        1.05981      0.426925      0.241147        30     
produce:pandora:StandardPandora                         4.65525       12.7102       24.8974       11.1989       5.42723        30     
produce:pandoraWriter:StandardPandora                  0.0867644      0.15339      0.274841      0.142111      0.044172        30     
produce:pandoraTrack:LArPandoraTrackCreation           0.375058      0.981908       2.22074      0.871309      0.426053        30     
produce:pandoraShower:LArPandoraShowerCreation          0.34069       1.18205       2.69672       1.01326      0.570899        30     
produce:pandoracalo:Calorimetry                        0.187402      0.490772      0.945726       0.48034      0.163492        30     
produce:pandoracalonosce:Calorimetry                   0.174731      0.439532      0.880719      0.409614      0.153837        30     
produce:pandorapid:Chi2ParticleID                     0.00112022    0.00181112    0.00331431    0.00164137    0.000524005      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.279527       1.03588       2.23439      0.957355      0.438935        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.266675       1.02619       2.21177      0.874262      0.463253        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.067416      0.156609      0.252613      0.148382      0.0474924       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0225448     0.0524217     0.0863124     0.0489153     0.0156579       30     
produce:emtrkmichelid:EmTrackMichelId                   17.5589       28.5815       38.9629       28.4198       5.25359        30     
[art]:TriggerResults:TriggerResultInserter             1.909e-05    3.50742e-05   8.9471e-05     2.846e-05    1.55145e-05      30     
end_path:out1:RootOutput                              1.0401e-05    1.58913e-05   6.6671e-05    1.27205e-05   1.06972e-05      30     
end_path:michelremoving:michelremoving                 0.0150512     0.0788895     0.421904      0.030783      0.0970644       30     
end_path:michelremovinggnocchi:michelremoving          0.0122984     0.0774193      0.4062       0.0273113     0.0988859       30     
end_path:calibanagnocchi:CalibAnaTree                  0.146445      0.417358      0.736881      0.384671       0.1421         30     
end_path:out1:RootOutput(write)                         0.41548      0.934765       1.36917      0.918188      0.205572        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4959.1 MB
  Peak resident set size usage (VmHWM): 2618.24 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029097_0224_dataflow4_datawriter_0_20240906T150341_reco_stage1_reco_stage2_20240926T080909_keepup.root
\tHists: np04hd_raw_run029097_0224_dataflow4_datawriter_0_20240906T150341_reco_stage1_reco_stage2_20240926T080909_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029097_0224_dataflow4_datawriter_0_20240906T150341_reco_stage1_reco_stage2_20240926T080909_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029097_0224_dataflow4_datawriter_0_20240906T150341_reco_stage1_reco_stage2_20240926T080909_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727335499.0,
    "core.end_time": 1727338150.0,
    "core.events": [
      53756,
      53780,
      53788,
      53796,
      53804,
      53812,
      53820,
      53828,
      53836,
      53844,
      53852,
      53860,
      53868,
      53876,
      53884,
      53892,
      53900,
      53908,
      53916,
      53924,
      53932,
      53940,
      53948,
      53956,
      53964,
      53972,
      53980,
      53988,
      53996,
      54052
    ],
    "core.event_count": 30,
    "core.first_event_number": 53756,
    "core.last_event_number": 54052,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29097
    ],
    "core.runs_subruns": [
      2909700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029097_0224_dataflow4_datawriter_0_20240906T150341.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029097_0224_dataflow4_datawriter_0_20240906T150341_reco_stage1_reco_stage2_20240926T080909_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727335499.0,
    "core.end_time": 1727338150.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29097
    ],
    "core.runs_subruns": [
      2909700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029097_0224_dataflow4_datawriter_0_20240906T150341.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:22:30 UTC       justIN version: 01.01.08