justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264762.66@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264762.66@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3518
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 07:41:05
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2024-09-27 12:43:28
From worker nodeHostnamedunegli-35088-0-cmswn2324.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 08:56:23
Input fileshd-protodune:np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455.hdf5
JobscriptExit code0
Real time3h (13571s)
CPU time1h (6558s = 48%)
Outputting started2024-09-27 12:42:35
Output fileshd-protodune-det-reco:np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455_reco_stage1_reco_stage2_20240927T124225_keepup.root
hd-protodune-det-reco:np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455_reco_stage1_reco_stage2_20240927T124225_keepup_hists.root
Finished2024-09-27 12:43:28
Saved logsjustin-logs:264762.66-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

9 ticks
wclsFrameSaver: saving 68680 traces tagged "gauss"
FrameSaver: q=2.27447e+06 n=1202364 tag=gauss
wclsFrameSaver: saving 90387 traces tagged "wiener"
FrameSaver: q=2.5246e+06 n=1091352 tag=wiener
11916 hits in TPC 0
6780 hits in TPC 1
7424 hits in TPC 2
4232 hits in TPC 3
4846 hits in TPC 4
6847 hits in TPC 5
7069 hits in TPC 6
3101 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 27668 XUs and 21868 XVs -> 1815 XUVs
C:0 T:2 46586 XUs and 39546 XVs -> 872 XUVs
C:0 T:3 890 XUs and 802 XVs -> 36 XUVs
C:0 T:4 238 XUs and 245 XVs -> 8 XUVs
C:0 T:5 28717 XUs and 21600 XVs -> 435 XUVs
C:0 T:6 37508 XUs and 30092 XVs -> 1023 XUVs
C:0 T:7 209 XUs and 277 XVs -> 5 XUVs
4194 XUVs total
1664 collection wire objects
4194 potential space points
Neighbour search...
156326 tests to find 83710 neighbours
Iterating with no regularization...
Begin: 3.15379e+07
0 3.04147e+07
1 3.03602e+07
2 3.03556e+07
Now with regularization...
Begin: 2.93996e+07
0 2.93977e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 12:42:25 UTC  Closed output file "np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455_reco_stage1_reco_stage2_20240927T124225_keepup.root"
27-Sep-2024 12:42:26 UTC  Closed input file "np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              92.9066       157.937       253.774       143.821        43.87         35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000608818   0.00469502     0.0668908    0.00238244     0.0107818       35     
produce:fembfilter:PDHDFEMBFilter                       0.88689       1.13597       1.76016       1.12868      0.179548        35     
produce:wclsdatahd:WireCellToolkit                      47.5089       58.6013       70.9428       58.5205       5.61176        35     
produce:gaushit:GausHitFinder                          0.635177       1.02786       1.53894       1.03158      0.215912        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000216976   0.000418834   0.000589315   0.000436672   0.000100268      35     
produce:reco3d:SpacePointSolver                         0.4139        1.54077       5.33747       1.33753       1.12568        35     
produce:hitpdune:DisambigFromSpacePoints               0.330844      0.925118       2.15272      0.755296      0.439136        35     
produce:pandora:StandardPandora                         8.07388       41.4125       106.727       38.2348       26.2874        35     
produce:pandoraWriter:StandardPandora                  0.127523      0.198955      0.291735      0.193352      0.0456252       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.10899       3.20298       7.62831       2.66877       1.78145        35     
produce:pandoraShower:LArPandoraShowerCreation          1.17157       3.2509        6.37824       2.93746       1.61482        35     
produce:pandoracalo:Calorimetry                        0.587758       1.43564       2.85876       1.26652      0.643445        35     
produce:pandoracalonosce:Calorimetry                    0.52588       1.36286       2.73317       1.17854      0.634789        35     
produce:pandorapid:Chi2ParticleID                     0.00152612    0.00246272    0.00367439    0.00240992    0.00058999       35     
produce:pandoraShowercalo:ShowerCalorimetry             1.02805       2.95565       6.72067       2.62873       1.43177        35     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.01739       2.7805        6.50606       2.49643       1.36758        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0975459     0.158263      0.231292      0.158436      0.0334805       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.036831      0.0540179     0.0797724     0.0529246     0.0110257       35     
produce:emtrkmichelid:EmTrackMichelId                   20.7492       35.4576       51.438        35.1511       7.81269        35     
[art]:TriggerResults:TriggerResultInserter            2.6796e-05    4.39136e-05    7.352e-05    4.4532e-05    1.13824e-05      35     
end_path:out1:RootOutput                               7.223e-06    9.49146e-06    2.401e-05     8.184e-06    3.3957e-06       35     
end_path:michelremoving:michelremoving                 0.028761      0.117076      0.467699      0.0432205     0.121655        35     
end_path:michelremovinggnocchi:michelremoving          0.0252049     0.113021      0.467264      0.0421977     0.121466        35     
end_path:calibanagnocchi:CalibAnaTree                  0.389862       1.07222       2.32493      0.895365      0.543976        35     
end_path:out1:RootOutput(write)                        0.618902      0.982335       1.41969      0.935744      0.205677        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5056.44 MB
  Peak resident set size usage (VmHWM): 2698.16 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455_reco_stage1_reco_stage2_20240927T124225_keepup.root
\tHists: np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455_reco_stage1_reco_stage2_20240927T124225_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455_reco_stage1_reco_stage2_20240927T124225_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455_reco_stage1_reco_stage2_20240927T124225_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727435368.0,
    "core.end_time": 1727440947.0,
    "core.events": [
      7844,
      7848,
      7852,
      7856,
      7860,
      7864,
      7868,
      7872,
      7876,
      7880,
      7884,
      7888,
      7892,
      7896,
      7900,
      7904,
      7908,
      7912,
      7916,
      7920,
      7924,
      7928,
      7932,
      7936,
      7940,
      7944,
      7948,
      7952,
      7956,
      7960,
      7964,
      7968,
      7972,
      7976,
      7980
    ],
    "core.event_count": 35,
    "core.first_event_number": 7844,
    "core.last_event_number": 7980,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27408
    ],
    "core.runs_subruns": [
      2740800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455_reco_stage1_reco_stage2_20240927T124225_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727435368.0,
    "core.end_time": 1727440947.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27408
    ],
    "core.runs_subruns": [
      2740800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027408_0056_dataflow0_datawriter_0_20240624T161455.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:31:49 UTC       justIN version: 01.01.08