justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79737.16@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79737.16@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3517
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 02:58:26
SiteUS_Wisconsin
EntryHCCHTPC_US_Wisconsin_osg01_rhel7
Last heartbeat2024-09-27 10:54:36
From worker nodeHostnamee2400
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit82800 (23 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 07:15:26
Input fileshd-protodune:np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729.hdf5
JobscriptExit code0
Real time3h (12950s)
CPU time2h (7860s = 60%)
Outputting started2024-09-27 10:51:18
Output fileshd-protodune-det-reco:np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup.root
hd-protodune-det-reco:np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup_hists.root
Finished2024-09-27 10:54:36
Saved logsjustin-logs:79737.16-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

mary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 53912 traces tagged "gauss"
FrameSaver: q=2.01169e+06 n=944988 tag=gauss
wclsFrameSaver: saving 71786 traces tagged "wiener"
FrameSaver: q=2.29899e+06 n=858356 tag=wiener
3882 hits in TPC 0
6504 hits in TPC 1
8754 hits in TPC 2
3320 hits in TPC 3
2387 hits in TPC 4
3453 hits in TPC 5
10161 hits in TPC 6
5162 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 19225 XUs and 15604 XVs -> 913 XUVs
C:0 T:2 139178 XUs and 139566 XVs -> 14751 XUVs
C:0 T:3 1117 XUs and 809 XVs -> 41 XUVs
C:0 T:4 767 XUs and 866 XVs -> 34 XUVs
C:0 T:5 19293 XUs and 10034 XVs -> 467 XUVs
C:0 T:6 121481 XUs and 103667 XVs -> 9237 XUVs
C:0 T:7 1265 XUs and 1077 XVs -> 34 XUVs
25477 XUVs total
3087 collection wire objects
25477 potential space points
Neighbour search...
5427565 tests to find 1704498 neighbours
Iterating with no regularization...
Begin: 5.24308e+07
0 3.50378e+07
1 3.34339e+07
2 3.30824e+07
3 3.2942e+07
4 3.28716e+07
5 3.28317e+07
6 3.28049e+07
Now with regularization...
Begin: 3.13824e+07
0 3.13455e+07
1 3.132e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 05:50:51 CDT  Closed output file "np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup.root"
27-Sep-2024 05:50:51 CDT  Closed input file "np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              139.387       206.912       325.128       196.204       46.854         35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000803785   0.00687016     0.0811111    0.00306562     0.0153365       35     
produce:fembfilter:PDHDFEMBFilter                       1.45233       6.86056       45.5372       1.6353        10.6172        35     
produce:wclsdatahd:WireCellToolkit                      65.0221       75.1337       126.179       71.674        12.7466        35     
produce:gaushit:GausHitFinder                          0.609132       1.03101       1.5234        1.00364      0.236511        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000371141    0.0106125      0.35255     0.000552093    0.0586419       35     
produce:reco3d:SpacePointSolver                        0.299388       1.88482       10.1884       1.34366       1.8922         35     
produce:hitpdune:DisambigFromSpacePoints               0.274037      0.935743       2.08945      0.826673      0.435961        35     
produce:pandora:StandardPandora                         11.778        26.8186       134.348       22.2949       20.1501        35     
produce:pandoraWriter:StandardPandora                  0.152209       0.3745        4.20233      0.234395      0.677853        35     
produce:pandoraTrack:LArPandoraTrackCreation            1.17357       3.96873       7.4551        3.97398       1.49437        35     
produce:pandoraShower:LArPandoraShowerCreation          1.01069       5.02127       12.3716       4.79418       2.70144        35     
produce:pandoracalo:Calorimetry                        0.529634       1.71003       3.34295       1.6821       0.642272        35     
produce:pandoracalonosce:Calorimetry                   0.521326       1.66204       3.31294       1.61185      0.637284        35     
produce:pandorapid:Chi2ParticleID                     0.00194155    0.00296147    0.00533695    0.00288994    0.000629656      35     
produce:pandoraShowercalo:ShowerCalorimetry             1.00379       4.0043        9.00888       3.74121       2.0363         35     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.01159       3.74647       8.14409       3.60041       1.84836        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.100471      0.166294      0.248366      0.171976      0.0365105       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0322449     0.0582028     0.0854855     0.0605136     0.012864        35     
produce:emtrkmichelid:EmTrackMichelId                   44.2055       69.1071       93.9218       69.6445       13.2282        35     
[art]:TriggerResults:TriggerResultInserter            4.4574e-05    8.63996e-05   0.00018236    8.2541e-05    2.14778e-05      35     
end_path:out1:RootOutput                              1.2012e-05    2.33027e-05   5.9018e-05    2.2472e-05    1.04388e-05      35     
end_path:michelremoving:michelremoving                 0.0318095     0.254837       4.65165      0.0881124     0.758868        35     
end_path:michelremovinggnocchi:michelremoving          0.0289543     0.116834      0.314255      0.0791344     0.0851906       35     
end_path:calibanagnocchi:CalibAnaTree                  0.344602       1.21588       2.52208       1.16536      0.478254        35     
end_path:out1:RootOutput(write)                        0.543896      0.975249       2.41322      0.923346      0.308994        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5005.36 MB
  Peak resident set size usage (VmHWM): 2360.16 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup.root
\tHists: np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727426949.0,
    "core.end_time": 1727434254.0,
    "core.events": [
      22542,
      22546,
      22550,
      22554,
      22558,
      22562,
      22566,
      22570,
      22574,
      22578,
      22582,
      22586,
      22590,
      22594,
      22598,
      22602,
      22606,
      22610,
      22614,
      22618,
      22622,
      22626,
      22630,
      22634,
      22638,
      22642,
      22646,
      22650,
      22654,
      22658,
      22662,
      22666,
      22670,
      22674,
      22678
    ],
    "core.event_count": 35,
    "core.first_event_number": 22542,
    "core.last_event_number": 22678,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729_reco_stage1_reco_stage2_20240927T105051_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727426949.0,
    "core.end_time": 1727434254.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0161_dataflow2_datawriter_0_20240624T004729.hdf5"
    }
  ]
}
justIN time: 2024-11-17 04:00:05 UTC       justIN version: 01.01.09