justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264657.114@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264657.114@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3517
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 04:52:53
SiteUS_Wisconsin
EntryHCCHTPC_US_Wisconsin_osg01_rhel7
Last heartbeat2024-09-27 10:17:22
From worker nodeHostnamee2400
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit82800 (23 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 06:32:19
Input fileshd-protodune:np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849.hdf5
JobscriptExit code0
Real time3h (12812s)
CPU time2h (7757s = 60%)
Outputting started2024-09-27 10:05:54
Output fileshd-protodune-det-reco:np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849_reco_stage1_reco_stage2_20240927T100332_keepup.root
hd-protodune-det-reco:np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849_reco_stage1_reco_stage2_20240927T100332_keepup_hists.root
Finished2024-09-27 10:17:22
Saved logsjustin-logs:264657.114-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

cooked to 5859 ticks
wclsFrameSaver: saving 45419 traces tagged "gauss"
FrameSaver: q=1.70961e+06 n=868483 tag=gauss
wclsFrameSaver: saving 60491 traces tagged "wiener"
FrameSaver: q=1.8261e+06 n=788504 tag=wiener
2393 hits in TPC 0
2924 hits in TPC 1
4824 hits in TPC 2
2304 hits in TPC 3
4957 hits in TPC 4
5986 hits in TPC 5
7825 hits in TPC 6
4505 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 34 XUs and 10 XVs -> 2 XUVs
C:0 T:1 2195 XUs and 1570 XVs -> 125 XUVs
C:0 T:2 11369 XUs and 28096 XVs -> 311 XUVs
C:0 T:3 544 XUs and 445 XVs -> 14 XUVs
C:0 T:4 99 XUs and 120 XVs -> 3 XUVs
C:0 T:5 15158 XUs and 17436 XVs -> 678 XUVs
C:0 T:6 36813 XUs and 42613 XVs -> 1210 XUVs
C:0 T:7 578 XUs and 513 XVs -> 19 XUVs
2362 XUVs total
1415 collection wire objects
2362 potential space points
Neighbour search...
52734 tests to find 30500 neighbours
Iterating with no regularization...
Begin: 2.08338e+07
0 1.99655e+07
1 1.99343e+07
2 1.99309e+07
Now with regularization...
Begin: 1.88594e+07
0 1.8858e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 05:03:32 CDT  Closed output file "np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849_reco_stage1_reco_stage2_20240927T100332_keepup.root"
27-Sep-2024 05:03:32 CDT  Closed input file "np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              138.856       196.112       262.526       194.783       32.6747        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000830697    0.0143383     0.390706     0.00392724     0.0645674       35     
produce:fembfilter:PDHDFEMBFilter                       1.45081       4.91109       37.5869       1.54544       8.98528        35     
produce:wclsdatahd:WireCellToolkit                      63.8608       71.5756       89.1131       71.449        4.48993        35     
produce:gaushit:GausHitFinder                          0.633906       1.03588       1.46703       1.04476      0.231206        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000394904   0.00833733     0.273794     0.000531156    0.0455256       35     
produce:reco3d:SpacePointSolver                        0.464334       1.46743       4.3464        1.09628      0.956298        35     
produce:hitpdune:DisambigFromSpacePoints               0.400488       1.0044        2.14969      0.939077      0.409471        35     
produce:pandora:StandardPandora                         10.6363       25.3241       51.2841       22.4785       10.2962        35     
produce:pandoraWriter:StandardPandora                  0.143463      0.209881      0.286066      0.205913      0.0379486       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.29288       3.54757       5.76175       3.34262       1.16223        35     
produce:pandoraShower:LArPandoraShowerCreation          1.46315       4.73197       8.2087        4.23016       1.98175        35     
produce:pandoracalo:Calorimetry                        0.560223       1.53426       2.65807       1.43869       0.5012         35     
produce:pandoracalonosce:Calorimetry                   0.512084       1.43362       2.47117       1.41774      0.495441        35     
produce:pandorapid:Chi2ParticleID                     0.00187608    0.00292894    0.00457614     0.0027686    0.000596585      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.985251       3.59674       7.15445       3.23844       1.60917        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.885986       3.40426       6.68347       3.04585       1.56632        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0984454     0.165222      0.258272      0.158145      0.0395278       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0331656     0.0553391     0.0841919     0.0559797     0.0126736       35     
produce:emtrkmichelid:EmTrackMichelId                   47.6987       69.6475       94.5354       67.3143       13.2074        35     
[art]:TriggerResults:TriggerResultInserter            5.9509e-05    8.01263e-05   0.000125452   7.8946e-05    1.1473e-05       35     
end_path:out1:RootOutput                               9.463e-06    1.51541e-05   3.3577e-05    1.3276e-05    5.60857e-06      35     
end_path:michelremoving:michelremoving                 0.0281287     0.111127       0.33499      0.0719253     0.0776239       35     
end_path:michelremovinggnocchi:michelremoving          0.026308      0.106837      0.330113      0.0648208     0.0790909       35     
end_path:calibanagnocchi:CalibAnaTree                  0.421004       1.08251       1.94914       1.05453      0.392523        35     
end_path:out1:RootOutput(write)                        0.619454      0.953702       1.81348       0.8959       0.231097        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5012.34 MB
  Peak resident set size usage (VmHWM): 2369.67 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849_reco_stage1_reco_stage2_20240927T100332_keepup.root
\tHists: np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849_reco_stage1_reco_stage2_20240927T100332_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849_reco_stage1_reco_stage2_20240927T100332_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849_reco_stage1_reco_stage2_20240927T100332_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727424473.0,
    "core.end_time": 1727431531.0,
    "core.events": [
      48021,
      48025,
      48029,
      48033,
      48037,
      48041,
      48045,
      48049,
      48053,
      48057,
      48061,
      48065,
      48069,
      48073,
      48077,
      48081,
      48085,
      48089,
      48093,
      48097,
      48101,
      48105,
      48109,
      48113,
      48117,
      48121,
      48125,
      48129,
      48133,
      48137,
      48141,
      48145,
      48149,
      48153,
      48157
    ],
    "core.event_count": 35,
    "core.first_event_number": 48021,
    "core.last_event_number": 48157,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849_reco_stage1_reco_stage2_20240927T100332_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727424473.0,
    "core.end_time": 1727431531.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27398
    ],
    "core.runs_subruns": [
      2739800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027398_0343_dataflow1_datawriter_0_20240624T021849.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:32:02 UTC       justIN version: 01.01.08