justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269437.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269437.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3584
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 18:16:07
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-10-05 02:13:56
From worker nodeHostnamedunegli-4177763-0-fnpc22030.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 01:01:06
Input fileshd-protodune:np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133.hdf5
JobscriptExit code0
Real time1h (4333s)
CPU time55m (3307s = 76%)
Outputting started2024-10-05 02:13:21
Output fileshd-protodune-det-reco:np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133_reco_stage1_reco_stage2_20241005T021315_keepup.root
hd-protodune-det-reco:np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133_reco_stage1_reco_stage2_20241005T021315_keepup_hists.root
Finished2024-10-05 02:13:56
Saved logsjustin-logs:269437.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

031 XUs and 83518 XVs -> 4311 XUVs
C:0 T:3 42 XUs and 142 XVs -> 0 XUVs
C:0 T:4 270 XUs and 183 XVs -> 6 XUVs
C:0 T:5 62924 XUs and 50144 XVs -> 2444 XUVs
C:0 T:6 42386 XUs and 72472 XVs -> 3095 XUVs
C:0 T:7 1859 XUs and 7214 XVs -> 458 XUVs
10329 XUVs total
2368 collection wire objects
10329 potential space points
Neighbour search...
1070343 tests to find 522394 neighbours
Iterating with no regularization...
Begin: 4.04423e+07
0 3.4948e+07
1 3.45597e+07
2 3.44844e+07
3 3.44599e+07
Now with regularization...
Begin: 3.19222e+07
0 3.19056e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 2760 TrkackID 4 startx, y, z -141.112 489.914 3.28664  wireno, peakt tpcno 462 3432.93 6 dist 0min T, max_T2458.29 4310.12
no of hits closeby  0   event 2760 TrkackID 4 startx, y, z -141.112 489.914 3.28664  wireno, peakt tpcno 462 3432.93 6 dist 0min T, max_T2458.29 4310.12
05-Oct-2024 02:13:15 UTC  Closed output file "np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133_reco_stage1_reco_stage2_20241005T021315_keepup.root"
05-Oct-2024 02:13:15 UTC  Closed input file "np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              27.4825       67.0727       122.41        62.1212       18.7543        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000452413   0.00192281    0.00424485    0.00192125    0.000956271      40     
produce:fembfilter:PDHDFEMBFilter                      0.577418      0.679852      0.899138      0.653585      0.0870351       40     
produce:wclsdatahd:WireCellToolkit                      23.0927       24.865        29.5349       24.553        1.40702        40     
produce:gaushit:GausHitFinder                          0.257427      0.531152       1.21823      0.496781      0.196818        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000186011   0.000394526   0.000851256   0.000350111   0.000154709      40     
produce:reco3d:SpacePointSolver                        0.120265       1.63993       6.62938      0.530731       1.84296        39     
produce:hitpdune:DisambigFromSpacePoints               0.111108      0.524137       1.29718       0.42171      0.322728        39     
produce:pandora:StandardPandora                         2.99363       11.8807       43.337        9.66967       7.44118        39     
produce:pandoraWriter:StandardPandora                  0.0472375     0.113877      0.188344      0.111192      0.0338251       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.320396       1.01976       2.24864      0.993131      0.428156        39     
produce:pandoraShower:LArPandoraShowerCreation         0.302292       1.25436       2.66598       1.06085       0.6378         39     
produce:pandoracalo:Calorimetry                        0.174262      0.557743       1.05572      0.502366      0.216768        39     
produce:pandoracalonosce:Calorimetry                   0.150877       0.52352      0.971725      0.472958      0.214359        39     
produce:pandorapid:Chi2ParticleID                     0.000947638   0.00153703    0.00345856    0.00149537    0.00041625       39     
produce:pandoraShowercalo:ShowerCalorimetry            0.312083       1.25475       2.60029       1.05277       0.68045        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.305487       1.20107       2.48214      0.948485      0.659708        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0486998     0.0843932     0.167437      0.0785034      0.02373        39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0152388     0.0289912     0.0633398     0.0278602    0.00907164       39     
produce:emtrkmichelid:EmTrackMichelId                   9.8852        20.6937       31.6079       19.0948       5.51771        39     
[art]:TriggerResults:TriggerResultInserter            1.4156e-05    2.55627e-05   0.000125527   2.1205e-05    1.78969e-05      40     
end_path:out1:RootOutput                               2.745e-06    9.39622e-06   4.3532e-05    8.4965e-06    5.76223e-06      40     
end_path:michelremoving:michelremoving                1.0731e-05     0.0496111     0.329586      0.0267013     0.0576963       40     
end_path:michelremovinggnocchi:michelremoving          4.188e-06     0.0474323      0.33424      0.0231364     0.058235        40     
end_path:calibanagnocchi:CalibAnaTree                  3.677e-06     0.427762      0.829965      0.406171      0.184984        40     
end_path:out1:RootOutput(write)                        0.293783      0.617181      0.900627      0.637131      0.165058        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5016.54 MB
  Peak resident set size usage (VmHWM): 2681.71 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133_reco_stage1_reco_stage2_20241005T021315_keepup.root
\tHists: np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133_reco_stage1_reco_stage2_20241005T021315_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133_reco_stage1_reco_stage2_20241005T021315_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133_reco_stage1_reco_stage2_20241005T021315_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728091678.0,
    "core.end_time": 1728094395.0,
    "core.events": [
      2721,
      2722,
      2723,
      2724,
      2725,
      2726,
      2727,
      2728,
      2729,
      2730,
      2731,
      2732,
      2733,
      2734,
      2735,
      2736,
      2737,
      2738,
      2739,
      2740,
      2741,
      2742,
      2743,
      2744,
      2745,
      2746,
      2747,
      2748,
      2749,
      2750,
      2751,
      2752,
      2753,
      2754,
      2755,
      2756,
      2757,
      2758,
      2759,
      2760
    ],
    "core.event_count": 40,
    "core.first_event_number": 2721,
    "core.last_event_number": 2760,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27704
    ],
    "core.runs_subruns": [
      2770400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133_reco_stage1_reco_stage2_20241005T021315_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728091678.0,
    "core.end_time": 1728094395.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27704
    ],
    "core.runs_subruns": [
      2770400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027704_0068_dataflow0_datawriter_0_20240705T021133.hdf5"
    }
  ]
}
justIN time: 2024-11-24 12:14:51 UTC       justIN version: 01.01.09