justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 83089.62@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID83089.62@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3698
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-17 08:29:21
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2024-10-17 15:18:20
From worker nodeHostnamedunegli-3968051-0-fnpc17108.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-17 13:58:38
Input fileshd-protodune:np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846.hdf5
JobscriptExit code0
Real time1h (4747s)
CPU time1h (3867s = 81%)
Outputting started2024-10-17 15:17:46
Output fileshd-protodune-det-reco:np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846_reco_stage1_reco_stage2_20241017T151737_keepup.root
hd-protodune-det-reco:np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846_reco_stage1_reco_stage2_20241017T151737_keepup_hists.root
Finished2024-10-17 15:18:20
Saved logsjustin-logs:83089.62-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

3
2564 hits in TPC 4
3347 hits in TPC 5
10294 hits in TPC 6
4236 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3793 XUs and 3078 XVs -> 276 XUVs
C:0 T:2 25573 XUs and 41126 XVs -> 1125 XUVs
C:0 T:3 272 XUs and 236 XVs -> 17 XUVs
C:0 T:4 31 XUs and 37 XVs -> 3 XUVs
C:0 T:5 7506 XUs and 5379 XVs -> 181 XUVs
C:0 T:6 49524 XUs and 98977 XVs -> 4497 XUVs
C:0 T:7 639 XUs and 1252 XVs -> 32 XUVs
6131 XUVs total
1782 collection wire objects
6131 potential space points
Neighbour search...
416607 tests to find 192550 neighbours
Iterating with no regularization...
Begin: 3.99629e+07
0 3.54804e+07
1 3.52289e+07
2 3.51982e+07
Now with regularization...
Begin: 3.30766e+07
0 3.30494e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  11   event 31639 TrkackID 11 startx, y, z 6.28815 580.896 402.757  wireno, peakt tpcno 441 4376.16 5 dist 0.494778min T, max_T4340.08 4769.85
no of hits closeby  11   event 31639 TrkackID 11 startx, y, z 6.28815 580.896 402.757  wireno, peakt tpcno 441 4376.16 5 dist 0.494778min T, max_T4340.08 4769.85
17-Oct-2024 15:17:37 UTC  Closed output file "np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846_reco_stage1_reco_stage2_20241017T151737_keepup.root"
17-Oct-2024 15:17:37 UTC  Closed input file "np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              63.3755       87.4432       123.951       84.9527       14.4504        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000385415    0.0020218    0.00355737    0.00204217    0.000818491      35     
produce:fembfilter:PDHDFEMBFilter                      0.617183       0.65466       1.01944      0.626933      0.0895618       35     
produce:wclsdatahd:WireCellToolkit                      36.6551       39.0716       53.2744       38.5265       3.46563        35     
produce:gaushit:GausHitFinder                          0.453234      0.742884       1.36283      0.719313      0.177041        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000284405   0.000771418    0.0126033    0.00041556    0.00203085       35     
produce:reco3d:SpacePointSolver                        0.161869      0.852949       3.05345      0.814822      0.588422        35     
produce:hitpdune:DisambigFromSpacePoints               0.220015      0.601381       1.10914      0.567672      0.217161        35     
produce:pandora:StandardPandora                         6.00965       14.4964       27.2227       13.4737       5.36484        35     
produce:pandoraWriter:StandardPandora                   0.09422      0.150735      0.231806      0.145346      0.0327914       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.702066       1.65884       3.49366       1.44352      0.633093        35     
produce:pandoraShower:LArPandoraShowerCreation         0.823246       2.0115        5.08924       1.8382       0.962472        35     
produce:pandoracalo:Calorimetry                        0.326032      0.716885       1.2343       0.702649      0.220584        35     
produce:pandoracalonosce:Calorimetry                    0.30261      0.658007       1.1215       0.661875      0.199707        35     
produce:pandorapid:Chi2ParticleID                     0.00119548    0.00171631    0.00487171    0.00164715    0.00060148       35     
produce:pandoraShowercalo:ShowerCalorimetry            0.573211       1.65819       3.46655       1.59922       0.71096        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.572177       1.58094       3.27371       1.57492      0.661264        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0603161     0.110221      0.191012       0.10719      0.0282582       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.025114      0.0423399     0.0768856     0.0408923     0.0110707       35     
produce:emtrkmichelid:EmTrackMichelId                   13.9544       20.9276       29.6841       20.8683       3.7778         35     
[art]:TriggerResults:TriggerResultInserter            2.2379e-05    3.47771e-05   9.9552e-05    3.0482e-05    1.32089e-05      35     
end_path:out1:RootOutput                               8.405e-06    1.02212e-05   2.9516e-05     9.563e-06    3.38447e-06      35     
end_path:michelremoving:michelremoving                 0.0166526     0.0643163     0.229665      0.0323068     0.0554726       35     
end_path:michelremovinggnocchi:michelremoving          0.0149855     0.060746      0.224246      0.0295616     0.0555136       35     
end_path:calibanagnocchi:CalibAnaTree                  0.211095      0.538291      0.905168      0.548692       0.16675        35     
end_path:out1:RootOutput(write)                        0.463473      0.731605       1.2589       0.711585       0.17485        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5008 MB
  Peak resident set size usage (VmHWM): 2672.33 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846_reco_stage1_reco_stage2_20241017T151737_keepup.root
\tHists: np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846_reco_stage1_reco_stage2_20241017T151737_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846_reco_stage1_reco_stage2_20241017T151737_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846_reco_stage1_reco_stage2_20241017T151737_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729175158.0,
    "core.end_time": 1729178259.0,
    "core.events": [
      31503,
      31507,
      31511,
      31515,
      31519,
      31523,
      31527,
      31531,
      31535,
      31539,
      31543,
      31547,
      31551,
      31555,
      31559,
      31563,
      31567,
      31571,
      31575,
      31579,
      31583,
      31587,
      31591,
      31595,
      31599,
      31603,
      31607,
      31611,
      31615,
      31619,
      31623,
      31627,
      31631,
      31635,
      31639
    ],
    "core.event_count": 35,
    "core.first_event_number": 31503,
    "core.last_event_number": 31639,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27425
    ],
    "core.runs_subruns": [
      2742500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846_reco_stage1_reco_stage2_20241017T151737_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1729175158.0,
    "core.end_time": 1729178259.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27425
    ],
    "core.runs_subruns": [
      2742500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027425_0225_dataflow3_datawriter_0_20240625T155846.hdf5"
    }
  ]
}
justIN time: 2024-11-24 03:45:20 UTC       justIN version: 01.01.09