justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79900.120@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79900.120@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3519
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 07:29:59
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2024-09-27 17:31:33
From worker nodeHostnamedunegli-3950868-0-fnpc7018.fnal.gov
cpuinfoAMD Opteron(tm) Processor 6376
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 12:02:47
Input fileshd-protodune:np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751.hdf5
JobscriptExit code0
Real time5h (18926s)
CPU time4h (16815s = 88%)
Outputting started2024-09-27 17:18:14
Output fileshd-protodune-det-reco:np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751_reco_stage1_reco_stage2_20240927T171754_keepup.root
hd-protodune-det-reco:np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751_reco_stage1_reco_stage2_20240927T171754_keepup_hists.root
Finished2024-09-27 17:31:33
Saved logsjustin-logs:79900.120-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 42608 traces tagged "gauss"
FrameSaver: q=1.39391e+06 n=773370 tag=gauss
wclsFrameSaver: saving 56009 traces tagged "wiener"
FrameSaver: q=1.49941e+06 n=698330 tag=wiener
4009 hits in TPC 0
3045 hits in TPC 1
4981 hits in TPC 2
2670 hits in TPC 3
3423 hits in TPC 4
3990 hits in TPC 5
6888 hits in TPC 6
3047 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 48 XUs and 14 XVs -> 0 XUVs
C:0 T:1 1286 XUs and 629 XVs -> 13 XUVs
C:0 T:2 13941 XUs and 11671 XVs -> 242 XUVs
C:0 T:3 154 XUs and 160 XVs -> 11 XUVs
C:0 T:4 192 XUs and 214 XVs -> 3 XUVs
C:0 T:5 17845 XUs and 12460 XVs -> 281 XUVs
C:0 T:6 16553 XUs and 14422 XVs -> 397 XUVs
C:0 T:7 4045 XUs and 3035 XVs -> 390 XUVs
1337 XUVs total
773 collection wire objects
1337 potential space points
Neighbour search...
40085 tests to find 21484 neighbours
Iterating with no regularization...
Begin: 8.0621e+06
0 7.47051e+06
1 7.43225e+06
2 7.42627e+06
Now with regularization...
Begin: 6.97782e+06
0 6.97562e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 17:17:54 UTC  Closed output file "np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751_reco_stage1_reco_stage2_20240927T171754_keepup.root"
27-Sep-2024 17:17:54 UTC  Closed input file "np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              272.047       434.802       747.837       401.945       132.319        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00115699    0.00428538     0.0116806    0.00301165    0.00284037       35     
produce:fembfilter:PDHDFEMBFilter                       1.5742        2.12523       3.05823       2.07838      0.388175        35     
produce:wclsdatahd:WireCellToolkit                      79.7808       107.267       131.105       108.589       11.8037        35     
produce:gaushit:GausHitFinder                           1.57398       2.38066       3.78128       2.21303       0.60744        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000882069   0.00138943    0.00295241    0.00127527    0.000440403      35     
produce:reco3d:SpacePointSolver                        0.748246       2.78115       6.94555       2.75291       1.48355        35     
produce:hitpdune:DisambigFromSpacePoints               0.752527        1.953        4.43545       1.86925      0.875878        35     
produce:pandora:StandardPandora                         18.4006       105.175       280.523       91.216        69.6595        35     
produce:pandoraWriter:StandardPandora                   0.31346      0.582034       1.91611      0.517047      0.280402        35     
produce:pandoraTrack:LArPandoraTrackCreation            2.15797       6.58179       15.7274       5.52015       3.46111        35     
produce:pandoraShower:LArPandoraShowerCreation          2.31302       6.96729       17.9399       6.07616       3.79507        35     
produce:pandoracalo:Calorimetry                         1.05686       3.09924       7.29817       2.55966       1.71506        35     
produce:pandoracalonosce:Calorimetry                   0.967812       2.80631       6.48159       2.40525       1.47365        35     
produce:pandorapid:Chi2ParticleID                     0.00350195    0.00602632     0.0117207    0.00529331    0.00190056       35     
produce:pandoraShowercalo:ShowerCalorimetry             2.04607       5.87138       16.5579       5.15315       3.47565        35     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.94948       5.37761       12.9397       4.89003       2.8748         35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry           0.19352      0.409942      0.615437      0.408668      0.105824        35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0639526     0.123944      0.184915      0.124767      0.0296656       35     
produce:emtrkmichelid:EmTrackMichelId                   120.798       176.626       294.294       162.231       44.6935        35     
[art]:TriggerResults:TriggerResultInserter            3.7042e-05    6.72189e-05   0.000138855   6.1572e-05    2.0211e-05       35     
end_path:out1:RootOutput                              1.0503e-05    1.62342e-05   3.7207e-05    1.4646e-05    5.70106e-06      35     
end_path:michelremoving:michelremoving                 0.0491223     0.237265       1.51448      0.0803618     0.314861        35     
end_path:michelremovinggnocchi:michelremoving          0.0447545     0.231124       1.50988      0.0752521     0.314703        35     
end_path:calibanagnocchi:CalibAnaTree                  0.847225       2.14826       5.08359       1.74381       1.11407        35     
end_path:out1:RootOutput(write)                         1.25511       1.84018       3.16747       1.76067      0.492081        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5029.51 MB
  Peak resident set size usage (VmHWM): 2689.91 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751_reco_stage1_reco_stage2_20240927T171754_keepup.root
\tHists: np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751_reco_stage1_reco_stage2_20240927T171754_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751_reco_stage1_reco_stage2_20240927T171754_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751_reco_stage1_reco_stage2_20240927T171754_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727442181.0,
    "core.end_time": 1727457477.0,
    "core.events": [
      4761,
      4765,
      4769,
      4773,
      4777,
      4781,
      4785,
      4789,
      4793,
      4797,
      4801,
      4805,
      4809,
      4813,
      4817,
      4821,
      4825,
      4829,
      4833,
      4837,
      4841,
      4845,
      4849,
      4853,
      4857,
      4861,
      4865,
      4869,
      4873,
      4877,
      4881,
      4885,
      4889,
      4893,
      4897
    ],
    "core.event_count": 35,
    "core.first_event_number": 4761,
    "core.last_event_number": 4897,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27412
    ],
    "core.runs_subruns": [
      2741200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751_reco_stage1_reco_stage2_20240927T171754_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727442181.0,
    "core.end_time": 1727457477.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27412
    ],
    "core.runs_subruns": [
      2741200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027412_0034_dataflow1_datawriter_0_20240625T040751.hdf5"
    }
  ]
}
justIN time: 2024-11-17 07:44:17 UTC       justIN version: 01.01.09