justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264294.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264294.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3453
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 17:10:34
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-26 18:46:46
From worker nodeHostnamewn1208081.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 17:12:03
Input fileshd-protodune:np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532.hdf5
JobscriptExit code0
Real time1h (5577s)
CPU time1h (4964s = 89%)
Outputting started2024-09-26 18:45:01
Output fileshd-protodune-det-reco:np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532_reco_stage1_reco_stage2_20240926T184448_keepup.root
hd-protodune-det-reco:np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532_reco_stage1_reco_stage2_20240926T184448_keepup_hists.root
Finished2024-09-26 18:46:46
Saved logsjustin-logs:264294.2-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

d "gauss"
FrameSaver: q=622125 n=549559 tag=gauss
wclsFrameSaver: saving 35612 traces tagged "wiener"
FrameSaver: q=660357 n=507689 tag=wiener
2574 hits in TPC 0
3114 hits in TPC 1
2045 hits in TPC 2
2412 hits in TPC 3
860 hits in TPC 4
2687 hits in TPC 5
3229 hits in TPC 6
2608 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 58 XUs and 49 XVs -> 1 XUVs
C:0 T:2 3873 XUs and 3477 XVs -> 407 XUVs
C:0 T:3 144 XUs and 191 XVs -> 13 XUVs
C:0 T:4 6 XUs and 11 XVs -> 0 XUVs
C:0 T:5 33408 XUs and 36113 XVs -> 901 XUVs
C:0 T:6 4869 XUs and 5743 XVs -> 324 XUVs
C:0 T:7 95 XUs and 184 XVs -> 7 XUVs
1653 XUVs total
716 collection wire objects
1653 potential space points
Neighbour search...
58213 tests to find 34260 neighbours
Iterating with no regularization...
Begin: 5.45622e+06
0 5.14789e+06
1 5.12178e+06
2 5.1196e+06
Now with regularization...
Begin: 4.82867e+06
0 4.82768e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 19:44:48 BST  Closed output file "np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532_reco_stage1_reco_stage2_20240926T184448_keepup.root"
26-Sep-2024 19:44:48 BST  Closed input file "np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              86.2586       125.31        180.997       121.158       22.2313        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000460097    0.0028586    0.00456911    0.00316627    0.00111197       30     
produce:fembfilter:PDHDFEMBFilter                      0.685498      0.931708      0.997658      0.954728      0.0802882       30     
produce:wclsdatahd:WireCellToolkit                      45.2939       51.3102       54.8217       51.8912       2.53395        30     
produce:gaushit:GausHitFinder                          0.618245       1.02154       1.57776       1.05202      0.259781        30     
produce:nhitsfilter:NumberOfHitsFilter                0.00028653    0.000434136   0.000649154   0.000435921   8.51499e-05      30     
produce:reco3d:SpacePointSolver                        0.348652       1.38012       4.01518       1.05549      0.996882        30     
produce:hitpdune:DisambigFromSpacePoints               0.237178      0.767308       1.60979      0.770077      0.320546        30     
produce:pandora:StandardPandora                         7.93646       19.511        44.6214       17.4414       8.19023        30     
produce:pandoraWriter:StandardPandora                  0.137884      0.257446      0.426229      0.261969      0.0614387       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.402838       1.80253       4.08275       1.71025      0.811812        30     
produce:pandoraShower:LArPandoraShowerCreation         0.463093       1.99153       4.61183       1.78578       1.02447        30     
produce:pandoracalo:Calorimetry                        0.261323      0.869723       1.85842      0.765374      0.352946        30     
produce:pandoracalonosce:Calorimetry                    0.22112      0.781497       1.75637      0.672121      0.339768        30     
produce:pandorapid:Chi2ParticleID                     0.00144163    0.00258996    0.00400486    0.00268811    0.000691871      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.412547       1.67539       4.0446        1.47906      0.802229        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.400959       1.64117       3.73414       1.49955      0.718586        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.107825      0.226183      0.309616      0.226145      0.0515913       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0405007     0.0756139     0.117501      0.0753427     0.0177509       30     
produce:emtrkmichelid:EmTrackMichelId                   21.9097       38.764        60.9614       38.9231       8.19311        30     
[art]:TriggerResults:TriggerResultInserter            2.7161e-05    4.43681e-05   9.8395e-05    4.10875e-05   1.46646e-05      30     
end_path:out1:RootOutput                               4.599e-06    6.7857e-06    2.8694e-05     5.776e-06    4.28132e-06      30     
end_path:michelremoving:michelremoving                 0.0230508     0.123713      0.408919      0.0478393     0.107989        30     
end_path:michelremovinggnocchi:michelremoving          0.0207988     0.123542      0.395424      0.0469465     0.109302        30     
end_path:calibanagnocchi:CalibAnaTree                  0.272787      0.654029       1.05989      0.612067      0.229304        30     
end_path:out1:RootOutput(write)                        0.700272       1.23202       1.76055       1.2743       0.257757        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4912.21 MB
  Peak resident set size usage (VmHWM): 2566.52 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532_reco_stage1_reco_stage2_20240926T184448_keepup.root
\tHists: np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532_reco_stage1_reco_stage2_20240926T184448_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532_reco_stage1_reco_stage2_20240926T184448_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532_reco_stage1_reco_stage2_20240926T184448_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727372466.0,
    "core.end_time": 1727376288.0,
    "core.events": [
      880108,
      880116,
      880124,
      880132,
      880140,
      880148,
      880156,
      880164,
      880172,
      880180,
      880188,
      880196,
      880204,
      880212,
      880220,
      880228,
      880236,
      880244,
      880252,
      880260,
      880268,
      880276,
      880284,
      880292,
      880300,
      880308,
      880316,
      880364,
      880372,
      880380
    ],
    "core.event_count": 30,
    "core.first_event_number": 880108,
    "core.last_event_number": 880380,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532_reco_stage1_reco_stage2_20240926T184448_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727372466.0,
    "core.end_time": 1727376288.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3667_dataflow4_datawriter_0_20240909T045532.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:42:23 UTC       justIN version: 01.01.09