justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261991.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID261991.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3390
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-25 06:20:17
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-09-25 07:38:58
From worker nodeHostnamedune001-2639653.0-lcg2602.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-25 06:21:02
Input fileshd-protodune:np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757.hdf5
JobscriptExit code0
Real time1h (4569s)
CPU time1h (4108s = 89%)
Outputting started2024-09-25 07:37:12
Output fileshd-protodune-det-reco:np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757_reco_stage1_reco_stage2_20240925T073659_keepup.root
hd-protodune-det-reco:np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757_reco_stage1_reco_stage2_20240925T073659_keepup_hists.root
Finished2024-09-25 07:38:58
Saved logsjustin-logs:261991.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

in TPC 2
3979 hits in TPC 3
2158 hits in TPC 4
3860 hits in TPC 5
5035 hits in TPC 6
3022 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2783 XUs and 3066 XVs -> 114 XUVs
C:0 T:2 22569 XUs and 24230 XVs -> 1411 XUVs
C:0 T:3 36 XUs and 67 XVs -> 4 XUVs
C:0 T:4 36 XUs and 81 XVs -> 1 XUVs
C:0 T:5 6905 XUs and 16356 XVs -> 487 XUVs
C:0 T:6 19818 XUs and 29998 XVs -> 653 XUVs
C:0 T:7 656 XUs and 444 XVs -> 10 XUVs
2680 XUVs total
1370 collection wire objects
2680 potential space points
Neighbour search...
109372 tests to find 50262 neighbours
Iterating with no regularization...
Begin: 9.53408e+06
0 8.20789e+06
1 8.10809e+06
2 8.09542e+06
3 8.09221e+06
Now with regularization...
Begin: 7.65038e+06
0 7.64872e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 861358 TrkackID 4 startx, y, z 129.616 470.083 297.116  wireno, peakt tpcno 263 1652.38 2 dist 154.035min T, max_T3.68907 1652.38
no of hits closeby  0   event 861358 TrkackID 4 startx, y, z 129.616 470.083 297.116  wireno, peakt tpcno 263 1652.38 2 dist 154.035min T, max_T3.68907 1652.38
25-Sep-2024 07:36:59 UTC  Closed output file "np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757_reco_stage1_reco_stage2_20240925T073659_keepup.root"
25-Sep-2024 07:36:59 UTC  Closed input file "np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              66.2674       102.723       147.856       101.217       20.838         30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00046015    0.00280046    0.00556753    0.00283664    0.00140721       30     
produce:fembfilter:PDHDFEMBFilter                      0.636233      0.913567       1.27436      0.922346      0.102561        30     
produce:wclsdatahd:WireCellToolkit                      34.9219       42.0591       47.7038       41.7472       2.48376        30     
produce:gaushit:GausHitFinder                          0.407216      0.867158       1.29151      0.839753      0.230135        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000212995   0.000434834   0.000678766   0.00042383    9.91769e-05      30     
produce:reco3d:SpacePointSolver                        0.197754       1.13705       3.75505      0.733785      0.898341        30     
produce:hitpdune:DisambigFromSpacePoints               0.118118      0.654105       1.55879      0.633133      0.311896        30     
produce:pandora:StandardPandora                         3.63736       15.7285       42.1468       14.1582       7.78796        30     
produce:pandoraWriter:StandardPandora                  0.0721986     0.173052      0.281889      0.172381      0.0492093       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.307122       1.37583       2.91019       1.35642      0.600752        30     
produce:pandoraShower:LArPandoraShowerCreation         0.386621       1.55537       4.39828       1.54579      0.820413        30     
produce:pandoracalo:Calorimetry                        0.247052      0.768766       1.38009      0.745662      0.287873        30     
produce:pandoracalonosce:Calorimetry                   0.204003       0.67674       1.28276      0.648048      0.260394        30     
produce:pandorapid:Chi2ParticleID                     0.00144961    0.00245891    0.00358997    0.00246289    0.000503107      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.321793       1.42939       3.24266       1.34579       0.70878        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.304666       1.37947       3.10446       1.31342      0.664323        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0771572      0.18132      0.272353      0.183921      0.0527657       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0254978     0.0610601     0.0884146     0.0611322     0.0172658       30     
produce:emtrkmichelid:EmTrackMichelId                   16.9532       31.8925       53.392        30.1511       8.28875        30     
[art]:TriggerResults:TriggerResultInserter            2.7911e-05    5.86876e-05   0.000220356   4.5366e-05    3.71133e-05      30     
end_path:out1:RootOutput                               9.57e-06     1.59907e-05   6.5372e-05     1.311e-05    1.02821e-05      30     
end_path:michelremoving:michelremoving                 0.0170216     0.0928241      0.26394      0.0400915     0.0807456       30     
end_path:michelremovinggnocchi:michelremoving          0.0174102     0.0890766     0.261336      0.0355744     0.0802678       30     
end_path:calibanagnocchi:CalibAnaTree                  0.156468      0.543012       1.17796      0.509953      0.226736        30     
end_path:out1:RootOutput(write)                        0.530142      0.988446       1.41477       1.01534       0.22963        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4938.34 MB
  Peak resident set size usage (VmHWM): 2572.08 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757_reco_stage1_reco_stage2_20240925T073659_keepup.root
\tHists: np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757_reco_stage1_reco_stage2_20240925T073659_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757_reco_stage1_reco_stage2_20240925T073659_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757_reco_stage1_reco_stage2_20240925T073659_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727246684.0,
    "core.end_time": 1727249820.0,
    "core.events": [
      861126,
      861134,
      861142,
      861150,
      861158,
      861166,
      861174,
      861182,
      861190,
      861198,
      861206,
      861214,
      861222,
      861230,
      861238,
      861246,
      861254,
      861262,
      861270,
      861278,
      861286,
      861294,
      861302,
      861310,
      861318,
      861326,
      861334,
      861342,
      861350,
      861358
    ],
    "core.event_count": 30,
    "core.first_event_number": 861126,
    "core.last_event_number": 861358,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757_reco_stage1_reco_stage2_20240925T073659_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727246684.0,
    "core.end_time": 1727249820.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_3588_dataflow6_datawriter_0_20240902T023757.hdf5"
    }
  ]
}
justIN time: 2024-11-17 09:43:18 UTC       justIN version: 01.01.09