justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59653.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59653.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 08:45:44
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk
Last heartbeat2024-08-19 09:55:59
From worker nodeHostnamewn-lot-026.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 08:47:28
Input fileshd-protodune:np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109.hdf5
JobscriptExit code0
Real time1h (4050s)
CPU time1h (3711s = 91%)
Outputting started2024-08-19 09:54:58
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109_reco_stage1_reco_stage2_20240819T095449_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109_reco_stage1_reco_stage2_20240819T095449_keepup_hists.root
Finished2024-08-19 09:55:59
Saved logsjustin-logs:59653.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

TPC 2
2588 hits in TPC 3
4947 hits in TPC 4
7403 hits in TPC 5
4195 hits in TPC 6
2273 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 4857 XUs and 3981 XVs -> 392 XUVs
C:0 T:2 15413 XUs and 26390 XVs -> 1826 XUVs
C:0 T:3 48 XUs and 77 XVs -> 0 XUVs
C:0 T:4 141 XUs and 172 XVs -> 5 XUVs
C:0 T:5 33698 XUs and 29053 XVs -> 2210 XUVs
C:0 T:6 6111 XUs and 5099 XVs -> 280 XUVs
C:0 T:7 17 XUs and 19 XVs -> 0 XUVs
4713 XUVs total
1492 collection wire objects
4713 potential space points
Neighbour search...
224453 tests to find 140192 neighbours
Iterating with no regularization...
Begin: 5.98996e+06
0 5.34715e+06
1 5.27482e+06
2 5.25752e+06
3 5.25156e+06
4 5.24873e+06
Now with regularization...
Begin: 4.73335e+06
0 4.73104e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  6   event 357594 TrkackID 3 startx, y, z -25.6766 497.367 446.649  wireno, peakt tpcno 129 3966.01 6 dist 0min T, max_T3965.44 5857.5
no of hits closeby  6   event 357594 TrkackID 3 startx, y, z -25.6766 497.367 446.649  wireno, peakt tpcno 129 3966.01 6 dist 0min T, max_T3965.44 5857.5
19-Aug-2024 11:54:49 CEST  Closed output file "np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109_reco_stage1_reco_stage2_20240819T095449_keepup.root"
19-Aug-2024 11:54:49 CEST  Closed input file "np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              65.5543       95.685        218.085       87.6124       28.2652        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000292288   0.00189414    0.00399685    0.00186988    0.000993207      30     
produce:fembfilter:PDHDFEMBFilter                      0.582684      0.595551      0.620115      0.594696     0.00750699       30     
produce:wclsdatahd:WireCellToolkit                      32.0961        33.29        35.4247       33.2527      0.712312        30     
produce:gaushit:GausHitFinder                          0.483481      0.695793       1.00637      0.678916      0.131352        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000272641   0.000361256   0.00050111    0.000355387   6.09565e-05      30     
produce:reco3d:SpacePointSolver                        0.296517       1.05799       3.05621      0.982552      0.703175        30     
produce:hitpdune:DisambigFromSpacePoints               0.273782      0.568661       1.09352      0.481845      0.223172        30     
produce:pandora:StandardPandora                         6.44534       23.7561       136.078       18.3079       22.7294        30     
produce:pandoraWriter:StandardPandora                  0.120173      0.175906      0.246907      0.162469      0.0369531       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.512259       1.42956       2.87288       1.32705      0.531477        30     
produce:pandoraShower:LArPandoraShowerCreation         0.840571       1.49568       3.22212       1.3815       0.585396        30     
produce:pandoracalo:Calorimetry                        0.304207      0.684885       1.38971      0.639516      0.226559        30     
produce:pandoracalonosce:Calorimetry                   0.278875      0.624132       1.27505      0.584556      0.215586        30     
produce:pandorapid:Chi2ParticleID                     0.00108605    0.00183281    0.00288642    0.00178201    0.000348854      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.713771       1.3261        2.85361       1.19642      0.529046        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.701981       1.27793       2.91482       1.14118      0.510376        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.106445      0.144062      0.203855      0.146453      0.0234405       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0369385     0.050935      0.0707994     0.0515533     0.0079859       30     
produce:emtrkmichelid:EmTrackMichelId                   19.1175       26.8045       38.6801       25.4749       4.90547        30     
[art]:TriggerResults:TriggerResultInserter            1.5108e-05    2.03665e-05   6.8879e-05    1.7538e-05    9.51448e-06      30     
end_path:out1:RootOutput                               3.646e-06     4.602e-06    1.7684e-05     4.183e-06    2.44523e-06      30     
end_path:michelremoving:michelremoving                 0.0200399     0.0902349     0.279613      0.0302127     0.0820425       30     
end_path:michelremovinggnocchi:michelremoving          0.0198434     0.0891563     0.277788      0.0287381     0.0820925       30     
end_path:calibanagnocchi:CalibAnaTree                  0.232699      0.508118       1.08071       0.46888      0.193601        30     
end_path:out1:RootOutput(write)                        0.620077      0.879866       1.26925       0.84628      0.159302        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4950.63 MB
  Peak resident set size usage (VmHWM): 2635.59 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109_reco_stage1_reco_stage2_20240819T095449_keepup.root
\tHists: np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109_reco_stage1_reco_stage2_20240819T095449_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109_reco_stage1_reco_stage2_20240819T095449_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109_reco_stage1_reco_stage2_20240819T095449_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724058384.0,
    "core.end_time": 1724061290.0,
    "core.events": [
      357314,
      357322,
      357330,
      357338,
      357394,
      357402,
      357410,
      357418,
      357426,
      357434,
      357442,
      357450,
      357458,
      357466,
      357474,
      357482,
      357490,
      357498,
      357506,
      357514,
      357522,
      357530,
      357538,
      357546,
      357554,
      357562,
      357570,
      357578,
      357586,
      357594
    ],
    "core.event_count": 30,
    "core.first_event_number": 357314,
    "core.last_event_number": 357594,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109_reco_stage1_reco_stage2_20240819T095449_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724058384.0,
    "core.end_time": 1724061290.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1489_dataflow2_datawriter_0_20240819T031109.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:08:36 UTC       justIN version: 01.01.09