justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59547.169@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59547.169@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 02:07:02
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug_multicore
Last heartbeat2024-08-19 03:19:27
From worker nodeHostnamewn-snel-009.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 02:14:51
Input fileshd-protodune:np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637.hdf5
JobscriptExit code0
Real time1h (3781s)
CPU time57m (3424s = 90%)
Outputting started2024-08-19 03:18:07
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637_reco_stage1_reco_stage2_20240819T031743_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637_reco_stage1_reco_stage2_20240819T031743_keepup_hists.root
Finished2024-08-19 03:19:27
Saved logsjustin-logs:59547.169-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

"wiener"
FrameSaver: q=1.07708e+06 n=786121 tag=wiener
3127 hits in TPC 0
2265 hits in TPC 1
4484 hits in TPC 2
2970 hits in TPC 3
3803 hits in TPC 4
6970 hits in TPC 5
5736 hits in TPC 6
3441 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3310 XUs and 5493 XVs -> 717 XUVs
C:0 T:2 10423 XUs and 19997 XVs -> 925 XUVs
C:0 T:3 154 XUs and 253 XVs -> 13 XUVs
C:0 T:4 51 XUs and 69 XVs -> 5 XUVs
C:0 T:5 21389 XUs and 22698 XVs -> 645 XUVs
C:0 T:6 13257 XUs and 12671 XVs -> 588 XUVs
C:0 T:7 278 XUs and 312 XVs -> 8 XUVs
2901 XUVs total
1285 collection wire objects
2901 potential space points
Neighbour search...
154851 tests to find 90076 neighbours
Iterating with no regularization...
Begin: 1.03389e+07
0 9.91393e+06
1 9.89398e+06
2 9.89194e+06
Now with regularization...
Begin: 9.48139e+06
0 9.48084e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 289915 TrkackID 6 startx, y, z 193.392 128.065 322.56  wireno, peakt tpcno 235 1958.7 5 dist 0.282049min T, max_T5 2492.25
no of hits closeby  0   event 289915 TrkackID 6 startx, y, z 193.392 128.065 322.56  wireno, peakt tpcno 235 1958.7 5 dist 0.282049min T, max_T5 2492.25
19-Aug-2024 05:17:43 CEST  Closed output file "np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637_reco_stage1_reco_stage2_20240819T031743_keepup.root"
19-Aug-2024 05:17:43 CEST  Closed input file "np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              53.8301       85.4852       121.73        87.0448       18.1872        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000342431   0.00189725     0.0037935    0.00168069    0.00105427       30     
produce:fembfilter:PDHDFEMBFilter                      0.495138      0.559038      0.738653      0.521171      0.0703854       30     
produce:wclsdatahd:WireCellToolkit                      28.2005       29.7397       30.9021       29.6107      0.640423        30     
produce:gaushit:GausHitFinder                          0.384524      0.618596      0.844361      0.643947      0.128721        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000203881   0.00038703    0.000765573   0.000349289    0.000143        30     
produce:reco3d:SpacePointSolver                        0.128262       1.20848       2.91496      0.970788      0.773242        30     
produce:hitpdune:DisambigFromSpacePoints               0.159768      0.477197       1.14652      0.476825       0.20031        30     
produce:pandora:StandardPandora                         4.76368       18.3666       44.5018       17.6523       9.51965        30     
produce:pandoraWriter:StandardPandora                  0.077792      0.153047      0.226138      0.158152      0.0347262       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.430992       1.37369       3.15733       1.24948      0.594685        30     
produce:pandoraShower:LArPandoraShowerCreation         0.552339       1.40777       3.40173       1.38386      0.669927        30     
produce:pandoracalo:Calorimetry                        0.250014       0.62402       1.3265       0.585301      0.229226        30     
produce:pandoracalonosce:Calorimetry                   0.220634      0.574567       1.27856      0.525439      0.220601        30     
produce:pandorapid:Chi2ParticleID                      0.0010893     0.0018035    0.00353973     0.0017315    0.00046335       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.502045       1.16905       2.79237       1.1796       0.522597        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.477898       1.13129       2.66973       1.12703      0.509094        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0725321     0.119503      0.179019      0.120192      0.0259774       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0250409     0.0421778     0.0693262     0.0422587    0.00959059       30     
produce:emtrkmichelid:EmTrackMichelId                   15.3849       25.5964       35.4496       26.5561       5.16928        30     
[art]:TriggerResults:TriggerResultInserter            2.0078e-05    3.21174e-05   0.000153277   2.58835e-05   2.36706e-05      30     
end_path:out1:RootOutput                               3.968e-06    5.82263e-06   3.3533e-05     4.754e-06    5.18036e-06      30     
end_path:michelremoving:michelremoving                 0.0221142      0.11262      0.495793      0.0417735     0.124443        30     
end_path:michelremovinggnocchi:michelremoving          0.0220424     0.109833      0.495116      0.0402091     0.125454        30     
end_path:calibanagnocchi:CalibAnaTree                  0.381883      0.836917       1.85862      0.774512      0.326239        30     
end_path:out1:RootOutput(write)                        0.919785       1.12231       1.3307        1.11537      0.118911        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4979.67 MB
  Peak resident set size usage (VmHWM): 2654.63 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637_reco_stage1_reco_stage2_20240819T031743_keepup.root
\tHists: np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637_reco_stage1_reco_stage2_20240819T031743_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637_reco_stage1_reco_stage2_20240819T031743_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637_reco_stage1_reco_stage2_20240819T031743_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724034862.0,
    "core.end_time": 1724037464.0,
    "core.events": [
      289651,
      289659,
      289667,
      289707,
      289715,
      289723,
      289731,
      289739,
      289747,
      289755,
      289763,
      289771,
      289779,
      289787,
      289795,
      289803,
      289811,
      289819,
      289827,
      289835,
      289843,
      289851,
      289859,
      289867,
      289875,
      289883,
      289891,
      289899,
      289907,
      289915
    ],
    "core.event_count": 30,
    "core.first_event_number": 289651,
    "core.last_event_number": 289915,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637_reco_stage1_reco_stage2_20240819T031743_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724034862.0,
    "core.end_time": 1724037464.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1207_dataflow3_datawriter_0_20240819T001637.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:17:30 UTC       justIN version: 01.01.08