justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244566.186@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244566.186@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 19:28:09
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel
Last heartbeat2024-08-18 21:50:39
From worker nodeHostnamewn-lot-027.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statestalled
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 20:39:36
Input fileshd-protodune:np04hd_raw_run028762_0793_dataflow2_datawriter_0_20240818T200524.hdf5
Outputting started2024-08-18 21:50:39
Output files
Finished2024-08-18 22:02:16
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ag=wiener
6866 hits in TPC 0
5281 hits in TPC 1
7338 hits in TPC 2
3873 hits in TPC 3
3569 hits in TPC 4
6219 hits in TPC 5
9026 hits in TPC 6
4548 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 185 XUs and 132 XVs -> 12 XUVs
C:0 T:1 7291 XUs and 4345 XVs -> 1113 XUVs
C:0 T:2 56876 XUs and 81290 XVs -> 2553 XUVs
C:0 T:3 425 XUs and 575 XVs -> 10 XUVs
C:0 T:4 54 XUs and 90 XVs -> 4 XUVs
C:0 T:5 23992 XUs and 22625 XVs -> 936 XUVs
C:0 T:6 64714 XUs and 92818 XVs -> 2234 XUVs
C:0 T:7 997 XUs and 1079 XVs -> 27 XUVs
6889 XUVs total
2415 collection wire objects
6889 potential space points
Neighbour search...
236547 tests to find 131414 neighbours
Iterating with no regularization...
Begin: 1.38313e+07
0 1.2352e+07
1 1.22649e+07
2 1.22539e+07
Now with regularization...
Begin: 1.15891e+07
0 1.15844e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  4   event 190634 TrkackID 9 startx, y, z 41.6978 584.914 233.103  wireno, peakt tpcno 444 1697.85 5 dist 0min T, max_T1672.98 2276.57
no of hits closeby  4   event 190634 TrkackID 9 startx, y, z 41.6978 584.914 233.103  wireno, peakt tpcno 444 1697.85 5 dist 0min T, max_T1672.98 2276.57
18-Aug-2024 23:50:31 CEST  Closed output file "np04hd_raw_run028762_0793_dataflow2_datawriter_0_20240818T200524_reco_stage1_reco_stage2_20240818T215031_keepup.root"
18-Aug-2024 23:50:31 CEST  Closed input file "np04hd_raw_run028762_0793_dataflow2_datawriter_0_20240818T200524_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              68.2326       100.963       213.757       96.1071       30.0282        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000339225    0.0022089    0.00459586    0.00210812    0.00128364       30     
produce:fembfilter:PDHDFEMBFilter                      0.604858      0.623491      0.683104      0.621457      0.0160047       30     
produce:wclsdatahd:WireCellToolkit                      33.8045       36.3601       42.6145       35.7102       2.16993        30     
produce:gaushit:GausHitFinder                          0.442438      0.762833       1.13816      0.731724      0.183339        30     
produce:nhitsfilter:NumberOfHitsFilter                0.00026718    0.000464136   0.000682237   0.000453745   0.000113567      30     
produce:reco3d:SpacePointSolver                        0.214069       1.29503       3.34238       1.09611      0.821313        30     
produce:hitpdune:DisambigFromSpacePoints               0.202681      0.608899       1.50418      0.544235      0.314438        30     
produce:pandora:StandardPandora                         6.20137       21.4022       87.1874       17.3329       15.9351        30     
produce:pandoraWriter:StandardPandora                  0.116905      0.194376       0.35187      0.192655      0.0519674       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.667587       1.97239       8.10345       1.5133        1.40424        30     
produce:pandoraShower:LArPandoraShowerCreation         0.682303       2.23748       9.18375       1.59488       1.74144        30     
produce:pandoracalo:Calorimetry                         0.35888      0.855034       1.80012      0.703963       0.39431        30     
produce:pandoracalonosce:Calorimetry                    0.31847      0.798658       1.90116      0.649757      0.388647        30     
produce:pandorapid:Chi2ParticleID                     0.00135179    0.00203787    0.00299444    0.00194548    0.00043944       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.617235       1.84154       4.60289       1.41035       1.14961        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.618292       1.76108       4.31317       1.30864       1.08868        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0966481     0.150268      0.234794      0.139731      0.0365041       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.034357      0.0546354     0.0817317     0.0524561     0.0129984       30     
produce:emtrkmichelid:EmTrackMichelId                   17.0264       28.0911       44.6462       26.8935       6.79015        30     
[art]:TriggerResults:TriggerResultInserter            1.7072e-05    2.91197e-05   7.0031e-05    2.77265e-05   1.09299e-05      30     
end_path:out1:RootOutput                               4.068e-06    5.66213e-06   1.9446e-05     4.794e-06    2.9121e-06       30     
end_path:michelremoving:michelremoving                 0.0174207     0.074591      0.229782      0.0455655     0.0620876       30     
end_path:michelremovinggnocchi:michelremoving          0.0167164     0.0730285      0.23257      0.0442038     0.0618499       30     
end_path:calibanagnocchi:CalibAnaTree                  0.246853      0.698858       2.01571       0.60716      0.406049        30     
end_path:out1:RootOutput(write)                        0.561912      0.923936       1.49611      0.853738      0.233383        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5008.76 MB
  Peak resident set size usage (VmHWM): 2691.89 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_0793_dataflow2_datawriter_0_20240818T200524_reco_stage1_reco_stage2_20240818T215031_keepup.root
\tHists: np04hd_raw_run028762_0793_dataflow2_datawriter_0_20240818T200524_reco_stage1_reco_stage2_20240818T215031_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_0793_dataflow2_datawriter_0_20240818T200524_reco_stage1_reco_stage2_20240818T215031_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_0793_dataflow2_datawriter_0_20240818T200524_reco_stage1_reco_stage2_20240818T215031_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724014756.0,
    "core.end_time": 1724017831.0,
    "core.events": [
      190314,
      190322,
      190330,
      190346,
      190354,
      190362,
      190370,
      190378,
      190386,
      190394,
      190402,
      190410,
      190418,
      190426,
      190434,
      190442,
      190450,
      190458,
      190466,
      190474,
      190482,
      190490,
      190498,
      190506,
      190514,
      190522,
      190530,
      190538,
      190626,
      190634
    ],
    "core.event_count": 30,
    "core.first_event_number": 190314,
    "core.last_event_number": 190634,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0793_dataflow2_datawriter_0_20240818T200524.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_0793_dataflow2_datawriter_0_20240818T200524_reco_stage1_reco_stage2_20240818T215031_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724014756.0,
    "core.end_time": 1724017831.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0793_dataflow2_datawriter_0_20240818T200524.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:16:13 UTC       justIN version: 01.01.08