justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244815.114@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244815.114@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 08:07:00
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2024-08-19 09:14:42
From worker nodeHostnamewn-lot-012.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 08:08:44
Input fileshd-protodune:np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714.hdf5
JobscriptExit code0
Real time1h (3905s)
CPU time1h (3619s = 92%)
Outputting started2024-08-19 09:13:49
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714_reco_stage1_reco_stage2_20240819T091342_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714_reco_stage1_reco_stage2_20240819T091342_keepup_hists.root
Finished2024-08-19 09:14:42
Saved logsjustin-logs:244815.114-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

gging trace set: wiener with 93875 traces, 93875 summary
Retagger: tagging trace set: gauss with 69186 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 69186 traces tagged "gauss"
FrameSaver: q=1.39883e+06 n=1256378 tag=gauss
wclsFrameSaver: saving 93875 traces tagged "wiener"
FrameSaver: q=1.50395e+06 n=1122607 tag=wiener
7672 hits in TPC 0
3676 hits in TPC 1
8715 hits in TPC 2
4630 hits in TPC 3
5620 hits in TPC 4
8017 hits in TPC 5
7159 hits in TPC 6
2880 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 713 XUs and 617 XVs -> 36 XUVs
C:0 T:2 44237 XUs and 37296 XVs -> 1473 XUVs
C:0 T:3 180 XUs and 218 XVs -> 8 XUVs
C:0 T:4 102 XUs and 105 XVs -> 0 XUVs
C:0 T:5 53558 XUs and 68319 XVs -> 1443 XUVs
C:0 T:6 37795 XUs and 32018 XVs -> 1206 XUVs
C:0 T:7 567 XUs and 654 XVs -> 47 XUVs
4213 XUVs total
1937 collection wire objects
4213 potential space points
Neighbour search...
162807 tests to find 92620 neighbours
Iterating with no regularization...
Begin: 7.71736e+06
0 7.14478e+06
1 7.10777e+06
2 7.10222e+06
Now with regularization...
Begin: 6.61323e+06
0 6.61087e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 11:13:42 CEST  Closed output file "np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714_reco_stage1_reco_stage2_20240819T091342_keepup.root"
19-Aug-2024 11:13:42 CEST  Closed input file "np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              56.5849       95.0608       165.968       89.282        27.0441        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000290725   0.00195084    0.00355317    0.00205857    0.000838605      30     
produce:fembfilter:PDHDFEMBFilter                      0.523295      0.551075      0.606123      0.551662      0.0144574       30     
produce:wclsdatahd:WireCellToolkit                      28.456        34.5242       39.8164       35.0099       3.63812        30     
produce:gaushit:GausHitFinder                          0.383854      0.667657       1.07441      0.624138      0.180519        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000216857   0.000360766   0.000531106   0.000335559   8.17367e-05      30     
produce:reco3d:SpacePointSolver                        0.162198       1.30785       4.80648      0.870066       1.19859        30     
produce:hitpdune:DisambigFromSpacePoints               0.155266      0.574849       1.31576      0.429358       0.31658        30     
produce:pandora:StandardPandora                         5.86687       20.5049       66.5315       17.4579       13.8373        30     
produce:pandoraWriter:StandardPandora                  0.0743385      0.1572       0.253043      0.141892      0.0471724       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.329984       1.51588       3.30612       1.33618      0.770873        30     
produce:pandoraShower:LArPandoraShowerCreation         0.357571       1.74861       4.46748       1.18361       1.07888        30     
produce:pandoracalo:Calorimetry                        0.178127      0.739415       1.49867      0.655508      0.346504        30     
produce:pandoracalonosce:Calorimetry                   0.155557      0.690786       1.44157      0.611872      0.331051        30     
produce:pandorapid:Chi2ParticleID                     0.00114898    0.00175915    0.00239072    0.00172583    0.000318976      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.342596       1.64467       4.27432       1.09743       1.02982        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.328715       1.58745       4.04879       1.10762      0.986956        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0679771      0.13028      0.185945      0.133074      0.0327255       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0239491     0.0467187     0.0656848     0.0474253     0.0120758       30     
produce:emtrkmichelid:EmTrackMichelId                   14.7094       27.0709       39.9674       25.0916       7.1543         30     
[art]:TriggerResults:TriggerResultInserter            1.3936e-05    1.70277e-05   5.5765e-05    1.53485e-05   7.33367e-06      30     
end_path:out1:RootOutput                               3.707e-06    4.60293e-06   1.7583e-05     4.193e-06    2.43137e-06      30     
end_path:michelremoving:michelremoving                 0.0133362     0.0469662     0.174027      0.0281288     0.0446511       30     
end_path:michelremovinggnocchi:michelremoving          0.011208      0.0457762     0.169945      0.0271147     0.043928        30     
end_path:calibanagnocchi:CalibAnaTree                  0.116934      0.565811       1.2189       0.494789      0.275848        30     
end_path:out1:RootOutput(write)                        0.464592       0.8222        1.18876       0.78336      0.215193        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4984.64 MB
  Peak resident set size usage (VmHWM): 2654.72 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714_reco_stage1_reco_stage2_20240819T091342_keepup.root
\tHists: np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714_reco_stage1_reco_stage2_20240819T091342_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714_reco_stage1_reco_stage2_20240819T091342_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714_reco_stage1_reco_stage2_20240819T091342_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724055940.0,
    "core.end_time": 1724058822.0,
    "core.events": [
      385687,
      385695,
      385703,
      385711,
      385719,
      385727,
      385735,
      385743,
      385751,
      385759,
      385767,
      385775,
      385783,
      385791,
      385799,
      385807,
      385815,
      385823,
      385831,
      385839,
      385847,
      385855,
      385863,
      385871,
      385879,
      385887,
      385895,
      385903,
      385975,
      385983
    ],
    "core.event_count": 30,
    "core.first_event_number": 385687,
    "core.last_event_number": 385983,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714_reco_stage1_reco_stage2_20240819T091342_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724055940.0,
    "core.end_time": 1724058822.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1607_dataflow7_datawriter_0_20240819T042714.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:17:17 UTC       justIN version: 01.01.09