justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266135.4@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266135.4@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 02:21:47
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-09-29 04:25:07
From worker nodeHostnamewn1206080.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 02:23:39
Input fileshd-protodune:np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630.hdf5
JobscriptExit code0
Real time1h (7190s)
CPU time1h (6487s = 90%)
Outputting started2024-09-29 04:23:31
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630_reco_stage1_reco_stage2_20240929T042316_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630_reco_stage1_reco_stage2_20240929T042316_keepup_hists.root
Finished2024-09-29 04:25:07
Saved logsjustin-logs:266135.4-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

g XUV coincidences...
C:0 T:1 7959 XUs and 5600 XVs -> 228 XUVs
C:0 T:2 5865 XUs and 7903 XVs -> 243 XUVs
C:0 T:3 57 XUs and 59 XVs -> 7 XUVs
C:0 T:4 186 XUs and 308 XVs -> 6 XUVs
C:0 T:5 11874 XUs and 20697 XVs -> 470 XUVs
C:0 T:6 34896 XUs and 21327 XVs -> 1171 XUVs
C:0 T:7 374 XUs and 554 XVs -> 14 XUVs
2139 XUVs total
895 collection wire objects
2139 potential space points
Neighbour search...
88301 tests to find 51290 neighbours
Iterating with no regularization...
Begin: 4.49133e+06
0 4.27494e+06
1 4.25906e+06
2 4.2557e+06
Now with regularization...
Begin: 3.98659e+06
0 3.98506e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  7   event 3041 TrkackID 9 startx, y, z 34.7276 592.122 414.696  wireno, peakt tpcno 314 15 5 dist 1.22314min T, max_T3.37332 1348.54
no of hits closeby  7   event 3041 TrkackID 9 startx, y, z 34.7276 592.122 414.696  wireno, peakt tpcno 314 15 5 dist 1.22314min T, max_T3.37332 1348.54
29-Sep-2024 05:23:16 BST  Closed output file "np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630_reco_stage1_reco_stage2_20240929T042316_keepup.root"
29-Sep-2024 05:23:16 BST  Closed input file "np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              87.9325       136.392       266.382       126.767       37.5415        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000515891   0.00366355     0.0161861    0.00310197    0.00255292       39     
produce:fembfilter:PDHDFEMBFilter                      0.919792      0.964138       1.02544      0.965438      0.0207755       39     
produce:wclsdatahd:WireCellToolkit                      46.8887       55.3537       64.7848       54.6803       3.40817        39     
produce:gaushit:GausHitFinder                          0.499934       1.03569       1.68772      0.982018       0.25852        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000279446   0.000491907   0.00095159    0.000465736   0.000122183      39     
produce:reco3d:SpacePointSolver                        0.233417       3.59304       19.9294       1.15145       4.75906        39     
produce:hitpdune:DisambigFromSpacePoints               0.205997      0.877106       2.56204      0.691966      0.521549        39     
produce:pandora:StandardPandora                         5.96899       20.1277       63.6088       16.4938       13.1546        39     
produce:pandoraWriter:StandardPandora                  0.141012      0.268638      0.566704      0.246132      0.0807829       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.536553       1.99336       6.36608       1.76901       1.11745        39     
produce:pandoraShower:LArPandoraShowerCreation         0.385303       2.39013       10.9484       1.93903       1.85075        39     
produce:pandoracalo:Calorimetry                        0.313182      0.988703       3.19499      0.879471      0.529493        39     
produce:pandoracalonosce:Calorimetry                   0.264479      0.906861       3.02331      0.798303      0.518557        39     
produce:pandorapid:Chi2ParticleID                     0.00155373     0.0028199    0.00472174    0.00276337    0.000701207      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.325076        2.135        9.39009       1.7814        1.60373        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.313688       2.06537       9.50029       1.69061       1.58477        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.116021      0.235738      0.409035      0.243491      0.0626839       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0353414     0.0804079     0.176192      0.0800265     0.0256856       39     
produce:emtrkmichelid:EmTrackMichelId                   21.2672       40.9676       85.7707       39.2796       12.531         39     
[art]:TriggerResults:TriggerResultInserter            2.7542e-05    5.53104e-05   0.000109836   5.3901e-05    1.52648e-05      39     
end_path:out1:RootOutput                               5.239e-06    8.50667e-06   2.8985e-05     6.853e-06    4.16101e-06      39     
end_path:michelremoving:michelremoving                 0.0196525     0.133313       0.80046      0.0520852     0.147678        39     
end_path:michelremovinggnocchi:michelremoving          0.0185232     0.132554      0.793556      0.0525258     0.147424        39     
end_path:calibanagnocchi:CalibAnaTree                  0.178977      0.703463       1.97034       0.68192      0.331439        39     
end_path:out1:RootOutput(write)                        0.643635       1.21915       2.2387        1.16732      0.340357        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4999.95 MB
  Peak resident set size usage (VmHWM): 2653.75 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630_reco_stage1_reco_stage2_20240929T042316_keepup.root
\tHists: np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630_reco_stage1_reco_stage2_20240929T042316_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630_reco_stage1_reco_stage2_20240929T042316_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630_reco_stage1_reco_stage2_20240929T042316_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727578415.0,
    "core.end_time": 1727583797.0,
    "core.events": [
      2965,
      2967,
      2969,
      2971,
      2973,
      2975,
      2977,
      2979,
      2981,
      2983,
      2985,
      2987,
      2989,
      2991,
      2993,
      2995,
      2997,
      2999,
      3001,
      3003,
      3005,
      3007,
      3009,
      3011,
      3013,
      3015,
      3017,
      3019,
      3021,
      3023,
      3025,
      3027,
      3029,
      3031,
      3033,
      3035,
      3037,
      3039,
      3041
    ],
    "core.event_count": 39,
    "core.first_event_number": 2965,
    "core.last_event_number": 3041,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630_reco_stage1_reco_stage2_20240929T042316_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727578415.0,
    "core.end_time": 1727583797.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0038_dataflow1_datawriter_0_20240929T014630.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:31:09 UTC       justIN version: 01.01.08