justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266105.10@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266105.10@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 00:27:52
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-09-29 02:44:16
From worker nodeHostnamewn6219290.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 00:29:38
Input fileshd-protodune:np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239.hdf5
JobscriptExit code0
Real time2h (7971s)
CPU time2h (7272s = 91%)
Outputting started2024-09-29 02:42:30
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239_reco_stage1_reco_stage2_20240929T024216_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239_reco_stage1_reco_stage2_20240929T024216_keepup_hists.root
Finished2024-09-29 02:44:16
Saved logsjustin-logs:266105.10-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ving 43764 traces tagged "gauss"
FrameSaver: q=943367 n=840804 tag=gauss
wclsFrameSaver: saving 56276 traces tagged "wiener"
FrameSaver: q=1.02412e+06 n=781792 tag=wiener
4029 hits in TPC 0
3704 hits in TPC 1
5056 hits in TPC 2
3899 hits in TPC 3
2117 hits in TPC 4
2580 hits in TPC 5
4798 hits in TPC 6
3488 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1718 XUs and 1181 XVs -> 61 XUVs
C:0 T:2 8988 XUs and 12133 XVs -> 599 XUVs
C:0 T:3 107 XUs and 158 XVs -> 6 XUVs
C:0 T:4 3 XUs and 6 XVs -> 0 XUVs
C:0 T:5 12387 XUs and 17191 XVs -> 197 XUVs
C:0 T:6 14570 XUs and 20819 XVs -> 1018 XUVs
C:0 T:7 31 XUs and 29 XVs -> 1 XUVs
1882 XUVs total
1151 collection wire objects
1882 potential space points
Neighbour search...
28028 tests to find 16104 neighbours
Iterating with no regularization...
Begin: 6.24842e+06
0 5.51308e+06
1 5.48081e+06
2 5.47896e+06
Now with regularization...
Begin: 5.1146e+06
0 5.11413e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

29-Sep-2024 03:42:16 BST  Closed output file "np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239_reco_stage1_reco_stage2_20240929T024216_keepup.root"
29-Sep-2024 03:42:16 BST  Closed input file "np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              87.7768       156.014       339.958       138.249       56.116         39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000477752   0.00342822    0.00575199    0.00336126    0.00137046       39     
produce:fembfilter:PDHDFEMBFilter                      0.696692      0.968967       1.0357       0.985325      0.0667692       39     
produce:wclsdatahd:WireCellToolkit                      48.2895       58.5595       70.4608       57.6673       6.56449        39     
produce:gaushit:GausHitFinder                          0.545238       1.16836       2.0787        1.10811      0.339935        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000382252   0.000541583   0.000882005   0.000496608   0.00013735       39     
produce:reco3d:SpacePointSolver                        0.205336       4.60328       31.2824       1.2895        7.08751        39     
produce:hitpdune:DisambigFromSpacePoints               0.244298       1.10443       3.81984      0.833349      0.817659        39     
produce:pandora:StandardPandora                         6.35867       25.6013       90.2366       18.8204       18.4226        39     
produce:pandoraWriter:StandardPandora                  0.157361      0.301211       0.56054      0.289938      0.0949855       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.528425       2.6193        7.17783       2.07179       1.82847        39     
produce:pandoraShower:LArPandoraShowerCreation         0.474186       3.29573       11.7015       2.10728       2.87443        39     
produce:pandoracalo:Calorimetry                         0.31497       1.23981       3.82373      0.952913      0.866608        39     
produce:pandoracalonosce:Calorimetry                   0.276332       1.16606       3.64742      0.914227      0.867369        39     
produce:pandorapid:Chi2ParticleID                     0.00162038    0.00304816    0.00550344    0.00291353    0.000921256      39     
produce:pandoraShowercalo:ShowerCalorimetry             0.39346       2.96704       11.7435       2.0906        2.72726        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.388157       2.89263       11.0363       2.04186       2.62124        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry           0.13444      0.263608      0.478297      0.247836      0.0814891       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0425332     0.0901151     0.152667      0.0915898     0.0263663       39     
produce:emtrkmichelid:EmTrackMichelId                   22.4206       46.3853       91.1957       44.6682       15.4124        39     
[art]:TriggerResults:TriggerResultInserter            2.2463e-05    5.72815e-05   0.000102163    5.777e-05    1.69314e-05      39     
end_path:out1:RootOutput                               4.308e-06    8.81056e-06   2.8544e-05     7.755e-06    4.35335e-06      39     
end_path:michelremoving:michelremoving                 0.0164378      0.12453      0.681224      0.053898       0.14341        39     
end_path:michelremovinggnocchi:michelremoving          0.0159727     0.122279      0.680223      0.0463678     0.143855        39     
end_path:calibanagnocchi:CalibAnaTree                  0.236634       0.94009       2.61517       0.66199      0.649769        39     
end_path:out1:RootOutput(write)                        0.713722       1.36242       2.52259       1.26292      0.422138        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5002.1 MB
  Peak resident set size usage (VmHWM): 2642.99 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239_reco_stage1_reco_stage2_20240929T024216_keepup.root
\tHists: np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239_reco_stage1_reco_stage2_20240929T024216_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239_reco_stage1_reco_stage2_20240929T024216_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239_reco_stage1_reco_stage2_20240929T024216_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727571586.0,
    "core.end_time": 1727577737.0,
    "core.events": [
      2341,
      2343,
      2345,
      2347,
      2349,
      2351,
      2353,
      2355,
      2357,
      2359,
      2361,
      2363,
      2365,
      2367,
      2369,
      2371,
      2373,
      2375,
      2377,
      2379,
      2381,
      2383,
      2385,
      2387,
      2389,
      2391,
      2393,
      2395,
      2397,
      2399,
      2401,
      2403,
      2405,
      2407,
      2409,
      2411,
      2413,
      2415,
      2417
    ],
    "core.event_count": 39,
    "core.first_event_number": 2341,
    "core.last_event_number": 2417,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239_reco_stage1_reco_stage2_20240929T024216_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727571586.0,
    "core.end_time": 1727577737.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0030_dataflow1_datawriter_0_20240929T000239.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:38:47 UTC       justIN version: 01.01.08