justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266196.1@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266196.1@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 03:53:39
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-09-29 05:37:24
From worker nodeHostnamewn2209251.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 03:55:45
Input fileshd-protodune:np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248.hdf5
JobscriptExit code0
Real time1h (6001s)
CPU time1h (5311s = 88%)
Outputting started2024-09-29 05:35:47
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248_reco_stage1_reco_stage2_20240929T053533_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248_reco_stage1_reco_stage2_20240929T053533_keepup_hists.root
Finished2024-09-29 05:37:24
Saved logsjustin-logs:266196.1-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ooked to 5859 ticks
wclsFrameSaver: saving 43065 traces tagged "gauss"
FrameSaver: q=945990 n=867660 tag=gauss
wclsFrameSaver: saving 55479 traces tagged "wiener"
FrameSaver: q=1.0164e+06 n=803036 tag=wiener
2959 hits in TPC 0
3300 hits in TPC 1
6163 hits in TPC 2
4164 hits in TPC 3
4056 hits in TPC 4
5214 hits in TPC 5
3386 hits in TPC 6
2063 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 16 XUs and 18 XVs -> 2 XUVs
C:0 T:1 755 XUs and 1144 XVs -> 49 XUVs
C:0 T:2 14269 XUs and 33370 XVs -> 571 XUVs
C:0 T:3 154 XUs and 280 XVs -> 7 XUVs
C:0 T:4 390 XUs and 360 XVs -> 21 XUVs
C:0 T:5 14726 XUs and 24024 XVs -> 477 XUVs
C:0 T:6 4993 XUs and 18703 XVs -> 205 XUVs
C:0 T:7 183 XUs and 245 XVs -> 7 XUVs
1339 XUVs total
912 collection wire objects
1339 potential space points
Neighbour search...
18417 tests to find 10798 neighbours
Iterating with no regularization...
Begin: 7.94722e+06
0 7.39134e+06
1 7.38208e+06
2 7.38062e+06
Now with regularization...
Begin: 7.16936e+06
0 7.16913e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

29-Sep-2024 06:35:33 BST  Closed output file "np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248_reco_stage1_reco_stage2_20240929T053533_keepup.root"
29-Sep-2024 06:35:33 BST  Closed input file "np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              70.7812       113.088       205.965       101.377       33.7672        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000638361   0.00298563    0.00503338    0.00304036    0.00129321       39     
produce:fembfilter:PDHDFEMBFilter                      0.653176      0.779732      0.975182      0.775407      0.0584682       39     
produce:wclsdatahd:WireCellToolkit                      37.9528       46.4943       55.8026       45.9447       4.43624        39     
produce:gaushit:GausHitFinder                          0.323002      0.868486       1.76496      0.811804      0.309214        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000263275   0.000411857   0.000693595   0.000395394   0.000104036      39     
produce:reco3d:SpacePointSolver                        0.133553       2.91478       13.4319       0.75612       3.85405        39     
produce:hitpdune:DisambigFromSpacePoints               0.128502      0.818462       2.28327      0.609821      0.578491        39     
produce:pandora:StandardPandora                         3.72814       15.9232       45.9607       12.2447       10.4124        39     
produce:pandoraWriter:StandardPandora                  0.102948      0.223048      0.406845      0.212176      0.0781452       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.398432       1.5011        4.41005       1.08028       1.02269        39     
produce:pandoraShower:LArPandoraShowerCreation          0.33259       1.70374       5.59923       1.27948       1.27178        39     
produce:pandoracalo:Calorimetry                        0.227466      0.789108       2.1031        0.59697      0.481002        39     
produce:pandoracalonosce:Calorimetry                    0.19989      0.711391       2.10811      0.542541      0.463369        39     
produce:pandorapid:Chi2ParticleID                     0.00145445    0.00230422    0.00400359    0.00223815    0.000603793      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.266297       1.61229       5.90271       1.09049       1.32189        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.283699       1.55642       5.49391       1.07736       1.26139        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0816733     0.178847      0.365463      0.173644      0.0689589       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0159889     0.0597138     0.128009      0.0553983     0.0232211       39     
produce:emtrkmichelid:EmTrackMichelId                   14.0514       34.874        65.8745       31.7465       12.7963        39     
[art]:TriggerResults:TriggerResultInserter            2.9786e-05    5.36722e-05   0.000118763   5.0616e-05    1.51883e-05      39     
end_path:out1:RootOutput                               7.665e-06    1.4833e-05    3.7901e-05    1.2514e-05    7.19894e-06      39     
end_path:michelremoving:michelremoving                 0.0186584     0.133946      0.513178      0.0994755     0.126033        39     
end_path:michelremovinggnocchi:michelremoving          0.0162975     0.131126      0.509333      0.0859558     0.126465        39     
end_path:calibanagnocchi:CalibAnaTree                  0.171461      0.566825       1.55366      0.463748      0.326372        39     
end_path:out1:RootOutput(write)                        0.547249       1.06967       1.82818      0.999439      0.343955        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4998.14 MB
  Peak resident set size usage (VmHWM): 2647.57 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248_reco_stage1_reco_stage2_20240929T053533_keepup.root
\tHists: np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248_reco_stage1_reco_stage2_20240929T053533_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248_reco_stage1_reco_stage2_20240929T053533_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248_reco_stage1_reco_stage2_20240929T053533_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727583674.0,
    "core.end_time": 1727588134.0,
    "core.events": [
      3121,
      3123,
      3125,
      3127,
      3129,
      3131,
      3133,
      3135,
      3137,
      3139,
      3141,
      3143,
      3145,
      3147,
      3149,
      3151,
      3153,
      3155,
      3157,
      3159,
      3161,
      3163,
      3165,
      3167,
      3169,
      3171,
      3173,
      3175,
      3177,
      3179,
      3181,
      3183,
      3185,
      3187,
      3189,
      3191,
      3193,
      3195,
      3197
    ],
    "core.event_count": 39,
    "core.first_event_number": 3121,
    "core.last_event_number": 3197,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248_reco_stage1_reco_stage2_20240929T053533_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727583674.0,
    "core.end_time": 1727588134.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0040_dataflow1_datawriter_0_20240929T021248.hdf5"
    }
  ]
}
justIN time: 2024-11-17 03:16:10 UTC       justIN version: 01.01.09