justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 77177.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID77177.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3390
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-25 06:09:15
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce01
Last heartbeat2024-09-25 07:31:38
From worker nodeHostnamedune001-2945202.0-lcg2561.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-25 06:10:04
Input fileshd-protodune:np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113.hdf5
JobscriptExit code0
Real time1h (4586s)
CPU time1h (4128s = 90%)
Outputting started2024-09-25 07:26:31
Output fileshd-protodune-det-reco:np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113_reco_stage1_reco_stage2_20240925T072619_keepup.root
hd-protodune-det-reco:np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113_reco_stage1_reco_stage2_20240925T072619_keepup_hists.root
Finished2024-09-25 07:31:38
Saved logsjustin-logs:77177.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

-> 0 XUVs
C:0 T:1 6227 XUs and 3647 XVs -> 108 XUVs
C:0 T:2 41595 XUs and 53545 XVs -> 2064 XUVs
C:0 T:3 244 XUs and 302 XVs -> 7 XUVs
C:0 T:4 218 XUs and 326 XVs -> 2 XUVs
C:0 T:5 23838 XUs and 14800 XVs -> 495 XUVs
C:0 T:6 59771 XUs and 64804 XVs -> 1798 XUVs
C:0 T:7 1567 XUs and 1514 XVs -> 47 XUVs
4521 XUVs total
2080 collection wire objects
4521 potential space points
Neighbour search...
296699 tests to find 148504 neighbours
Iterating with no regularization...
Begin: 8.10091e+06
0 7.60367e+06
1 7.57593e+06
2 7.57307e+06
Now with regularization...
Begin: 7.06554e+06
0 7.06412e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  20   event 865248 TrkackID 6 startx, y, z 129.843 601.716 43.6898  wireno, peakt tpcno 142 2542 2 dist 355.499min T, max_T7.46758 2776.55
no of hits closeby  20   event 865248 TrkackID 6 startx, y, z 129.843 601.716 43.6898  wireno, peakt tpcno 142 2542 2 dist 355.499min T, max_T7.46758 2776.55
25-Sep-2024 07:26:19 UTC  Closed output file "np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113_reco_stage1_reco_stage2_20240925T072619_keepup.root"
25-Sep-2024 07:26:19 UTC  Closed input file "np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              65.1045       101.578       172.036       97.7915       24.2434        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000674448   0.00300643    0.00489478    0.00320145    0.00105872       30     
produce:fembfilter:PDHDFEMBFilter                      0.605662       0.79235      0.962205       0.85575      0.126105        30     
produce:wclsdatahd:WireCellToolkit                      31.8916       40.0337       47.7448       40.408        4.90902        30     
produce:gaushit:GausHitFinder                          0.444603      0.784632       1.43333      0.722197      0.241416        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000309244   0.000403609   0.000641478   0.000385055   8.49288e-05      30     
produce:reco3d:SpacePointSolver                        0.171235       1.09164       3.15313       0.98388      0.666895        30     
produce:hitpdune:DisambigFromSpacePoints               0.229129      0.571904       1.39557      0.533887      0.253836        30     
produce:pandora:StandardPandora                         7.35014       16.0719       41.6512       13.918        8.61016        30     
produce:pandoraWriter:StandardPandora                  0.0940996     0.183001      0.336398      0.184223      0.0580632       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.375507       1.40872       3.2277        1.20815      0.714656        30     
produce:pandoraShower:LArPandoraShowerCreation         0.330897       1.68461       4.42425       1.38595       1.02449        30     
produce:pandoracalo:Calorimetry                        0.242999      0.710595       1.56263      0.609537      0.332513        30     
produce:pandoracalonosce:Calorimetry                   0.215089      0.633572       1.44614      0.543118      0.304797        30     
produce:pandorapid:Chi2ParticleID                     0.00105216    0.00206357     0.0036466    0.00178672    0.000696107      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.310004       1.48028       3.83949       1.29598       0.87255        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.332734       1.4236        3.65929       1.2543       0.852514        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.102602      0.176145      0.326949      0.167832      0.0604982       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0342229     0.0590471     0.112111      0.0522954     0.0198414       30     
produce:emtrkmichelid:EmTrackMichelId                   18.7262       32.3607       53.7483       31.6213       8.40106        30     
[art]:TriggerResults:TriggerResultInserter             2.228e-05    4.59215e-05   8.9251e-05    4.3305e-05    1.80754e-05      30     
end_path:out1:RootOutput                                8.9e-06     1.35744e-05    3.328e-05     1.218e-05    5.16269e-06      30     
end_path:michelremoving:michelremoving                 0.0204658     0.153293      0.874236      0.0464786     0.187475        30     
end_path:michelremovinggnocchi:michelremoving          0.0178049     0.146561       0.87898      0.0428748     0.188192        30     
end_path:calibanagnocchi:CalibAnaTree                  0.201546      0.585732       1.31115      0.567036      0.256697        30     
end_path:out1:RootOutput(write)                        0.640564       1.06227       1.79577       1.05957      0.306777        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5008.02 MB
  Peak resident set size usage (VmHWM): 2659.26 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113_reco_stage1_reco_stage2_20240925T072619_keepup.root
\tHists: np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113_reco_stage1_reco_stage2_20240925T072619_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113_reco_stage1_reco_stage2_20240925T072619_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113_reco_stage1_reco_stage2_20240925T072619_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727246080.0,
    "core.end_time": 1727249179.0,
    "core.events": [
      864944,
      864952,
      864960,
      864968,
      864976,
      864984,
      865016,
      865024,
      865032,
      865040,
      865048,
      865056,
      865064,
      865072,
      865080,
      865088,
      865096,
      865104,
      865112,
      865120,
      865128,
      865136,
      865144,
      865152,
      865160,
      865168,
      865224,
      865232,
      865240,
      865248
    ],
    "core.event_count": 30,
    "core.first_event_number": 864944,
    "core.last_event_number": 865248,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113_reco_stage1_reco_stage2_20240925T072619_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727246080.0,
    "core.end_time": 1727249179.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_3604_dataflow0_datawriter_0_20240902T025113.hdf5"
    }
  ]
}
justIN time: 2024-11-17 09:27:27 UTC       justIN version: 01.01.09