justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244643.105@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244643.105@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 21:21:07
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2024-08-18 22:37:50
From worker nodeHostnamewn-snel-011.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 21:37:13
Input fileshd-protodune:np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420.hdf5
JobscriptExit code0
Real time59m (3544s)
CPU time54m (3253s = 91%)
Outputting started2024-08-18 22:36:18
Output fileshd-protodune-det-reco:np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420_reco_stage1_reco_stage2_20240818T223609_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420_reco_stage1_reco_stage2_20240818T223609_keepup_hists.root
Finished2024-08-18 22:37:50
Saved logsjustin-logs:244643.105-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

TPC 3
2494 hits in TPC 4
4421 hits in TPC 5
5578 hits in TPC 6
4679 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 8 XUs and 9 XVs -> 0 XUVs
C:0 T:1 141 XUs and 147 XVs -> 2 XUVs
C:0 T:2 20032 XUs and 21078 XVs -> 868 XUVs
C:0 T:3 1702 XUs and 2028 XVs -> 55 XUVs
C:0 T:4 99 XUs and 156 XVs -> 11 XUVs
C:0 T:5 10088 XUs and 6952 XVs -> 170 XUVs
C:0 T:6 24813 XUs and 17548 XVs -> 633 XUVs
C:0 T:7 503 XUs and 334 XVs -> 13 XUVs
1752 XUVs total
929 collection wire objects
1752 potential space points
Neighbour search...
22070 tests to find 13696 neighbours
Iterating with no regularization...
Begin: 1.13795e+07
0 1.05986e+07
1 1.05347e+07
2 1.05313e+07
Now with regularization...
Begin: 1.00181e+07
0 1.00165e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 214559 TrkackID 8 startx, y, z 104.995 531.446 38.0062  wireno, peakt tpcno 204 1316.33 2 dist 240.127min T, max_T6.11611 1357.72
no of hits closeby  0   event 214559 TrkackID 8 startx, y, z 104.995 531.446 38.0062  wireno, peakt tpcno 204 1316.33 2 dist 240.127min T, max_T6.11611 1357.72
19-Aug-2024 00:36:09 CEST  Closed output file "np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420_reco_stage1_reco_stage2_20240818T223609_keepup.root"
19-Aug-2024 00:36:09 CEST  Closed input file "np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              30.4034       80.2533       159.806       77.5146       20.9129        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000354937   0.00146464    0.00257319    0.00129642    0.000772515      30     
produce:fembfilter:PDHDFEMBFilter                      0.494981      0.574823      0.925573      0.514429      0.103854        30     
produce:wclsdatahd:WireCellToolkit                      27.6932       29.185        32.2156       29.1366      0.803242        30     
produce:gaushit:GausHitFinder                          0.409377      0.600192       1.05846      0.590009      0.135336        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000224401   0.000404611   0.000713521   0.000387382   0.000123798      30     
produce:reco3d:SpacePointSolver                        0.179674      0.828852       3.4659       0.650541      0.707739        29     
produce:hitpdune:DisambigFromSpacePoints                0.15539       0.45878       1.54496       0.4204       0.242933        29     
produce:pandora:StandardPandora                         5.91157       16.2146       59.5145       13.9911       10.0394        29     
produce:pandoraWriter:StandardPandora                  0.0863994     0.149727      0.282538      0.150458      0.0382643       29     
produce:pandoraTrack:LArPandoraTrackCreation           0.388901       1.18114       3.69143       1.02338      0.613122        29     
produce:pandoraShower:LArPandoraShowerCreation         0.315926       1.22099       3.71921       1.13493       0.61522        29     
produce:pandoracalo:Calorimetry                         0.20903      0.557239       1.51201      0.514186      0.239137        29     
produce:pandoracalonosce:Calorimetry                   0.184053      0.508928       1.42302      0.467341      0.230081        29     
produce:pandorapid:Chi2ParticleID                     0.00109979    0.00181502    0.00372278    0.00173025    0.000495079      29     
produce:pandoraShowercalo:ShowerCalorimetry            0.263099       1.03932       3.03153      0.925118      0.498843        29     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.252094       1.00744       2.85652      0.894766      0.471864        29     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0538301     0.119662      0.209524      0.113439      0.0301262       29     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0200733     0.0425304     0.0685431     0.0410257     0.0099373       29     
produce:emtrkmichelid:EmTrackMichelId                   17.6392       26.0655       40.785        25.7364       5.15658        29     
[art]:TriggerResults:TriggerResultInserter            1.4918e-05    2.42749e-05   9.0049e-05    2.1866e-05    1.26863e-05      30     
end_path:out1:RootOutput                               3.476e-06    5.3918e-06    2.6901e-05    4.6185e-06    4.02102e-06      30     
end_path:michelremoving:michelremoving                1.3164e-05     0.0957073     0.441693      0.0377462     0.111147        30     
end_path:michelremovinggnocchi:michelremoving          4.498e-06     0.0946419     0.432982      0.036091      0.110134        30     
end_path:calibanagnocchi:CalibAnaTree                  3.928e-06     0.718019       1.62632      0.661879      0.319987        30     
end_path:out1:RootOutput(write)                        0.271446       1.12305       1.53086       1.17548      0.228028        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4945.44 MB
  Peak resident set size usage (VmHWM): 2626.21 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420_reco_stage1_reco_stage2_20240818T223609_keepup.root
\tHists: np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420_reco_stage1_reco_stage2_20240818T223609_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420_reco_stage1_reco_stage2_20240818T223609_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420_reco_stage1_reco_stage2_20240818T223609_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724018126.0,
    "core.end_time": 1724020570.0,
    "core.events": [
      214327,
      214335,
      214343,
      214351,
      214359,
      214367,
      214375,
      214383,
      214391,
      214399,
      214407,
      214415,
      214423,
      214431,
      214439,
      214447,
      214455,
      214463,
      214471,
      214479,
      214487,
      214495,
      214503,
      214511,
      214519,
      214527,
      214535,
      214543,
      214551,
      214559
    ],
    "core.event_count": 30,
    "core.first_event_number": 214327,
    "core.last_event_number": 214559,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420_reco_stage1_reco_stage2_20240818T223609_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724018126.0,
    "core.end_time": 1724020570.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0893_dataflow7_datawriter_0_20240818T210420.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:05:43 UTC       justIN version: 01.01.09