justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59577.156@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59577.156@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2868
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 06:52:53
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2024-08-19 08:31:38
From worker nodeHostnamewn-sate-018.farm.nikhef.nl
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 07:07:29
Input fileshd-protodune:np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954.hdf5
JobscriptExit code0
Real time1h (4980s)
CPU time1h (4667s = 93%)
Outputting started2024-08-19 08:30:30
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954_reco_stage1_reco_stage2_20240819T083020_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954_reco_stage1_reco_stage2_20240819T083020_keepup_hists.root
Finished2024-08-19 08:31:38
Saved logsjustin-logs:59577.156-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

n TPC 5
6295 hits in TPC 6
3424 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2357 XUs and 2736 XVs -> 387 XUVs
C:0 T:2 14545 XUs and 72348 XVs -> 653 XUVs
C:0 T:3 26 XUs and 57 XVs -> 1 XUVs
C:0 T:4 1205 XUs and 3657 XVs -> 220 XUVs
C:0 T:5 6855 XUs and 10172 XVs -> 457 XUVs
C:0 T:6 17784 XUs and 21712 XVs -> 1454 XUVs
C:0 T:7 1091 XUs and 931 XVs -> 21 XUVs
3193 XUVs total
1399 collection wire objects
3193 potential space points
Neighbour search...
81961 tests to find 47610 neighbours
Iterating with no regularization...
Begin: 1.79529e+07
0 1.66285e+07
1 1.65011e+07
2 1.64924e+07
Now with regularization...
Begin: 1.58906e+07
0 1.58875e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  2   event 393114 TrkackID 2 startx, y, z 61.7227 589.367 257.698  wireno, peakt tpcno 458 2131.13 5 dist 0min T, max_T2099.49 3740.5
no of hits closeby  2   event 393114 TrkackID 2 startx, y, z 61.7227 589.367 257.698  wireno, peakt tpcno 458 2131.13 5 dist 0min T, max_T2099.49 3740.5
19-Aug-2024 10:30:20 CEST  Closed output file "np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954_reco_stage1_reco_stage2_20240819T083020_keepup.root"
19-Aug-2024 10:30:20 CEST  Closed input file "np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              65.3524       123.824       198.585       119.904       28.4151        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000618545   0.00288101    0.00567484    0.00272704    0.00135355       30     
produce:fembfilter:PDHDFEMBFilter                      0.667089      0.699441      0.739938      0.697502      0.0215384       30     
produce:wclsdatahd:WireCellToolkit                      34.1301       36.8116       38.5727       36.7053       1.00908        30     
produce:gaushit:GausHitFinder                          0.400734      0.876246       1.26132      0.898562      0.182845        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000242427   0.000395824   0.000553552   0.00040063    6.95714e-05      30     
produce:reco3d:SpacePointSolver                        0.131411       1.63286       5.73499       1.29098       1.3724         30     
produce:hitpdune:DisambigFromSpacePoints                0.13849      0.636113       1.15487      0.586038      0.246811        30     
produce:pandora:StandardPandora                         5.42666       22.9605       51.4272       21.1421       10.9069        30     
produce:pandoraWriter:StandardPandora                  0.0952392     0.192847      0.272523      0.192894      0.0401401       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.558683       2.14759       4.90354       1.93864      0.930972        30     
produce:pandoraShower:LArPandoraShowerCreation         0.382278       2.5241        5.6201        2.35364       1.39999        30     
produce:pandoracalo:Calorimetry                        0.273711      0.959507       2.35451      0.852127      0.451647        30     
produce:pandoracalonosce:Calorimetry                   0.231972      0.882271       2.16858      0.801366      0.422993        30     
produce:pandorapid:Chi2ParticleID                     0.00150682    0.00226488     0.0033519    0.00219669    0.000428519      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.283198       2.05377       5.45399       1.86803       1.26447        30     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.27834       1.95729       5.10012       1.79753       1.18947        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0685332     0.165834      0.248183      0.173235      0.0421261       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0247986     0.0576923     0.0849493     0.0602758     0.0143063       30     
produce:emtrkmichelid:EmTrackMichelId                   21.3986       47.1271       71.8137       46.081        11.4996        30     
[art]:TriggerResults:TriggerResultInserter             2.65e-05     5.43847e-05   8.4088e-05    5.50635e-05   1.45624e-05      30     
end_path:out1:RootOutput                               8.106e-06    1.57757e-05   3.4385e-05    1.3841e-05    6.6117e-06       30     
end_path:michelremoving:michelremoving                 0.016273      0.079017      0.336584      0.0455535     0.071257        30     
end_path:michelremovinggnocchi:michelremoving          0.0139519     0.074371      0.324061      0.0392808     0.0706826       30     
end_path:calibanagnocchi:CalibAnaTree                  0.164932      0.709527       1.48848      0.656918      0.304561        30     
end_path:out1:RootOutput(write)                         0.49175       1.09414       1.56033       1.12675      0.240281        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4967.51 MB
  Peak resident set size usage (VmHWM): 2645.85 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954_reco_stage1_reco_stage2_20240819T083020_keepup.root
\tHists: np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954_reco_stage1_reco_stage2_20240819T083020_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954_reco_stage1_reco_stage2_20240819T083020_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954_reco_stage1_reco_stage2_20240819T083020_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724052461.0,
    "core.end_time": 1724056221.0,
    "core.events": [
      392826,
      392890,
      392898,
      392906,
      392914,
      392922,
      392930,
      392938,
      392946,
      392954,
      392962,
      392970,
      392978,
      392986,
      392994,
      393002,
      393010,
      393018,
      393026,
      393034,
      393042,
      393050,
      393058,
      393066,
      393074,
      393082,
      393090,
      393098,
      393106,
      393114
    ],
    "core.event_count": 30,
    "core.first_event_number": 392826,
    "core.last_event_number": 393114,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954_reco_stage1_reco_stage2_20240819T083020_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724052461.0,
    "core.end_time": 1724056221.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1637_dataflow2_datawriter_0_20240819T045954.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:04:01 UTC       justIN version: 01.01.09