justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 77005.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID77005.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3392
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-25 03:20:25
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce510
Last heartbeat2024-09-25 05:57:10
From worker nodeHostnameb9p07p4372.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-25 04:38:02
Input fileshd-protodune:np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833.hdf5
JobscriptExit code0
Real time1h (4110s)
CPU time1h (3946s = 96%)
Outputting started2024-09-25 05:46:33
Output fileshd-protodune-det-reco:np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833_reco_stage1_reco_stage2_20240925T054619_keepup.root
hd-protodune-det-reco:np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833_reco_stage1_reco_stage2_20240925T054619_keepup_hists.root
Finished2024-09-25 05:57:10
Saved logsjustin-logs:77005.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 286 XUs and 741 XVs -> 5 XUVs
C:0 T:2 54834 XUs and 61710 XVs -> 4475 XUVs
C:0 T:3 127 XUs and 254 XVs -> 8 XUVs
C:0 T:4 210 XUs and 382 XVs -> 11 XUVs
C:0 T:5 35098 XUs and 86344 XVs -> 5795 XUVs
C:0 T:6 39290 XUs and 31232 XVs -> 660 XUVs
C:0 T:7 18 XUs and 21 XVs -> 0 XUVs
10954 XUVs total
2465 collection wire objects
10954 potential space points
Neighbour search...
1246998 tests to find 556978 neighbours
Iterating with no regularization...
Begin: 1.04793e+07
0 7.52587e+06
1 7.26783e+06
2 7.21695e+06
3 7.2004e+06
4 7.19273e+06
5 7.18859e+06
Now with regularization...
Begin: 6.52803e+06
0 6.52267e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  16   event 910807 TrkackID 5 startx, y, z 43.5112 593.576 398.532  wireno, peakt tpcno 43 673.225 5 dist 54.0123min T, max_T6.20445 2937.5
no of hits closeby  16   event 910807 TrkackID 5 startx, y, z 43.5112 593.576 398.532  wireno, peakt tpcno 43 673.225 5 dist 54.0123min T, max_T6.20445 2937.5
25-Sep-2024 07:46:19 CEST  Closed output file "np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833_reco_stage1_reco_stage2_20240925T054619_keepup.root"
25-Sep-2024 07:46:19 CEST  Closed input file "np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              72.1944        104.2        147.434       104.606       16.8723        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00038495    0.00204714    0.00402388     0.0019678    0.000888667      30     
produce:fembfilter:PDHDFEMBFilter                      0.546183      0.734295      0.876587       0.79086      0.117591        30     
produce:wclsdatahd:WireCellToolkit                      38.0428       42.7705       48.3854       42.4368       2.77613        30     
produce:gaushit:GausHitFinder                          0.402611      0.732607       1.34043      0.743846      0.236641        30     
produce:nhitsfilter:NumberOfHitsFilter                 0.0002064    0.000360625   0.000668734   0.00036661    9.27688e-05      30     
produce:reco3d:SpacePointSolver                        0.183098       1.08935       2.90255      0.946289      0.644665        30     
produce:hitpdune:DisambigFromSpacePoints               0.253284      0.736021       1.66964      0.667565      0.325365        30     
produce:pandora:StandardPandora                         4.6534        12.6561       23.3576       11.6564       4.54401        30     
produce:pandoraWriter:StandardPandora                  0.0731626     0.140886       0.26493      0.134318      0.0442734       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.567747       1.24111        2.623        1.2053       0.477917        30     
produce:pandoraShower:LArPandoraShowerCreation         0.578137       1.52325       4.18543       1.42464      0.705266        30     
produce:pandoracalo:Calorimetry                        0.320245      0.710062       1.56162      0.711211       0.25451        30     
produce:pandoracalonosce:Calorimetry                   0.302433      0.633264       1.40437      0.605298      0.240104        30     
produce:pandorapid:Chi2ParticleID                     0.00110313    0.00205824    0.00406101    0.00192734    0.000712386      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.559612       1.49885       4.29911       1.37646      0.736856        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.576523       1.46904       4.20077       1.3862       0.722452        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0801951     0.165234      0.297284      0.180485      0.0547657       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0281172     0.0543351     0.0880945     0.0550378     0.0170337       30     
produce:emtrkmichelid:EmTrackMichelId                   23.7354       36.2345       58.0204       35.3977       7.62187        30     
[art]:TriggerResults:TriggerResultInserter             2.167e-05    3.9865e-05    0.00012314    3.41705e-05   2.04947e-05      30     
end_path:out1:RootOutput                                9.5e-06     1.31414e-05    3.816e-05     1.173e-05    4.99111e-06      30     
end_path:michelremoving:michelremoving                 0.0199507     0.114972      0.355603      0.0459656     0.101694        30     
end_path:michelremovinggnocchi:michelremoving          0.0194061     0.108641      0.360559      0.0372723     0.0990714       30     
end_path:calibanagnocchi:CalibAnaTree                  0.275561       0.56048       1.27137      0.526763      0.214565        30     
end_path:out1:RootOutput(write)                        0.549809      0.913492       1.54653      0.930013       0.22887        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4960.6 MB
  Peak resident set size usage (VmHWM): 2595.63 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833_reco_stage1_reco_stage2_20240925T054619_keepup.root
\tHists: np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833_reco_stage1_reco_stage2_20240925T054619_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833_reco_stage1_reco_stage2_20240925T054619_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833_reco_stage1_reco_stage2_20240925T054619_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727240012.0,
    "core.end_time": 1727243180.0,
    "core.events": [
      910535,
      910575,
      910583,
      910591,
      910599,
      910607,
      910615,
      910623,
      910631,
      910639,
      910647,
      910655,
      910663,
      910671,
      910679,
      910687,
      910695,
      910703,
      910711,
      910719,
      910727,
      910735,
      910743,
      910751,
      910759,
      910767,
      910775,
      910783,
      910799,
      910807
    ],
    "core.event_count": 30,
    "core.first_event_number": 910535,
    "core.last_event_number": 910807,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833_reco_stage1_reco_stage2_20240925T054619_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727240012.0,
    "core.end_time": 1727243180.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_3794_dataflow7_datawriter_0_20240902T052833.hdf5"
    }
  ]
}
justIN time: 2024-11-17 07:35:30 UTC       justIN version: 01.01.09