justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261832.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID261832.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3392
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-25 03:36:12
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce14-multicore
Last heartbeat2024-09-25 06:04:35
From worker nodeHostnametds412.pic.es
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-25 04:15:15
Input fileshd-protodune:np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239.hdf5
JobscriptExit code0
Real time1h (5981s)
CPU time1h (3846s = 64%)
Outputting started2024-09-25 05:54:57
Output fileshd-protodune-det-reco:np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239_reco_stage1_reco_stage2_20240925T055446_keepup.root
hd-protodune-det-reco:np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239_reco_stage1_reco_stage2_20240925T055446_keepup_hists.root
Finished2024-09-25 06:04:35
Saved logsjustin-logs:261832.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

incidences...
C:0 T:1 6241 XUs and 4011 XVs -> 228 XUVs
C:0 T:2 3445 XUs and 3863 XVs -> 172 XUVs
C:0 T:3 82 XUs and 84 XVs -> 0 XUVs
C:0 T:4 771 XUs and 1089 XVs -> 29 XUVs
C:0 T:5 23007 XUs and 32315 XVs -> 1660 XUVs
C:0 T:6 13658 XUs and 18568 XVs -> 606 XUVs
C:0 T:7 205 XUs and 272 XVs -> 9 XUVs
2704 XUVs total
1033 collection wire objects
2704 potential space points
Neighbour search...
242520 tests to find 119876 neighbours
Iterating with no regularization...
Begin: 9.57424e+06
0 8.8953e+06
1 8.85256e+06
2 8.84919e+06
Now with regularization...
Begin: 8.45165e+06
0 8.45042e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  2   event 5459 TrkackID 8 startx, y, z 16.7591 596.036 80.8013  wireno, peakt tpcno 208 2370.53 2 dist 346.467min T, max_T6.31404 2401.35
no of hits closeby  3   event 5459 TrkackID 9 startx, y, z -16.3261 286.044 438.399  wireno, peakt tpcno 38 1375.39 6 dist 0min T, max_T1375.39 2092.04
no of hits closeby  2   event 5459 TrkackID 8 startx, y, z 16.7591 596.036 80.8013  wireno, peakt tpcno 208 2370.53 2 dist 346.467min T, max_T6.31404 2401.35
no of hits closeby  3   event 5459 TrkackID 9 startx, y, z -16.3261 286.044 438.399  wireno, peakt tpcno 38 1375.39 6 dist 0min T, max_T1375.39 2092.04
25-Sep-2024 07:54:46 CEST  Closed output file "np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239_reco_stage1_reco_stage2_20240925T055446_keepup.root"
25-Sep-2024 07:54:46 CEST  Closed input file "np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              66.4791       93.0019       131.949       87.4824       17.3136        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000601207   0.00282694    0.00507404    0.00283858    0.00107345       30     
produce:fembfilter:PDHDFEMBFilter                       0.59425      0.774501      0.872669      0.829641      0.0977222       30     
produce:wclsdatahd:WireCellToolkit                      35.8288       42.0457       46.8672       41.942        2.77964        30     
produce:gaushit:GausHitFinder                          0.436279      0.842256       1.31957      0.841124      0.249555        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000287333   0.000433102   0.00115507    0.000415275    0.0001543       30     
produce:reco3d:SpacePointSolver                        0.115499       0.69262       1.80206      0.627436       0.39732        30     
produce:hitpdune:DisambigFromSpacePoints               0.144305      0.499588       1.21902      0.433341       0.25192        30     
produce:pandora:StandardPandora                         4.9032        12.1593       22.6204       11.2669       4.9208         30     
produce:pandoraWriter:StandardPandora                  0.115701      0.193464      0.296544      0.180214      0.0530581       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.449042       1.20966       2.70189       1.07448       0.58679        30     
produce:pandoraShower:LArPandoraShowerCreation         0.446463       1.35589       2.96455      0.992879      0.792698        30     
produce:pandoracalo:Calorimetry                        0.269685      0.622147       1.1507       0.537492      0.239478        30     
produce:pandoracalonosce:Calorimetry                   0.236128      0.545873       1.14546      0.470405      0.224758        30     
produce:pandorapid:Chi2ParticleID                     0.00140791    0.00220871    0.00581986    0.00211386    0.000786296      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.397581       1.17776       2.60064      0.913462      0.682979        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.418126       1.11377       2.49105       0.94081      0.608618        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0717793      0.15505      0.258851      0.150093      0.0489853       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0294437     0.0525168     0.0834294     0.0517338     0.0146556       30     
produce:emtrkmichelid:EmTrackMichelId                   18.6793       27.9065       49.5721       25.8917       7.13202        30     
[art]:TriggerResults:TriggerResultInserter             2.571e-05    5.06237e-05   0.000165692   4.2371e-05    2.67696e-05      30     
end_path:out1:RootOutput                               8.33e-06      1.333e-05    3.2851e-05    1.07355e-05   5.95674e-06      30     
end_path:michelremoving:michelremoving                 0.0168901     0.0686272     0.259055      0.0319424     0.0689058       30     
end_path:michelremovinggnocchi:michelremoving          0.0153827     0.0654653     0.254802      0.0314535     0.0683808       30     
end_path:calibanagnocchi:CalibAnaTree                  0.205916      0.452425      0.812671      0.417662      0.147385        30     
end_path:out1:RootOutput(write)                        0.626859      0.907049       1.47428      0.860213      0.200293        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4937.9 MB
  Peak resident set size usage (VmHWM): 2596.61 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239_reco_stage1_reco_stage2_20240925T055446_keepup.root
\tHists: np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239_reco_stage1_reco_stage2_20240925T055446_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239_reco_stage1_reco_stage2_20240925T055446_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239_reco_stage1_reco_stage2_20240925T055446_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727240839.0,
    "core.end_time": 1727243686.0,
    "core.events": [
      5401,
      5403,
      5405,
      5407,
      5409,
      5411,
      5413,
      5415,
      5417,
      5419,
      5421,
      5423,
      5425,
      5427,
      5429,
      5431,
      5433,
      5435,
      5437,
      5439,
      5441,
      5443,
      5445,
      5447,
      5449,
      5451,
      5453,
      5455,
      5457,
      5459
    ],
    "core.event_count": 30,
    "core.first_event_number": 5401,
    "core.last_event_number": 5459,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29045
    ],
    "core.runs_subruns": [
      2904500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239_reco_stage1_reco_stage2_20240925T055446_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727240839.0,
    "core.end_time": 1727243686.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29045
    ],
    "core.runs_subruns": [
      2904500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029045_0090_dataflow1_datawriter_0_20240902T161239.hdf5"
    }
  ]
}
justIN time: 2024-11-17 07:52:32 UTC       justIN version: 01.01.09