justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266082.8@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266082.8@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-28 22:17:53
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2024-09-28 23:38:19
From worker nodeHostnamenode1G23.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5218 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-28 22:19:43
Input fileshd-protodune:np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224.hdf5
JobscriptExit code0
Real time1h (4649s)
CPU time1h (4046s = 87%)
Outputting started2024-09-28 23:37:14
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224_reco_stage1_reco_stage2_20240928T233704_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224_reco_stage1_reco_stage2_20240928T233704_keepup_hists.root
Finished2024-09-28 23:38:19
Saved logsjustin-logs:266082.8-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ary
Retagger: tagging trace set: gauss with 60003 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60003 traces tagged "gauss"
FrameSaver: q=1.30122e+06 n=1147914 tag=gauss
wclsFrameSaver: saving 78703 traces tagged "wiener"
FrameSaver: q=1.40452e+06 n=1055767 tag=wiener
3043 hits in TPC 0
4836 hits in TPC 1
8881 hits in TPC 2
4356 hits in TPC 3
4693 hits in TPC 4
8147 hits in TPC 5
4681 hits in TPC 6
3223 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7159 XUs and 6161 XVs -> 529 XUVs
C:0 T:2 33545 XUs and 31801 XVs -> 708 XUVs
C:0 T:3 201 XUs and 165 XVs -> 7 XUVs
C:0 T:4 293 XUs and 438 XVs -> 3 XUVs
C:0 T:5 20435 XUs and 29652 XVs -> 1490 XUVs
C:0 T:6 11284 XUs and 17539 XVs -> 515 XUVs
C:0 T:7 57 XUs and 83 XVs -> 1 XUVs
3253 XUVs total
1531 collection wire objects
3253 potential space points
Neighbour search...
98055 tests to find 59538 neighbours
Iterating with no regularization...
Begin: 1.29376e+07
0 1.19742e+07
1 1.17956e+07
2 1.17828e+07
3 1.17801e+07
Now with regularization...
Begin: 1.11593e+07
0 1.11564e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

29-Sep-2024 00:37:04 BST  Closed output file "np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224_reco_stage1_reco_stage2_20240928T233704_keepup.root"
29-Sep-2024 00:37:04 BST  Closed input file "np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              60.1987       81.8292       105.847       80.4763       12.7298        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000323264   0.00125949    0.00431275    0.000877159   0.000974681      39     
produce:fembfilter:PDHDFEMBFilter                      0.614106      0.628645       0.66072      0.628273     0.00811344       39     
produce:wclsdatahd:WireCellToolkit                      40.3106       41.2163       42.4171       41.1993      0.514598        39     
produce:gaushit:GausHitFinder                          0.392187      0.648215       0.96491      0.626309      0.146176        39     
produce:nhitsfilter:NumberOfHitsFilter                 0.000264     0.000387429   0.000523111   0.000381377   6.63464e-05      39     
produce:reco3d:SpacePointSolver                        0.112423      0.680681       2.43152       0.46147      0.542668        39     
produce:hitpdune:DisambigFromSpacePoints               0.141167      0.445117      0.999891      0.455281      0.185227        39     
produce:pandora:StandardPandora                         4.18242       10.4771       19.4292       10.1743       4.30209        39     
produce:pandoraWriter:StandardPandora                  0.0804759     0.142664      0.210859      0.139369      0.0337258       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.343057       1.50476       2.63305       1.45308      0.635443        39     
produce:pandoraShower:LArPandoraShowerCreation         0.466075       1.72078       3.9406        1.52249      0.856876        39     
produce:pandoracalo:Calorimetry                        0.183225      0.655466       1.12432      0.668707      0.240699        39     
produce:pandoracalonosce:Calorimetry                   0.168034      0.603123       1.02355      0.586579      0.220301        39     
produce:pandorapid:Chi2ParticleID                     0.000835238   0.00159261     0.0025422     0.0015534    0.000305624      39     
produce:pandoraShowercalo:ShowerCalorimetry             0.3886        1.51745       3.43841       1.36762      0.737874        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.383564       1.50721       3.43416       1.33373      0.731804        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0519734     0.110421       0.16759      0.106387      0.0262619       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0211564     0.0434963     0.0682826     0.0420536     0.0104157       39     
produce:emtrkmichelid:EmTrackMichelId                   10.7989       18.4373       26.1265       18.4287       4.1828         39     
[art]:TriggerResults:TriggerResultInserter            2.2622e-05    3.39786e-05   6.5832e-05    3.2413e-05    7.41988e-06      39     
end_path:out1:RootOutput                               7.074e-06    8.94874e-06   1.8561e-05     8.729e-06    1.8178e-06       39     
end_path:michelremoving:michelremoving                 0.0199599     0.0738627      0.27471      0.0431727     0.0670262       39     
end_path:michelremovinggnocchi:michelremoving          0.0180622     0.0705241     0.268181      0.039927      0.0648843       39     
end_path:calibanagnocchi:CalibAnaTree                  0.162622       0.4981       0.831256      0.506631      0.186936        39     
end_path:out1:RootOutput(write)                        0.368393      0.669448      0.976166      0.659638      0.147167        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5752.12 MB
  Peak resident set size usage (VmHWM): 2824.77 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224_reco_stage1_reco_stage2_20240928T233704_keepup.root
\tHists: np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224_reco_stage1_reco_stage2_20240928T233704_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224_reco_stage1_reco_stage2_20240928T233704_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224_reco_stage1_reco_stage2_20240928T233704_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727563400.0,
    "core.end_time": 1727566625.0,
    "core.events": [
      1561,
      1563,
      1565,
      1567,
      1569,
      1571,
      1573,
      1575,
      1577,
      1579,
      1581,
      1583,
      1585,
      1587,
      1589,
      1591,
      1593,
      1595,
      1597,
      1599,
      1601,
      1603,
      1605,
      1607,
      1609,
      1611,
      1613,
      1615,
      1617,
      1619,
      1621,
      1623,
      1625,
      1627,
      1629,
      1631,
      1633,
      1635,
      1637
    ],
    "core.event_count": 39,
    "core.first_event_number": 1561,
    "core.last_event_number": 1637,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224_reco_stage1_reco_stage2_20240928T233704_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727563400.0,
    "core.end_time": 1727566625.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0020_dataflow1_datawriter_0_20240928T215224.hdf5"
    }
  ]
}
justIN time: 2024-11-17 03:11:07 UTC       justIN version: 01.01.09