justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266104.1@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266104.1@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3517
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 00:23:54
SiteUS_UConn-HPC
EntryGLUEX_US_UConn-HPC_osgce
Last heartbeat2024-09-29 01:43:46
From worker nodeHostnamecn421
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 00:25:18
Input fileshd-protodune:np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026.hdf5
JobscriptExit code0
Real time1h (4593s)
CPU time1h (4060s = 88%)
Outputting started2024-09-29 01:41:52
Output fileshd-protodune-det-reco:np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026_reco_stage1_reco_stage2_20240929T014121_keepup.root
hd-protodune-det-reco:np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026_reco_stage1_reco_stage2_20240929T014121_keepup_hists.root
Finished2024-09-29 01:43:46
Saved logsjustin-logs:266104.1-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

agging trace set: gauss with 52124 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 52124 traces tagged "gauss"
FrameSaver: q=1.87181e+06 n=944143 tag=gauss
wclsFrameSaver: saving 69791 traces tagged "wiener"
FrameSaver: q=2.01263e+06 n=845889 tag=wiener
1525 hits in TPC 0
1691 hits in TPC 1
7844 hits in TPC 2
3741 hits in TPC 3
5980 hits in TPC 4
6900 hits in TPC 5
8737 hits in TPC 6
3522 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3318 XUs and 1957 XVs -> 187 XUVs
C:0 T:2 43374 XUs and 64873 XVs -> 1670 XUVs
C:0 T:3 261 XUs and 310 XVs -> 2 XUVs
C:0 T:4 222 XUs and 233 XVs -> 18 XUVs
C:0 T:5 23555 XUs and 19878 XVs -> 726 XUVs
C:0 T:6 43645 XUs and 41123 XVs -> 1260 XUVs
C:0 T:7 789 XUs and 647 XVs -> 44 XUVs
3907 XUVs total
1842 collection wire objects
3907 potential space points
Neighbour search...
125359 tests to find 65490 neighbours
Iterating with no regularization...
Begin: 3.22718e+07
0 2.99672e+07
1 2.98152e+07
2 2.97975e+07
Now with regularization...
Begin: 2.8307e+07
0 2.83002e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

28-Sep-2024 21:41:21 EDT  Closed output file "np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026_reco_stage1_reco_stage2_20240929T014121_keepup.root"
28-Sep-2024 21:41:21 EDT  Closed input file "np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              61.6209       93.4356       188.205       89.6696       26.2075        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000563625   0.00307091    0.00504237    0.00361507    0.00143824       35     
produce:fembfilter:PDHDFEMBFilter                      0.562234      0.638342      0.779852      0.620629      0.0725751       35     
produce:wclsdatahd:WireCellToolkit                      29.2457       34.0705       47.8744       33.6174       4.63662        35     
produce:gaushit:GausHitFinder                          0.436351      0.658226       1.16216      0.634811      0.140001        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000310899   0.000493177   0.000983389   0.00045485    0.000133412      35     
produce:reco3d:SpacePointSolver                        0.189846       1.15577       3.87158       0.87263       0.80944        35     
produce:hitpdune:DisambigFromSpacePoints               0.203679      0.529551       1.35746      0.487659      0.233556        35     
produce:pandora:StandardPandora                         7.46159       16.634        50.6698       15.2505       7.87886        35     
produce:pandoraWriter:StandardPandora                  0.115059      0.173533      0.324065      0.171342      0.0387743       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.904015       2.30536       4.82597       2.14198      0.957137        35     
produce:pandoraShower:LArPandoraShowerCreation         0.599514       2.97048       8.34593       2.52527       1.82612        35     
produce:pandoracalo:Calorimetry                        0.396306       1.04652       2.42549      0.987578      0.523264        35     
produce:pandoracalonosce:Calorimetry                   0.327865      0.988152       2.89022      0.827559      0.540844        35     
produce:pandorapid:Chi2ParticleID                     0.00140255    0.00213812    0.00425401    0.00192847    0.000644686      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.568338       2.37269       7.36548       2.09047       1.54635        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.495048       2.17549       7.11567       1.91118       1.41388        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0802612     0.133362      0.299725      0.121906      0.0470573       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0290568     0.0465288     0.0919229     0.0426728     0.0144554       35     
produce:emtrkmichelid:EmTrackMichelId                   15.9479       25.6945       52.3737       24.3565       8.09159        35     
[art]:TriggerResults:TriggerResultInserter            2.9546e-05    5.3398e-05    0.000115207   5.1337e-05    1.45847e-05      35     
end_path:out1:RootOutput                               9.919e-06    2.0132e-05    4.4093e-05    2.0258e-05    6.8036e-06       35     
end_path:michelremoving:michelremoving                 0.0181856     0.0612176     0.184971      0.0401086     0.0472718       35     
end_path:michelremovinggnocchi:michelremoving          0.0168162     0.0590511     0.184887      0.0416404     0.0459751       35     
end_path:calibanagnocchi:CalibAnaTree                  0.249727      0.699605       1.37809      0.682185      0.277118        35     
end_path:out1:RootOutput(write)                        0.479328      0.785866       1.27843      0.738558      0.197331        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4963.68 MB
  Peak resident set size usage (VmHWM): 2622.35 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026_reco_stage1_reco_stage2_20240929T014121_keepup.root
\tHists: np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026_reco_stage1_reco_stage2_20240929T014121_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026_reco_stage1_reco_stage2_20240929T014121_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026_reco_stage1_reco_stage2_20240929T014121_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727570751.0,
    "core.end_time": 1727574081.0,
    "core.events": [
      102902,
      102906,
      102910,
      102914,
      102918,
      102922,
      102926,
      102930,
      102934,
      102938,
      102942,
      102946,
      102950,
      102954,
      102958,
      102962,
      102966,
      102970,
      102974,
      102978,
      102982,
      102986,
      102990,
      102994,
      102998,
      103002,
      103006,
      103010,
      103014,
      103018,
      103022,
      103026,
      103030,
      103034,
      103038
    ],
    "core.event_count": 35,
    "core.first_event_number": 102902,
    "core.last_event_number": 103038,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27394
    ],
    "core.runs_subruns": [
      2739400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026_reco_stage1_reco_stage2_20240929T014121_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727570751.0,
    "core.end_time": 1727574081.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27394
    ],
    "core.runs_subruns": [
      2739400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027394_0735_dataflow2_datawriter_0_20240623T224026.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:37:06 UTC       justIN version: 01.01.08