justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79392.3@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79392.3@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3448
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 16:34:50
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-26 18:28:45
From worker nodeHostnamewn1908241.tier2.hep.manchester.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 16:36:05
Input fileshd-protodune:np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807.hdf5
JobscriptExit code0
Real time1h (6670s)
CPU time1h (6154s = 92%)
Outputting started2024-09-26 18:27:16
Output fileshd-protodune-det-reco:np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807_reco_stage1_reco_stage2_20240926T182703_keepup.root
hd-protodune-det-reco:np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807_reco_stage1_reco_stage2_20240926T182703_keepup_hists.root
Finished2024-09-26 18:28:45
Saved logsjustin-logs:79392.3-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 57069 traces, 57069 summary
Retagger: tagging trace set: gauss with 41263 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 41263 traces tagged "gauss"
FrameSaver: q=958664 n=769047 tag=gauss
wclsFrameSaver: saving 57069 traces tagged "wiener"
FrameSaver: q=1.03076e+06 n=691183 tag=wiener
1975 hits in TPC 0
3075 hits in TPC 1
3287 hits in TPC 2
2300 hits in TPC 3
4841 hits in TPC 4
5692 hits in TPC 5
4884 hits in TPC 6
3674 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 785 XUs and 1078 XVs -> 42 XUVs
C:0 T:2 8237 XUs and 7805 XVs -> 1048 XUVs
C:0 T:3 335 XUs and 672 XVs -> 3 XUVs
C:0 T:4 95 XUs and 81 XVs -> 12 XUVs
C:0 T:5 22056 XUs and 18342 XVs -> 394 XUVs
C:0 T:6 13639 XUs and 9148 XVs -> 707 XUVs
C:0 T:7 963 XUs and 696 XVs -> 17 XUVs
2223 XUVs total
1142 collection wire objects
2223 potential space points
Neighbour search...
45851 tests to find 27712 neighbours
Iterating with no regularization...
Begin: 7.84678e+06
0 7.51794e+06
1 7.48903e+06
2 7.48468e+06
Now with regularization...
Begin: 6.97003e+06
0 6.96893e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 19:27:03 BST  Closed output file "np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807_reco_stage1_reco_stage2_20240926T182703_keepup.root"
26-Sep-2024 19:27:03 BST  Closed input file "np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              104.626       155.596       234.042       153.445       29.8465        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000615511   0.00285764    0.00491661    0.00303812    0.00126937       30     
produce:fembfilter:PDHDFEMBFilter                      0.723036        1.077        1.54559       1.07271      0.130707        30     
produce:wclsdatahd:WireCellToolkit                      49.8125       68.4525       77.8716       68.9268       4.89282        30     
produce:gaushit:GausHitFinder                          0.643236       1.26099       2.06134       1.20738      0.300468        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000355021   0.000530375   0.000856742   0.000527094   0.000107695      30     
produce:reco3d:SpacePointSolver                        0.249009       1.56448       4.21449       1.28433       1.02398        30     
produce:hitpdune:DisambigFromSpacePoints               0.290164      0.985296       2.39182       0.86214      0.513701        30     
produce:pandora:StandardPandora                         5.46608       22.1243       54.1106       20.8382       10.1636        30     
produce:pandoraWriter:StandardPandora                  0.139652      0.249963      0.373666      0.249015      0.0626797       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.910001       3.22644       6.4877        2.84375       1.50617        30     
produce:pandoraShower:LArPandoraShowerCreation         0.840001       3.43264       7.93853       3.07943       1.85446        30     
produce:pandoracalo:Calorimetry                        0.444174       1.4072        2.62154       1.24085      0.568989        30     
produce:pandoracalonosce:Calorimetry                   0.409563       1.27781       2.39854       1.1503       0.517006        30     
produce:pandorapid:Chi2ParticleID                     0.00161346    0.00296833    0.00507588    0.00295098    0.000700707      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.715915       2.82787       6.02132       2.69416       1.35207        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.645718       2.77124       5.86104       2.6449        1.33562        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.119976      0.227703      0.350473      0.228178      0.0644034       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0463944     0.0900099      0.16962      0.0894348     0.0270205       30     
produce:emtrkmichelid:EmTrackMichelId                   23.7953       41.8303       62.1364       40.5163       9.20565        30     
[art]:TriggerResults:TriggerResultInserter            5.4718e-05     7.656e-05    0.000269112   6.9392e-05    3.65994e-05      30     
end_path:out1:RootOutput                              1.2366e-05    1.67076e-05   5.0763e-05    1.5591e-05    6.57427e-06      30     
end_path:michelremoving:michelremoving                 0.0380467     0.162038      0.658562      0.0757415     0.150153        30     
end_path:michelremovinggnocchi:michelremoving          0.0324096     0.153498      0.644792      0.0687161     0.148457        30     
end_path:calibanagnocchi:CalibAnaTree                  0.351378      0.989302       1.98981      0.841628      0.425389        30     
end_path:out1:RootOutput(write)                        0.721253       1.29899       1.98881       1.27943      0.309409        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4937.79 MB
  Peak resident set size usage (VmHWM): 2610.43 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807_reco_stage1_reco_stage2_20240926T182703_keepup.root
\tHists: np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807_reco_stage1_reco_stage2_20240926T182703_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807_reco_stage1_reco_stage2_20240926T182703_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807_reco_stage1_reco_stage2_20240926T182703_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727370488.0,
    "core.end_time": 1727375225.0,
    "core.events": [
      1948,
      1956,
      1964,
      1972,
      1980,
      1988,
      1996,
      2004,
      2012,
      2020,
      2028,
      2036,
      2044,
      2052,
      2060,
      2068,
      2076,
      2084,
      2092,
      2100,
      2108,
      2116,
      2124,
      2132,
      2140,
      2148,
      2156,
      2164,
      2172,
      2180
    ],
    "core.event_count": 30,
    "core.first_event_number": 1948,
    "core.last_event_number": 2180,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807_reco_stage1_reco_stage2_20240926T182703_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727370488.0,
    "core.end_time": 1727375225.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_0008_dataflow4_datawriter_0_20240906T163807.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:27:24 UTC       justIN version: 01.01.09