justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264786.57@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264786.57@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3512
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 08:05:13
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2024-09-27 12:42:06
From worker nodeHostnamedunegli-35088-0-cmswn2324.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 09:19:42
Input fileshd-protodune:np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126.hdf5
JobscriptExit code0
Real time3h (12094s)
CPU time1h (5385s = 44%)
Outputting started2024-09-27 12:41:17
Output fileshd-protodune-det-reco:np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126_reco_stage1_reco_stage2_20240927T124108_keepup.root
hd-protodune-det-reco:np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126_reco_stage1_reco_stage2_20240927T124108_keepup_hists.root
Finished2024-09-27 12:42:06
Saved logsjustin-logs:264786.57-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ging trace set: wiener with 50289 traces, 50289 summary
Retagger: tagging trace set: gauss with 37908 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 37908 traces tagged "gauss"
FrameSaver: q=1.52812e+06 n=726552 tag=gauss
wclsFrameSaver: saving 50289 traces tagged "wiener"
FrameSaver: q=1.63182e+06 n=660157 tag=wiener
2808 hits in TPC 0
4161 hits in TPC 1
4407 hits in TPC 2
2962 hits in TPC 3
3354 hits in TPC 4
6128 hits in TPC 5
4054 hits in TPC 6
2146 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1737 XUs and 2249 XVs -> 407 XUVs
C:0 T:2 10949 XUs and 7028 XVs -> 302 XUVs
C:0 T:3 89 XUs and 66 XVs -> 2 XUVs
C:0 T:4 193 XUs and 196 XVs -> 9 XUVs
C:0 T:5 10792 XUs and 12644 XVs -> 834 XUVs
C:0 T:6 13465 XUs and 40631 XVs -> 2712 XUVs
C:0 T:7 70 XUs and 58 XVs -> 0 XUVs
4266 XUVs total
1014 collection wire objects
4266 potential space points
Neighbour search...
321098 tests to find 183098 neighbours
Iterating with no regularization...
Begin: 2.76106e+07
0 2.5292e+07
1 2.51144e+07
2 2.50857e+07
3 2.50759e+07
Now with regularization...
Begin: 2.32606e+07
0 2.32439e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 12:41:08 UTC  Closed output file "np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126_reco_stage1_reco_stage2_20240927T124108_keepup.root"
27-Sep-2024 12:41:08 UTC  Closed input file "np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              76.9399       124.77        265.386       111.461       35.7926        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000620278   0.00409422     0.0619827    0.00216952    0.00999588       35     
produce:fembfilter:PDHDFEMBFilter                      0.972064       1.15853       1.82935       1.07289       0.20146        35     
produce:wclsdatahd:WireCellToolkit                      46.2982       57.8161       69.3317       60.1332       7.61227        35     
produce:gaushit:GausHitFinder                          0.511981      0.886142       1.40461      0.841288      0.225561        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000211118   0.000443867   0.00168156    0.000400479   0.000235371      35     
produce:reco3d:SpacePointSolver                        0.205446      0.889778       5.05278       0.63819      0.867842        35     
produce:hitpdune:DisambigFromSpacePoints               0.233597      0.727147       2.2536       0.534873      0.481213        35     
produce:pandora:StandardPandora                         5.86005       21.4406       136.568       16.3994       21.5359        35     
produce:pandoraWriter:StandardPandora                  0.096455      0.186569       0.87365      0.162721      0.125245        35     
produce:pandoraTrack:LArPandoraTrackCreation           0.663234       2.17711       6.39886       1.84713       1.29521        35     
produce:pandoraShower:LArPandoraShowerCreation         0.817898       2.55371       7.34801       1.83128       1.76458        35     
produce:pandoracalo:Calorimetry                        0.395212      0.983869       2.39718      0.858935      0.497969        35     
produce:pandoracalonosce:Calorimetry                   0.348871      0.910252       2.20297      0.844467      0.461824        35     
produce:pandorapid:Chi2ParticleID                     0.00125853    0.00221212    0.00417286    0.00205527    0.000644136      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.712122       2.06943       5.16756       1.77959       1.1797         35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.687526       1.98446       4.77764       1.77778       1.10147        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0945128     0.142833      0.211269      0.140619      0.0365683       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.031267      0.0484743     0.0717268     0.0460041     0.0123901       35     
produce:emtrkmichelid:EmTrackMichelId                   15.3613       28.9425       49.4935       26.7358       7.55949        35     
[art]:TriggerResults:TriggerResultInserter            2.2114e-05    4.17222e-05   9.8921e-05    4.0849e-05    1.4405e-05       35     
end_path:out1:RootOutput                               6.879e-06    9.39223e-06   3.0546e-05     8.512e-06    3.98753e-06      35     
end_path:michelremoving:michelremoving                 0.0203299     0.0883414     0.346624      0.0438845     0.0899472       35     
end_path:michelremovinggnocchi:michelremoving          0.0195583     0.0813064     0.340066      0.0374905     0.0876335       35     
end_path:calibanagnocchi:CalibAnaTree                  0.230471      0.715703       1.72969      0.666323      0.369012        35     
end_path:out1:RootOutput(write)                        0.484248      0.837103       1.32302       0.78367       0.22532        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4962.78 MB
  Peak resident set size usage (VmHWM): 2615.23 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126_reco_stage1_reco_stage2_20240927T124108_keepup.root
\tHists: np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126_reco_stage1_reco_stage2_20240927T124108_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126_reco_stage1_reco_stage2_20240927T124108_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126_reco_stage1_reco_stage2_20240927T124108_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727436454.0,
    "core.end_time": 1727440869.0,
    "core.events": [
      3083,
      3087,
      3091,
      3095,
      3099,
      3103,
      3107,
      3111,
      3115,
      3119,
      3123,
      3127,
      3131,
      3135,
      3139,
      3143,
      3147,
      3151,
      3155,
      3159,
      3163,
      3167,
      3171,
      3175,
      3179,
      3183,
      3187,
      3191,
      3195,
      3199,
      3203,
      3207,
      3211,
      3215,
      3219
    ],
    "core.event_count": 35,
    "core.first_event_number": 3083,
    "core.last_event_number": 3219,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27342
    ],
    "core.runs_subruns": [
      2734200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126_reco_stage1_reco_stage2_20240927T124108_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727436454.0,
    "core.end_time": 1727440869.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27342
    ],
    "core.runs_subruns": [
      2734200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027342_0022_dataflow3_datawriter_0_20240621T133126.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:24:59 UTC       justIN version: 01.01.08