justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79989.47@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79989.47@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3518
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 08:41:25
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2024-09-27 16:08:05
From worker nodeHostnamedunegli-35088-0-cmswn2324.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 14:06:42
Input fileshd-protodune:np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030.hdf5
JobscriptExit code0
Real time1h (5989s)
CPU time1h (4716s = 78%)
Outputting started2024-09-27 15:46:33
Output fileshd-protodune-det-reco:np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030_reco_stage1_reco_stage2_20240927T154624_keepup.root
hd-protodune-det-reco:np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030_reco_stage1_reco_stage2_20240927T154624_keepup_hists.root
Finished2024-09-27 16:08:05
Saved logsjustin-logs:79989.47-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

2e+06 n=713875 tag=wiener
5707 hits in TPC 0
3975 hits in TPC 1
3412 hits in TPC 2
2406 hits in TPC 3
2306 hits in TPC 4
3926 hits in TPC 5
7360 hits in TPC 6
4068 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 5357 XUs and 5049 XVs -> 138 XUVs
C:0 T:2 8195 XUs and 7120 XVs -> 192 XUVs
C:0 T:3 98 XUs and 102 XVs -> 16 XUVs
C:0 T:4 35 XUs and 35 XVs -> 0 XUVs
C:0 T:5 7211 XUs and 13726 XVs -> 1083 XUVs
C:0 T:6 33866 XUs and 28863 XVs -> 679 XUVs
C:0 T:7 817 XUs and 848 XVs -> 16 XUVs
2124 XUVs total
954 collection wire objects
2124 potential space points
Neighbour search...
89882 tests to find 57782 neighbours
Iterating with no regularization...
Begin: 1.03575e+07
0 9.52297e+06
1 9.46454e+06
2 9.45527e+06
Now with regularization...
Begin: 8.63693e+06
0 8.63255e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 18059 TrkackID 9 startx, y, z 365.421 526.08 197.788  wireno, peakt tpcno 241 5854.85 6 dist 1.10399min T, max_T5032 5855.17
no of hits closeby  0   event 18059 TrkackID 9 startx, y, z 365.421 526.08 197.788  wireno, peakt tpcno 241 5854.85 6 dist 1.10399min T, max_T5032 5855.17
27-Sep-2024 15:46:24 UTC  Closed output file "np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030_reco_stage1_reco_stage2_20240927T154624_keepup.root"
27-Sep-2024 15:46:24 UTC  Closed input file "np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              75.8372       105.471       150.667       99.6787       19.1148        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000428021   0.00166813    0.00322284    0.00156308    0.000850329      35     
produce:fembfilter:PDHDFEMBFilter                      0.673536      0.720101      0.780118      0.723242      0.0269212       35     
produce:wclsdatahd:WireCellToolkit                      42.1495       44.6613       50.2086       44.3747       1.6621         35     
produce:gaushit:GausHitFinder                          0.575486      0.929206       1.53188      0.895927      0.218128        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000188481   0.000316435   0.000608215   0.000291929   9.63411e-05      35     
produce:reco3d:SpacePointSolver                        0.230026      0.768037       1.94754      0.661652      0.392601        35     
produce:hitpdune:DisambigFromSpacePoints                0.28195      0.762163       1.44764      0.675959      0.354062        35     
produce:pandora:StandardPandora                         7.49061       19.6335       42.2599       17.9995       8.93335        35     
produce:pandoraWriter:StandardPandora                  0.0858496     0.151283      0.217363      0.145449      0.0340724       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.562415       1.64386       3.11037       1.4498       0.599727        35     
produce:pandoraShower:LArPandoraShowerCreation         0.548991       1.90828       4.09286       1.61795      0.800816        35     
produce:pandoracalo:Calorimetry                        0.339858      0.827452       1.38815      0.750209      0.256883        35     
produce:pandoracalonosce:Calorimetry                   0.298673      0.764889       1.33277      0.712999      0.243412        35     
produce:pandorapid:Chi2ParticleID                     0.00127382    0.00205387    0.00323596    0.00202333    0.000423029      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.507498       1.78183       3.51006       1.58995      0.713164        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.494574       1.72405       3.39122       1.52113      0.681539        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0895624     0.139057      0.195379      0.138493      0.0263337       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0273547     0.0467627     0.0685455     0.047372     0.00886149       35     
produce:emtrkmichelid:EmTrackMichelId                   17.2728       27.2651       38.3903       25.9664       5.43666        35     
[art]:TriggerResults:TriggerResultInserter            1.7181e-05    2.47963e-05   6.6003e-05    2.2633e-05    7.96868e-06      35     
end_path:out1:RootOutput                               6.88e-06     9.21049e-06   2.3128e-05     8.957e-06    2.47261e-06      35     
end_path:michelremoving:michelremoving                 0.0177999     0.0903044     0.310762      0.0352042     0.0797722       35     
end_path:michelremovinggnocchi:michelremoving          0.0147302     0.0853718     0.301445      0.0323706     0.0788222       35     
end_path:calibanagnocchi:CalibAnaTree                   0.23072      0.643608       1.05763      0.603513      0.192707        35     
end_path:out1:RootOutput(write)                        0.488755      0.841822       1.16845      0.819328      0.169043        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5045.5 MB
  Peak resident set size usage (VmHWM): 2685.78 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030_reco_stage1_reco_stage2_20240927T154624_keepup.root
\tHists: np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030_reco_stage1_reco_stage2_20240927T154624_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030_reco_stage1_reco_stage2_20240927T154624_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030_reco_stage1_reco_stage2_20240927T154624_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727448248.0,
    "core.end_time": 1727451985.0,
    "core.events": [
      17923,
      17927,
      17931,
      17935,
      17939,
      17943,
      17947,
      17951,
      17955,
      17959,
      17963,
      17967,
      17971,
      17975,
      17979,
      17983,
      17987,
      17991,
      17995,
      17999,
      18003,
      18007,
      18011,
      18015,
      18019,
      18023,
      18027,
      18031,
      18035,
      18039,
      18043,
      18047,
      18051,
      18055,
      18059
    ],
    "core.event_count": 35,
    "core.first_event_number": 17923,
    "core.last_event_number": 18059,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27406
    ],
    "core.runs_subruns": [
      2740600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030_reco_stage1_reco_stage2_20240927T154624_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727448248.0,
    "core.end_time": 1727451985.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27406
    ],
    "core.runs_subruns": [
      2740600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027406_0128_dataflow3_datawriter_0_20240624T142030.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:29:33 UTC       justIN version: 01.01.08