justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265976.14@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265976.14@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-28 19:20:19
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2024-09-28 20:59:09
From worker nodeHostnamenode2A06.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-28 19:22:47
Input fileshd-protodune:np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420.hdf5
JobscriptExit code0
Real time1h (5696s)
CPU time1h (5166s = 90%)
Outputting started2024-09-28 20:57:44
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420_reco_stage1_reco_stage2_20240928T205733_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420_reco_stage1_reco_stage2_20240928T205733_keepup_hists.root
Finished2024-09-28 20:59:09
Saved logsjustin-logs:265976.14-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

C 6
6536 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 14 XUs and 7 XVs -> 0 XUVs
C:0 T:1 128 XUs and 144 XVs -> 26 XUVs
C:0 T:2 10884 XUs and 9687 XVs -> 277 XUVs
C:0 T:3 57 XUs and 60 XVs -> 3 XUVs
C:0 T:4 281 XUs and 535 XVs -> 18 XUVs
C:0 T:5 18756 XUs and 12202 XVs -> 867 XUVs
C:0 T:6 38102 XUs and 52422 XVs -> 1400 XUVs
C:0 T:7 127 XUs and 159 XVs -> 13 XUVs
2604 XUVs total
1306 collection wire objects
2604 potential space points
Neighbour search...
131772 tests to find 54534 neighbours
Iterating with no regularization...
Begin: 1.55172e+07
0 1.34279e+07
1 1.32615e+07
2 1.32539e+07
Now with regularization...
Begin: 1.24342e+07
0 1.24285e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 389 TrkackID 6 startx, y, z 152.714 364.751 452.719  wireno, peakt tpcno 108 2000.62 5 dist 0min T, max_T875.003 2848.3
no of hits closeby  0   event 389 TrkackID 6 startx, y, z 152.714 364.751 452.719  wireno, peakt tpcno 108 2000.62 5 dist 0min T, max_T875.003 2848.3
28-Sep-2024 21:57:33 BST  Closed output file "np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420_reco_stage1_reco_stage2_20240928T205733_keepup.root"
28-Sep-2024 21:57:33 BST  Closed input file "np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                               71.87        105.062       132.734       103.386       15.6223        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000419948   0.00265341    0.00442356    0.00284368     0.0010763       39     
produce:fembfilter:PDHDFEMBFilter                      0.580358      0.701646      0.739482      0.700983      0.0282061       39     
produce:wclsdatahd:WireCellToolkit                      40.8528       47.2281       59.9179       45.9538       4.25186        39     
produce:gaushit:GausHitFinder                          0.478616      0.817133       1.16524      0.876033      0.166251        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000282026   0.000416559   0.000586258   0.000413949   6.68798e-05      39     
produce:reco3d:SpacePointSolver                        0.145151      0.883438       3.32388      0.719629      0.698276        39     
produce:hitpdune:DisambigFromSpacePoints               0.146888      0.619608       1.55472      0.573727       0.29826        39     
produce:pandora:StandardPandora                         6.73716       17.1242       30.9068       16.189        6.47349        39     
produce:pandoraWriter:StandardPandora                  0.0936342     0.239449      0.468848      0.190731      0.107332        39     
produce:pandoraTrack:LArPandoraTrackCreation           0.527186       1.64193       3.17201       1.62933      0.630525        39     
produce:pandoraShower:LArPandoraShowerCreation         0.564616       2.05038       4.43576       2.02322       0.92738        39     
produce:pandoracalo:Calorimetry                         0.27576      0.829036       1.37772      0.827452       0.26873        39     
produce:pandoracalonosce:Calorimetry                   0.235398      0.757828       1.27443      0.730557      0.246675        39     
produce:pandorapid:Chi2ParticleID                     0.00104727    0.00280369    0.00504976    0.00314779    0.00113731       39     
produce:pandoraShowercalo:ShowerCalorimetry            0.490785       1.92517       3.93527       1.87251       0.81059        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.389919       1.85247       3.97542       1.76096      0.829318        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.062288      0.212182      0.386786      0.180152      0.100183        39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0255098     0.0853995      0.16331      0.0630812     0.0434185       39     
produce:emtrkmichelid:EmTrackMichelId                   14.5955       26.2064       35.4191       26.0696       5.22124        39     
[art]:TriggerResults:TriggerResultInserter            2.7969e-05    3.71256e-05   7.1765e-05    3.5751e-05    6.97363e-06      39     
end_path:out1:RootOutput                               9.499e-06    1.10467e-05   2.3087e-05    1.0572e-05    2.27041e-06      39     
end_path:michelremoving:michelremoving                 0.0181953     0.0875852     0.450198      0.0551928     0.080581        39     
end_path:michelremovinggnocchi:michelremoving          0.0156709     0.0839267     0.444332      0.0528497     0.0804543       39     
end_path:calibanagnocchi:CalibAnaTree                  0.211438      0.619716      0.982431      0.600543      0.206055        39     
end_path:out1:RootOutput(write)                        0.504396      0.965917       1.55273       0.95706      0.283905        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4933.9 MB
  Peak resident set size usage (VmHWM): 2606.56 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420_reco_stage1_reco_stage2_20240928T205733_keepup.root
\tHists: np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420_reco_stage1_reco_stage2_20240928T205733_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420_reco_stage1_reco_stage2_20240928T205733_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420_reco_stage1_reco_stage2_20240928T205733_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727552911.0,
    "core.end_time": 1727557054.0,
    "core.events": [
      313,
      315,
      317,
      319,
      321,
      323,
      325,
      327,
      329,
      331,
      333,
      335,
      337,
      339,
      341,
      343,
      345,
      347,
      349,
      351,
      353,
      355,
      357,
      359,
      361,
      363,
      365,
      367,
      369,
      371,
      373,
      375,
      377,
      379,
      381,
      383,
      385,
      387,
      389
    ],
    "core.event_count": 39,
    "core.first_event_number": 313,
    "core.last_event_number": 389,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420_reco_stage1_reco_stage2_20240928T205733_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727552911.0,
    "core.end_time": 1727557054.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0004_dataflow1_datawriter_0_20240928T182420.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:36:12 UTC       justIN version: 01.01.08