justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79422.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79422.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3451
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 17:01:01
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-26 18:45:14
From worker nodeHostnamewn5914241.tier2.hep.manchester.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 17:01:50
Input fileshd-protodune:np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850.hdf5
JobscriptExit code0
Real time1h (6115s)
CPU time1h (5547s = 90%)
Outputting started2024-09-26 18:43:47
Output fileshd-protodune-det-reco:np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850_reco_stage1_reco_stage2_20240926T184332_keepup.root
hd-protodune-det-reco:np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850_reco_stage1_reco_stage2_20240926T184332_keepup_hists.root
Finished2024-09-26 18:45:14
Saved logsjustin-logs:79422.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

n TPC 2
1762 hits in TPC 3
4526 hits in TPC 4
7464 hits in TPC 5
3523 hits in TPC 6
1506 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3383 XUs and 5197 XVs -> 711 XUVs
C:0 T:2 5709 XUs and 4296 XVs -> 86 XUVs
C:0 T:3 60 XUs and 87 XVs -> 4 XUVs
C:0 T:4 94 XUs and 105 XVs -> 4 XUVs
C:0 T:5 20749 XUs and 29308 XVs -> 3788 XUVs
C:0 T:6 23011 XUs and 9724 XVs -> 228 XUVs
C:0 T:7 32 XUs and 82 XVs -> 3 XUVs
4824 XUVs total
1225 collection wire objects
4824 potential space points
Neighbour search...
222730 tests to find 140282 neighbours
Iterating with no regularization...
Begin: 4.23122e+06
0 3.73426e+06
1 3.66553e+06
2 3.65214e+06
3 3.64759e+06
4 3.64541e+06
Now with regularization...
Begin: 3.07956e+06
0 3.07787e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 522017 TrkackID 12 startx, y, z -68.1304 292.46 374.129  wireno, peakt tpcno 325 122.232 6 dist 0.423538min T, max_T5 905.927
no of hits closeby  0   event 522017 TrkackID 12 startx, y, z -68.1304 292.46 374.129  wireno, peakt tpcno 325 122.232 6 dist 0.423538min T, max_T5 905.927
26-Sep-2024 19:43:32 BST  Closed output file "np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850_reco_stage1_reco_stage2_20240926T184332_keepup.root"
26-Sep-2024 19:43:32 BST  Closed input file "np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              86.8331       136.559       198.517       127.47        26.8927        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000454246   0.00270779     0.0049476    0.00264058     0.0011417       30     
produce:fembfilter:PDHDFEMBFilter                      0.692969      0.997444       1.48825       1.04519      0.168361        30     
produce:wclsdatahd:WireCellToolkit                      50.9448       61.0153       72.7422       60.9853       5.82633        30     
produce:gaushit:GausHitFinder                          0.409703      0.960749       1.43426      0.973726      0.272459        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000283957   0.000514041   0.00125216    0.00048814    0.000173309      30     
produce:reco3d:SpacePointSolver                        0.145831      0.981369       3.07723      0.848773      0.644861        30     
produce:hitpdune:DisambigFromSpacePoints               0.157516      0.705233       2.16278      0.674426      0.401767        30     
produce:pandora:StandardPandora                         5.2729        16.5213       40.8364       14.5085       7.76804        30     
produce:pandoraWriter:StandardPandora                  0.135072      0.215947      0.424584      0.203581      0.0652609       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.882663       2.5603        5.73026       2.43487       1.2221         30     
produce:pandoraShower:LArPandoraShowerCreation         0.654328       3.03194       9.04233       2.63143       1.88535        30     
produce:pandoracalo:Calorimetry                        0.445739       1.10733       2.29709       1.00743      0.484179        30     
produce:pandoracalonosce:Calorimetry                   0.391101       1.01783       2.2674       0.931005      0.477026        30     
produce:pandorapid:Chi2ParticleID                     0.00133703    0.00260916    0.00550177    0.00255794    0.000865122      30     
produce:pandoraShowercalo:ShowerCalorimetry             0.56669       2.52187       7.23282       2.17288       1.52782        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.546671       2.44103       7.25308       2.10942       1.48384        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.112151      0.185824      0.327916      0.183252      0.0559806       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0401191     0.0719727     0.111887      0.0729506     0.0199102       30     
produce:emtrkmichelid:EmTrackMichelId                   18.3591       39.5724       61.473        38.3985       10.0012        30     
[art]:TriggerResults:TriggerResultInserter            3.7126e-05    6.68754e-05   0.00012745    6.46215e-05   1.51732e-05      30     
end_path:out1:RootOutput                                9.7e-06     1.54526e-05   3.8218e-05    1.46565e-05   5.23113e-06      30     
end_path:michelremoving:michelremoving                 0.0327214     0.150119      0.450493      0.0915644     0.107908        30     
end_path:michelremovinggnocchi:michelremoving          0.0338196     0.146049      0.449325      0.0877462     0.107179        30     
end_path:calibanagnocchi:CalibAnaTree                  0.245517      0.968003       2.71195      0.810006      0.518025        30     
end_path:out1:RootOutput(write)                         0.58778       1.21179       2.2229        1.23914      0.348113        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4957.79 MB
  Peak resident set size usage (VmHWM): 2607.59 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850_reco_stage1_reco_stage2_20240926T184332_keepup.root
\tHists: np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850_reco_stage1_reco_stage2_20240926T184332_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850_reco_stage1_reco_stage2_20240926T184332_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850_reco_stage1_reco_stage2_20240926T184332_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727372056.0,
    "core.end_time": 1727376214.0,
    "core.events": [
      521785,
      521793,
      521801,
      521809,
      521817,
      521825,
      521833,
      521841,
      521849,
      521857,
      521865,
      521873,
      521881,
      521889,
      521897,
      521905,
      521913,
      521921,
      521929,
      521937,
      521945,
      521953,
      521961,
      521969,
      521977,
      521985,
      521993,
      522001,
      522009,
      522017
    ],
    "core.event_count": 30,
    "core.first_event_number": 521785,
    "core.last_event_number": 522017,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850_reco_stage1_reco_stage2_20240926T184332_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727372056.0,
    "core.end_time": 1727376214.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_2174_dataflow1_datawriter_0_20240908T025850.hdf5"
    }
  ]
}
justIN time: 2024-11-17 07:55:26 UTC       justIN version: 01.01.09