justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266213.23@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266213.23@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3553
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 08:10:11
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-09-29 10:54:44
From worker nodeHostnamewn1908301.tier2.hep.manchester.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5118 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 08:11:49
Input fileshd-protodune:np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054.hdf5
JobscriptExit code0
Real time2h (9613s)
CPU time2h (8887s = 92%)
Outputting started2024-09-29 10:52:03
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054_reco_stage1_reco_stage2_20240929T105144_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054_reco_stage1_reco_stage2_20240929T105144_keepup_hists.root
Finished2024-09-29 10:54:44
Saved logsjustin-logs:266213.23-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

C:0 T:5 24631 XUs and 11541 XVs -> 450 XUVs
C:0 T:6 17637 XUs and 16701 XVs -> 393 XUVs
C:0 T:7 400 XUs and 369 XVs -> 2 XUVs
4206 XUVs total
1026 collection wire objects
4206 potential space points
Neighbour search...
302440 tests to find 184934 neighbours
Iterating with no regularization...
Begin: 7.26115e+06
0 6.99743e+06
1 6.97636e+06
2 6.97381e+06
Now with regularization...
Begin: 6.7473e+06
0 6.74644e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

Begin processing the 39th record. run: 29389 subRun: 1 event: 4446 at 29-Sep-2024 11:50:24 BST
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 112177 traces, 112177 summary
Retagger: tagging trace set: gauss with 81847 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 81847 traces tagged "gauss"
FrameSaver: q=2.11996e+06 n=1500887 tag=gauss
wclsFrameSaver: saving 112177 traces tagged "wiener"
FrameSaver: q=2.4462e+06 n=1366171 tag=wiener
5323 hits in TPC 0
3847 hits in TPC 1
21718 hits in TPC 2
29-Sep-2024 11:51:44 BST  Closed output file "np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054_reco_stage1_reco_stage2_20240929T105144_keepup.root"
29-Sep-2024 11:51:44 BST  Closed input file "np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              78.2725       194.855       389.582       184.509       64.6706        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000644587   0.00336287    0.00529566    0.00357086     0.0012812       39     
produce:fembfilter:PDHDFEMBFilter                       1.07747       1.12898       1.3191        1.11453      0.0499062       39     
produce:wclsdatahd:WireCellToolkit                      64.3011       69.833        74.6056       69.3426       2.40501        39     
produce:gaushit:GausHitFinder                          0.833229       1.3273        2.24642       1.30643      0.366466        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000439688   0.000649524   0.00128498     0.0006199    0.000171559      39     
produce:reco3d:SpacePointSolver                        0.379323       4.51208       25.4698       1.53093       6.46454        38     
produce:hitpdune:DisambigFromSpacePoints               0.422767       1.44235       4.19975       1.11197      0.943138        38     
produce:pandora:StandardPandora                         9.81349       28.338        109.093       23.1261       19.4797        38     
produce:pandoraWriter:StandardPandora                   0.17738      0.304463       0.55487      0.289393      0.0994477       38     
produce:pandoraTrack:LArPandoraTrackCreation            1.17428       4.29476       12.5667       4.00935       2.55521        38     
produce:pandoraShower:LArPandoraShowerCreation          1.00161       5.44895       13.0311       4.70104       3.70297        38     
produce:pandoracalo:Calorimetry                        0.530334       1.7805        5.33207       1.62598       1.06351        38     
produce:pandoracalonosce:Calorimetry                   0.467564       1.65998       5.05779       1.50326       1.02406        38     
produce:pandorapid:Chi2ParticleID                     0.00200598     0.0035368     0.0138819    0.00334053    0.00187055       38     
produce:pandoraShowercalo:ShowerCalorimetry            0.826171       4.36773       10.614        3.5302        2.97259        38     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.818218       4.31215       10.821        3.46992       2.95698        38     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.142473      0.264069      0.418247      0.257697      0.0784392       38     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0605287     0.110615      0.197994      0.108656      0.0341143       38     
produce:emtrkmichelid:EmTrackMichelId                   38.841        65.2895       124.123       63.9079       21.4668        38     
[art]:TriggerResults:TriggerResultInserter            5.5916e-05    7.68544e-05   0.000130155   7.6151e-05    1.08596e-05      39     
end_path:out1:RootOutput                              1.3763e-05    2.24273e-05   4.3208e-05    2.1931e-05    4.31689e-06      39     
end_path:michelremoving:michelremoving                6.8986e-05     0.217018      0.706091      0.130814      0.187315        39     
end_path:michelremovinggnocchi:michelremoving         6.0242e-05     0.205889      0.626643      0.110482      0.178039        39     
end_path:calibanagnocchi:CalibAnaTree                 6.0187e-05      1.42047       4.44885       1.28803      0.970434        39     
end_path:out1:RootOutput(write)                        0.725208       1.51201       2.67593       1.47773      0.493381        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5017.17 MB
  Peak resident set size usage (VmHWM): 2678.42 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054_reco_stage1_reco_stage2_20240929T105144_keepup.root
\tHists: np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054_reco_stage1_reco_stage2_20240929T105144_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054_reco_stage1_reco_stage2_20240929T105144_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054_reco_stage1_reco_stage2_20240929T105144_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727599424.0,
    "core.end_time": 1727607106.0,
    "core.events": [
      4370,
      4372,
      4374,
      4376,
      4378,
      4380,
      4382,
      4384,
      4386,
      4388,
      4390,
      4392,
      4394,
      4396,
      4398,
      4400,
      4402,
      4404,
      4406,
      4408,
      4410,
      4412,
      4414,
      4416,
      4418,
      4420,
      4422,
      4424,
      4426,
      4428,
      4430,
      4432,
      4434,
      4436,
      4438,
      4440,
      4442,
      4444,
      4446
    ],
    "core.event_count": 39,
    "core.first_event_number": 4370,
    "core.last_event_number": 4446,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054_reco_stage1_reco_stage2_20240929T105144_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727599424.0,
    "core.end_time": 1727607106.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0056_dataflow0_datawriter_0_20240929T054054.hdf5"
    }
  ]
}
justIN time: 2024-09-29 13:21:23 UTC       justIN version: 01.01.08