justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 80352.0@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID80352.0@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3493
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 17:45:19
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-09-27 20:31:37
From worker nodeHostnamespool1606.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 18:47:07
Input fileshd-protodune:np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430.hdf5
JobscriptExit code0
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started2024-09-27 20:29:34
Output fileshd-protodune-det-reco:np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430_reco_stage1_reco_stage2_20240927T202921_keepup.root
hd-protodune-det-reco:np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430_reco_stage1_reco_stage2_20240927T202921_keepup_hists.root
Finished2024-09-27 20:31:37
Saved logsjustin-logs:80352.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

nnels
Finding XUV coincidences...
C:0 T:0 76 XUs and 63 XVs -> 0 XUVs
C:0 T:1 8448 XUs and 9735 XVs -> 470 XUVs
C:0 T:2 35052 XUs and 14578 XVs -> 886 XUVs
C:0 T:3 371 XUs and 64 XVs -> 14 XUVs
C:0 T:4 581 XUs and 949 XVs -> 79 XUVs
C:0 T:5 28265 XUs and 33140 XVs -> 608 XUVs
C:0 T:6 15567 XUs and 17132 XVs -> 816 XUVs
C:0 T:7 1406 XUs and 1664 XVs -> 20 XUVs
2893 XUVs total
1570 collection wire objects
2893 potential space points
Neighbour search...
43331 tests to find 27536 neighbours
Iterating with no regularization...
Begin: 5.66718e+07
0 5.32859e+07
1 5.31173e+07
2 5.311e+07
Now with regularization...
Begin: 5.11426e+07
0 5.11391e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  2   event 95523 TrkackID 5 startx, y, z 120.739 554.466 1.7769  wireno, peakt tpcno 174 1700.08 2 dist 203.68min T, max_T6.52441 1740
no of hits closeby  2   event 95523 TrkackID 5 startx, y, z 120.739 554.466 1.7769  wireno, peakt tpcno 174 1700.08 2 dist 203.68min T, max_T6.52441 1740
27-Sep-2024 20:29:21 UTC  Closed output file "np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430_reco_stage1_reco_stage2_20240927T202921_keepup.root"
27-Sep-2024 20:29:21 UTC  Closed input file "np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              80.6572       148.201       267.437       124.087       50.3488        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000482049    0.0025614     0.0115978    0.00164755    0.00227656       35     
produce:fembfilter:PDHDFEMBFilter                      0.670921      0.810924       1.38094      0.721731      0.196658        35     
produce:wclsdatahd:WireCellToolkit                      47.6272       52.685        57.2481       52.9925       2.61333        35     
produce:gaushit:GausHitFinder                          0.539163       1.00556       1.51258      0.976347      0.232757        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000405375   0.00317398     0.0867424    0.000680403    0.0143336       35     
produce:reco3d:SpacePointSolver                        0.496432       2.02491       5.8048        1.63832       1.29784        35     
produce:hitpdune:DisambigFromSpacePoints               0.260592      0.748477       1.81775      0.714908      0.358931        35     
produce:pandora:StandardPandora                         7.34639       40.1277       124.312       30.9834       30.4848        35     
produce:pandoraWriter:StandardPandora                  0.135346      0.237968       0.4309       0.231664      0.0609622       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.71546       6.29392       17.6001       5.20473       3.72092        35     
produce:pandoraShower:LArPandoraShowerCreation          1.48441       6.51659       16.9128       4.70423       3.92245        35     
produce:pandoracalo:Calorimetry                        0.701006       2.10148       5.93205       1.73667       1.24001        35     
produce:pandoracalonosce:Calorimetry                   0.675014       2.15688       7.51637       1.69376       1.46331        35     
produce:pandorapid:Chi2ParticleID                     0.00163466     0.0028255    0.00403342    0.00275378    0.000641788      35     
produce:pandoraShowercalo:ShowerCalorimetry             1.21414       4.48632       12.4127       3.33253       2.79094        35     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.11676       4.34278       11.2293       3.02091       2.64859        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0881841     0.133179      0.251754      0.127383      0.0322845       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0347821     0.0589594     0.122974      0.0549281     0.0175739       35     
produce:emtrkmichelid:EmTrackMichelId                   12.3672       21.5581       32.6951       21.1246       4.81834        35     
[art]:TriggerResults:TriggerResultInserter            3.7581e-05    6.89453e-05   0.000131235   6.5066e-05    2.11582e-05      35     
end_path:out1:RootOutput                               7.898e-06    1.55187e-05   2.5402e-05    1.5429e-05    4.47141e-06      35     
end_path:michelremoving:michelremoving                 0.0317517     0.0776813     0.214438      0.0591355     0.0432865       35     
end_path:michelremovinggnocchi:michelremoving          0.0243874     0.0732869     0.248929      0.0537434     0.0453743       35     
end_path:calibanagnocchi:CalibAnaTree                   0.47522       1.43117       3.83968       1.11403      0.929224        35     
end_path:out1:RootOutput(write)                        0.549848      0.904149       1.33201      0.894356      0.217322        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5917.24 MB
  Peak resident set size usage (VmHWM): 2728.68 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430_reco_stage1_reco_stage2_20240927T202921_keepup.root
\tHists: np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430_reco_stage1_reco_stage2_20240927T202921_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430_reco_stage1_reco_stage2_20240927T202921_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430_reco_stage1_reco_stage2_20240927T202921_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727463735.0,
    "core.end_time": 1727468962.0,
    "core.events": [
      95387,
      95391,
      95395,
      95399,
      95403,
      95407,
      95411,
      95415,
      95419,
      95423,
      95427,
      95431,
      95435,
      95439,
      95443,
      95447,
      95451,
      95455,
      95459,
      95463,
      95467,
      95471,
      95475,
      95479,
      95483,
      95487,
      95491,
      95495,
      95499,
      95503,
      95507,
      95511,
      95515,
      95519,
      95523
    ],
    "core.event_count": 35,
    "core.first_event_number": 95387,
    "core.last_event_number": 95523,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27310
    ],
    "core.runs_subruns": [
      2731000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430_reco_stage1_reco_stage2_20240927T202921_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727463735.0,
    "core.end_time": 1727468962.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27310
    ],
    "core.runs_subruns": [
      2731000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027310_0681_dataflow3_datawriter_0_20240620T035430.hdf5"
    }
  ]
}
justIN time: 2024-11-17 03:20:27 UTC       justIN version: 01.01.09