justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 270059.55@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID270059.55@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3566
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 10:27:37
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-10-05 11:58:41
From worker nodeHostnamespool1510.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 10:54:15
Input fileshd-protodune:np04hd_raw_run027425_2012_dataflow2_datawriter_0_20240626T001906.hdf5
Outputting started2024-10-05 11:57:01
Output files
Finished2024-10-05 11:58:41
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ked to 5859 ticks
wclsFrameSaver: saving 49592 traces tagged "gauss"
FrameSaver: q=1.80023e+06 n=928762 tag=gauss
wclsFrameSaver: saving 67109 traces tagged "wiener"
FrameSaver: q=1.94348e+06 n=845085 tag=wiener
3653 hits in TPC 0
5067 hits in TPC 1
6735 hits in TPC 2
3916 hits in TPC 3
4611 hits in TPC 4
6963 hits in TPC 5
5055 hits in TPC 6
2677 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2358 XUs and 2789 XVs -> 174 XUVs
C:0 T:2 23876 XUs and 24347 XVs -> 1463 XUVs
C:0 T:3 126 XUs and 143 XVs -> 1 XUVs
C:0 T:4 267 XUs and 546 XVs -> 11 XUVs
C:0 T:5 15462 XUs and 23434 XVs -> 655 XUVs
C:0 T:6 16499 XUs and 17464 XVs -> 384 XUVs
C:0 T:7 673 XUs and 350 XVs -> 15 XUVs
2703 XUVs total
1551 collection wire objects
2703 potential space points
Neighbour search...
42855 tests to find 24450 neighbours
Iterating with no regularization...
Begin: 1.73492e+07
0 1.59136e+07
1 1.58429e+07
2 1.58371e+07
Now with regularization...
Begin: 1.42506e+07
0 1.42482e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

05-Oct-2024 11:56:51 UTC  Closed output file "np04hd_raw_run027425_2012_dataflow2_datawriter_0_20240626T001906_reco_stage1_reco_stage2_20241005T115651_keepup.root"
05-Oct-2024 11:56:51 UTC  Closed input file "np04hd_raw_run027425_2012_dataflow2_datawriter_0_20240626T001906_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              59.4868       77.6662       95.9206       76.3116       9.07966        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000321806   0.00155582    0.00350199    0.00119691    0.00106137       35     
produce:fembfilter:PDHDFEMBFilter                      0.649918       0.6687       0.782268      0.663448      0.0227409       35     
produce:wclsdatahd:WireCellToolkit                      43.2126       45.9222       71.5222       45.3664       4.47128        35     
produce:gaushit:GausHitFinder                          0.307246      0.656139      0.976246       0.64788      0.145544        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000240203   0.000398868   0.000592038   0.000387496   7.1229e-05       35     
produce:reco3d:SpacePointSolver                        0.113678      0.647171       1.62811      0.566223      0.365392        35     
produce:hitpdune:DisambigFromSpacePoints               0.0831323     0.347752      0.650353      0.329711       0.12181        35     
produce:pandora:StandardPandora                         3.59354       9.82736       20.1837       8.78979       3.81371        35     
produce:pandoraWriter:StandardPandora                  0.0806898     0.127195      0.186809       0.12292      0.0245425       35     
produce:pandoraTrack:LArPandoraTrackCreation            0.68404       1.45606       2.55258       1.33835      0.443955        35     
produce:pandoraShower:LArPandoraShowerCreation         0.598819       1.74122       3.30124       1.67777      0.637136        35     
produce:pandoracalo:Calorimetry                         0.28144      0.647926       1.11362      0.615066      0.179266        35     
produce:pandoracalonosce:Calorimetry                   0.260543      0.608559       1.06268      0.568002      0.175593        35     
produce:pandorapid:Chi2ParticleID                     0.00108962    0.00158116    0.00265701    0.00152515    0.000302772      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.465419       1.42384       2.92293       1.34802      0.555148        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.468352       1.3699        2.8301        1.27749      0.539318        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0452484     0.0898558     0.128665      0.0873573     0.0187336       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0213192     0.0356891     0.049779      0.0346065    0.00717938       35     
produce:emtrkmichelid:EmTrackMichelId                   6.91026       10.7097       14.5145       10.1475       1.9504         35     
[art]:TriggerResults:TriggerResultInserter            2.5306e-05    4.17161e-05   8.3334e-05    3.9187e-05    1.34746e-05      35     
end_path:out1:RootOutput                               7.075e-06    1.08707e-05   2.7817e-05     9.899e-06    4.42423e-06      35     
end_path:michelremoving:michelremoving                 0.0214181     0.0497577     0.170839      0.0334634     0.0368798       35     
end_path:michelremovinggnocchi:michelremoving          0.0187503     0.0473543     0.173504      0.0298775     0.037109        35     
end_path:calibanagnocchi:CalibAnaTree                  0.261235      0.481891      0.903486      0.456194      0.134232        35     
end_path:out1:RootOutput(write)                        0.333755      0.612292      0.887195      0.586631      0.121173        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5861.16 MB
  Peak resident set size usage (VmHWM): 2671.74 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027425_2012_dataflow2_datawriter_0_20240626T001906_reco_stage1_reco_stage2_20241005T115651_keepup.root
\tHists: np04hd_raw_run027425_2012_dataflow2_datawriter_0_20240626T001906_reco_stage1_reco_stage2_20241005T115651_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027425_2012_dataflow2_datawriter_0_20240626T001906_reco_stage1_reco_stage2_20241005T115651_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027425_2012_dataflow2_datawriter_0_20240626T001906_reco_stage1_reco_stage2_20241005T115651_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728126660.0,
    "core.end_time": 1728129412.0,
    "core.events": [
      281682,
      281686,
      281690,
      281694,
      281698,
      281702,
      281706,
      281710,
      281714,
      281718,
      281722,
      281726,
      281730,
      281734,
      281738,
      281742,
      281746,
      281750,
      281754,
      281758,
      281762,
      281766,
      281770,
      281774,
      281778,
      281782,
      281786,
      281790,
      281794,
      281798,
      281802,
      281806,
      281810,
      281814,
      281818
    ],
    "core.event_count": 35,
    "core.first_event_number": 281682,
    "core.last_event_number": 281818,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27425
    ],
    "core.runs_subruns": [
      2742500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027425_2012_dataflow2_datawriter_0_20240626T001906.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027425_2012_dataflow2_datawriter_0_20240626T001906_reco_stage1_reco_stage2_20241005T115651_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728126660.0,
    "core.end_time": 1728129412.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27425
    ],
    "core.runs_subruns": [
      2742500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027425_2012_dataflow2_datawriter_0_20240626T001906.hdf5"
    }
  ]
}
justIN time: 2024-11-21 19:34:44 UTC       justIN version: 01.01.09