justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 76731.153@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID76731.153@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3385
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-24 19:45:59
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce504
Last heartbeat2024-09-24 21:36:35
From worker nodeHostnameb9p05p8744.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-24 20:26:30
Input fileshd-protodune:np04hd_raw_run029006_0390_dataflow2_datawriter_0_20240830T171350.hdf5
Outputting started2024-09-24 21:35:06
Output files
Finished2024-09-24 21:36:35
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

10 XVs -> 11375 XUVs
C:0 T:3 224 XUs and 163 XVs -> 3 XUVs
C:0 T:4 59 XUs and 44 XVs -> 2 XUVs
C:0 T:5 12312 XUs and 12666 XVs -> 1141 XUVs
C:0 T:6 133092 XUs and 142946 XVs -> 7401 XUVs
C:0 T:7 50 XUs and 42 XVs -> 3 XUVs
19925 XUVs total
3493 collection wire objects
19925 potential space points
Neighbour search...
2781189 tests to find 1007476 neighbours
Iterating with no regularization...
Begin: 2.70691e+07
0 2.06283e+07
1 1.99167e+07
2 1.97551e+07
3 1.96905e+07
4 1.96584e+07
5 1.96411e+07
Now with regularization...
Begin: 1.87194e+07
0 1.87031e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 93834 TrkackID 1 startx, y, z -262.088 525.322 461.06  wireno, peakt tpcno 22 2684.85 2 dist 0min T, max_T229.805 3575.6
no of hits closeby  0   event 93834 TrkackID 1 startx, y, z -262.088 525.322 461.06  wireno, peakt tpcno 22 2684.85 2 dist 0min T, max_T229.805 3575.6
24-Sep-2024 23:34:50 CEST  Closed output file "np04hd_raw_run029006_0390_dataflow2_datawriter_0_20240830T171350_reco_stage1_reco_stage2_20240924T213450_keepup.root"
24-Sep-2024 23:34:50 CEST  Closed input file "np04hd_raw_run029006_0390_dataflow2_datawriter_0_20240830T171350_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              70.6136       101.691       150.747       100.16        18.1992        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000613395   0.00230588    0.00449656    0.00240918    0.000996472      30     
produce:fembfilter:PDHDFEMBFilter                      0.671329      0.795847       0.91207      0.820915      0.0622596       30     
produce:wclsdatahd:WireCellToolkit                      36.501        43.2368       47.8345       43.9701       2.50456        30     
produce:gaushit:GausHitFinder                          0.341783       0.76512       1.2054        0.79838      0.205993        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000217241   0.000360276   0.000652995   0.000366318   8.1354e-05       30     
produce:reco3d:SpacePointSolver                        0.263989       1.37307       7.49902       1.07166       1.42056        30     
produce:hitpdune:DisambigFromSpacePoints               0.194071      0.679845       1.44154      0.621995      0.326981        30     
produce:pandora:StandardPandora                         4.39541       12.9427       27.7995       12.748        5.60995        30     
produce:pandoraWriter:StandardPandora                  0.0766475     0.155285      0.256984      0.158415      0.0484959       30     
produce:pandoraTrack:LArPandoraTrackCreation            0.45434       1.09003       2.51651      0.963923      0.486559        30     
produce:pandoraShower:LArPandoraShowerCreation         0.390633       1.32177       3.01579       1.15989      0.584797        30     
produce:pandoracalo:Calorimetry                        0.261725      0.618887       1.45622      0.550374      0.269049        30     
produce:pandoracalonosce:Calorimetry                   0.222966       0.56424       1.44765      0.500557      0.253854        30     
produce:pandorapid:Chi2ParticleID                     0.00122486    0.00197497    0.00336054    0.00189588     0.0005377       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.353681       1.30909       3.11562       1.15764       0.62582        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.319218       1.25603       3.00104       1.15454      0.570432        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.057608      0.159191      0.243946      0.155204      0.0454234       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0183191     0.050644      0.0831612     0.0478002     0.0151556       30     
produce:emtrkmichelid:EmTrackMichelId                   16.401        33.6559       56.246        33.9089       8.21773        30     
[art]:TriggerResults:TriggerResultInserter             2.394e-05    3.5188e-05    9.4811e-05    3.08655e-05   1.30296e-05      30     
end_path:out1:RootOutput                               8.51e-06      1.108e-05     3.101e-05     1.005e-05    4.03656e-06      30     
end_path:michelremoving:michelremoving                 0.0169726     0.120012      0.251852      0.136739      0.0753174       30     
end_path:michelremovinggnocchi:michelremoving          0.0165414     0.113091      0.248539      0.124482      0.0714434       30     
end_path:calibanagnocchi:CalibAnaTree                  0.178879       0.49371       1.3453       0.473207       0.21028        30     
end_path:out1:RootOutput(write)                        0.497218      0.862482       1.30536      0.872999      0.205652        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4954.56 MB
  Peak resident set size usage (VmHWM): 2607.05 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029006_0390_dataflow2_datawriter_0_20240830T171350_reco_stage1_reco_stage2_20240924T213450_keepup.root
\tHists: np04hd_raw_run029006_0390_dataflow2_datawriter_0_20240830T171350_reco_stage1_reco_stage2_20240924T213450_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029006_0390_dataflow2_datawriter_0_20240830T171350_reco_stage1_reco_stage2_20240924T213450_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029006_0390_dataflow2_datawriter_0_20240830T171350_reco_stage1_reco_stage2_20240924T213450_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727210594.0,
    "core.end_time": 1727213690.0,
    "core.events": [
      93602,
      93610,
      93618,
      93626,
      93634,
      93642,
      93650,
      93658,
      93666,
      93674,
      93682,
      93690,
      93698,
      93706,
      93714,
      93722,
      93730,
      93738,
      93746,
      93754,
      93762,
      93770,
      93778,
      93786,
      93794,
      93802,
      93810,
      93818,
      93826,
      93834
    ],
    "core.event_count": 30,
    "core.first_event_number": 93602,
    "core.last_event_number": 93834,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_0390_dataflow2_datawriter_0_20240830T171350.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029006_0390_dataflow2_datawriter_0_20240830T171350_reco_stage1_reco_stage2_20240924T213450_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727210594.0,
    "core.end_time": 1727213690.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_0390_dataflow2_datawriter_0_20240830T171350.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:16:45 UTC       justIN version: 01.01.08