justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 270043.16@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID270043.16@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3565
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 09:40:47
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-10-05 10:57:13
From worker nodeHostnamespool1610.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 09:42:30
Input fileshd-protodune:np04hd_raw_run027420_0035_dataflow3_datawriter_0_20240625T125219.hdf5
Outputting started2024-10-05 10:55:33
Output files
Finished2024-10-05 10:57:13
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

PC 1
8602 hits in TPC 2
5873 hits in TPC 3
1600 hits in TPC 4
3657 hits in TPC 5
7768 hits in TPC 6
5417 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 10445 XUs and 10061 XVs -> 175 XUVs
C:0 T:2 80361 XUs and 84900 XVs -> 4731 XUVs
C:0 T:3 2133 XUs and 2874 XVs -> 247 XUVs
C:0 T:4 28 XUs and 53 XVs -> 2 XUVs
C:0 T:5 5332 XUs and 5664 XVs -> 172 XUVs
C:0 T:6 33943 XUs and 59430 XVs -> 586 XUVs
C:0 T:7 1068 XUs and 668 XVs -> 15 XUVs
5928 XUVs total
1312 collection wire objects
5928 potential space points
Neighbour search...
540802 tests to find 278140 neighbours
Iterating with no regularization...
Begin: 2.39625e+07
0 2.24368e+07
1 2.23211e+07
2 2.23025e+07
Now with regularization...
Begin: 2.14593e+07
0 2.1451e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 5039 TrkackID 1 startx, y, z 157.041 452.176 458.277  wireno, peakt tpcno 307 4094.93 2 dist 162.075min T, max_T2110.16 4128.95
no of hits closeby  0   event 5039 TrkackID 1 startx, y, z 157.041 452.176 458.277  wireno, peakt tpcno 307 4094.93 2 dist 162.075min T, max_T2110.16 4128.95
05-Oct-2024 10:55:23 UTC  Closed output file "np04hd_raw_run027420_0035_dataflow3_datawriter_0_20240625T125219_reco_stage1_reco_stage2_20241005T105523_keepup.root"
05-Oct-2024 10:55:23 UTC  Closed input file "np04hd_raw_run027420_0035_dataflow3_datawriter_0_20240625T125219_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              66.1862       93.304        221.693       89.612        26.6805        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000365955   0.00153523    0.00438689    0.00113868    0.00113314       35     
produce:fembfilter:PDHDFEMBFilter                      0.664351      0.687268      0.771282      0.680468      0.0231973       35     
produce:wclsdatahd:WireCellToolkit                      45.471        48.3989       51.2063       48.3794       1.28728        35     
produce:gaushit:GausHitFinder                          0.442749      0.734571       1.08365      0.745921      0.163845        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000281857   0.000448745   0.000620714   0.000458887   8.66088e-05      35     
produce:reco3d:SpacePointSolver                        0.163919      0.930549       2.40063      0.746986      0.554961        35     
produce:hitpdune:DisambigFromSpacePoints               0.152048      0.422932      0.689389      0.430454       0.15157        35     
produce:pandora:StandardPandora                         4.09839       19.1466       142.201       14.0955       22.815         35     
produce:pandoraWriter:StandardPandora                  0.076864      0.152446      0.211823      0.159469      0.0344378       35     
produce:pandoraTrack:LArPandoraTrackCreation           0.779093       1.93314       3.05642       1.72641      0.689302        35     
produce:pandoraShower:LArPandoraShowerCreation         0.805204       2.1514        4.30365       2.2602       0.866649        35     
produce:pandoracalo:Calorimetry                        0.325242      0.824667       1.37918      0.764537      0.283014        35     
produce:pandoracalonosce:Calorimetry                   0.314076      0.775518       1.30809      0.720955      0.278642        35     
produce:pandorapid:Chi2ParticleID                     0.00116609    0.00179199    0.00273749    0.00190146    0.000354268      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.571173       1.75797       4.13729       1.82551      0.803277        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.563415       1.71466       3.88101       1.7878       0.774405        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0610896     0.100251      0.150018      0.104062      0.0214747       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0246979     0.0407556     0.0585241     0.0419614    0.00902858       35     
produce:emtrkmichelid:EmTrackMichelId                   7.14981       11.9008       16.6107       12.2257       2.33937        35     
[art]:TriggerResults:TriggerResultInserter            2.9061e-05    4.46983e-05   9.0029e-05    4.1775e-05    1.28605e-05      35     
end_path:out1:RootOutput                              1.0053e-05    1.32324e-05   2.6159e-05    1.1722e-05    3.62838e-06      35     
end_path:michelremoving:michelremoving                 0.0185531     0.0575778     0.166372      0.0355938     0.0419313       35     
end_path:michelremovinggnocchi:michelremoving          0.017192      0.0543304     0.169156      0.033488      0.0391641       35     
end_path:calibanagnocchi:CalibAnaTree                  0.216366      0.607872       1.0186       0.604325      0.223912        35     
end_path:out1:RootOutput(write)                        0.415404      0.684045      0.986295      0.708379      0.146135        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5848.54 MB
  Peak resident set size usage (VmHWM): 2640.92 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027420_0035_dataflow3_datawriter_0_20240625T125219_reco_stage1_reco_stage2_20241005T105523_keepup.root
\tHists: np04hd_raw_run027420_0035_dataflow3_datawriter_0_20240625T125219_reco_stage1_reco_stage2_20241005T105523_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027420_0035_dataflow3_datawriter_0_20240625T125219_reco_stage1_reco_stage2_20241005T105523_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027420_0035_dataflow3_datawriter_0_20240625T125219_reco_stage1_reco_stage2_20241005T105523_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728122424.0,
    "core.end_time": 1728125723.0,
    "core.events": [
      4903,
      4907,
      4911,
      4915,
      4919,
      4923,
      4927,
      4931,
      4935,
      4939,
      4943,
      4947,
      4951,
      4955,
      4959,
      4963,
      4967,
      4971,
      4975,
      4979,
      4983,
      4987,
      4991,
      4995,
      4999,
      5003,
      5007,
      5011,
      5015,
      5019,
      5023,
      5027,
      5031,
      5035,
      5039
    ],
    "core.event_count": 35,
    "core.first_event_number": 4903,
    "core.last_event_number": 5039,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27420
    ],
    "core.runs_subruns": [
      2742000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027420_0035_dataflow3_datawriter_0_20240625T125219.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027420_0035_dataflow3_datawriter_0_20240625T125219_reco_stage1_reco_stage2_20241005T105523_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728122424.0,
    "core.end_time": 1728125723.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27420
    ],
    "core.runs_subruns": [
      2742000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027420_0035_dataflow3_datawriter_0_20240625T125219.hdf5"
    }
  ]
}
justIN time: 2024-11-21 19:47:43 UTC       justIN version: 01.01.09