justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 78430.40@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID78430.40@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3447
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 09:33:14
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce03
Last heartbeat2024-09-26 11:16:07
From worker nodeHostnameccwcondor0551
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 09:48:37
Input fileshd-protodune:np04hd_raw_run029081_0709_dataflow4_datawriter_0_20240905T041450.hdf5
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started 
Output files
Finished2024-09-26 11:16:07
Saved logsjustin-logs:78430.40-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ficient p-value for these numbers
----view 0: 0.000281215 0.000281274 0.000281215 0.000281215 0.000281215 0.000281274 0.000281215 0.000281215 0.000281215 0.000281215 0.000281274 
----view 1: 0.022665 0.0449733 0.0208704 0.03992 0.0228046 0.0353273 0.0201498 0.0309175 0.0349938 0.0310972 0.0269765 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000281274 0.000281215 0.000281215 0.000281215 0.000281274 0.000281215 0.000281215 0.000281215 0.000281215 0.000281274 0.000281215 
----view 1: 0.0449733 0.0208704 0.03992 0.0228046 0.0353273 0.0201498 0.0309175 0.0349938 0.0310972 0.0269765 0.0410005 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000281215 0.000281215 0.000281215 0.000281274 0.000281215 0.000281215 0.000281215 0.000281215 0.000281274 0.000281215 0.000281215 
----view 1: 0.0208704 0.03992 0.0228046 0.0353273 0.0201498 0.0309175 0.0349938 0.0310972 0.0269765 0.0410005 0.0304001 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000281215 0.000281215 0.000281274 0.000281215 0.000281215 0.000281215 0.000281215 0.000281274 0.000281215 0.000281215 0.000281215 
----view 1: 0.03992 0.0228046 0.0353273 0.0201498 0.0309175 0.0349938 0.0310972 0.0269765 0.0410005 0.0304001 0.0279363 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000281215 0.000281274 0.000281215 0.000281215 0.000281215 0.000281215 0.000281274 0.000281215 0.000281215 0.000281215 0.000281274 
----view 1: 0.0228046 0.0353273 0.0201498 0.0309175 0.0349938 0.0310972 0.0269765 0.0410005 0.0304001 0.0279363 0.0293196 
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000281274 0.000281215 0.000281215 0.000281215 0.000281215 0.000281274 0.000281215 0.000281215 0.000281215 0.000281274 0.000281215 
----view 1: 0.0353273 0.0201498 0.0309175 0.0349938 0.0310972 0.0269765 0.0410005 0.0304001 0.0279363 0.0293196 0.0225523 
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 170388 TrkackID 1 startx, y, z 81.5234 592.523 339.262  wireno, peakt tpcno 478 814.94 5 dist 1.07867min T, max_T796.329 3984.42
no of hits closeby  0   event 170388 TrkackID 1 startx, y, z 81.5234 592.523 339.262  wireno, peakt tpcno 478 814.94 5 dist 1.07867min T, max_T796.329 3984.42
Begin processing the 30th record. run: 29081 subRun: 1 event: 170396 at 26-Sep-2024 12:49:08 CEST
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 47851 traces, 47851 summary
Retagger: tagging trace set: gauss with 37687 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 37687 traces tagged "gauss"
FrameSaver: q=787756 n=739886 tag=gauss
wclsFrameSaver: saving 47851 traces tagged "wiener"
FrameSaver: q=826315 n=674246 tag=wiener
2337 hits in TPC 0
1723 hits in TPC 1
3751 hits in TPC 2
2304 hits in TPC 3
4176 hits in TPC 4
5139 hits in TPC 5
3601 hits in TPC 6
3154 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 87 XUs and 88 XVs -> 2 XUVs
C:0 T:2 8739 XUs and 5414 XVs -> 133 XUVs
C:0 T:3 2 XUs and 2 XVs -> 0 XUVs
C:0 T:4 85 XUs and 95 XVs -> 6 XUVs
C:0 T:5 18132 XUs and 16272 XVs -> 426 XUVs
C:0 T:6 9034 XUs and 6775 XVs -> 299 XUVs
C:0 T:7 162 XUs and 100 XVs -> 0 XUVs
866 XUVs total
731 collection wire objects
866 potential space points
Neighbour search...
6150 tests to find 3226 neighbours
Iterating with no regularization...
Begin: 3.83163e+06
0 3.73454e+06
1 3.73296e+06
Now with regularization...
Begin: 3.54173e+06
0 3.54164e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 170396 TrkackID 0 startx, y, z 121.579 303.515 6.20786  wireno, peakt tpcno 469 3315.52 5 dist 0min T, max_T3230.13 4788.47
no of hits closeby  0   event 170396 TrkackID 0 startx, y, z 121.579 303.515 6.20786  wireno, peakt tpcno 469 3315.52 5 dist 0min T, max_T3230.13 4788.47
26-Sep-2024 12:50:19 CEST  Closed output file "np04hd_raw_run029081_0709_dataflow4_datawriter_0_20240905T041450_reco_stage1_reco_stage2_20240926T105019_keepup.root"
26-Sep-2024 12:50:19 CEST  Closed input file "np04hd_raw_run029081_0709_dataflow4_datawriter_0_20240905T041450_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              66.8585       89.3442       117.375       87.1138       13.5407        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000354081   0.00312201    0.00592806    0.00332578    0.00141088       30     
produce:fembfilter:PDHDFEMBFilter                      0.498817      0.591394       0.76753      0.562351      0.0847252       30     
produce:wclsdatahd:WireCellToolkit                      32.8267       36.3482       42.2323       36.382        2.35905        30     
produce:gaushit:GausHitFinder                          0.335927      0.564662       0.82667       0.57172      0.123009        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000231001   0.000324063   0.000658851   0.000294691   8.73795e-05      30     
produce:reco3d:SpacePointSolver                        0.177706       1.14359       3.81906      0.935842      0.870885        30     
produce:hitpdune:DisambigFromSpacePoints               0.127048      0.467518       1.20238      0.446786      0.246916        30     
produce:pandora:StandardPandora                         5.40654       11.1036       21.7266       10.8062       3.97973        30     
produce:pandoraWriter:StandardPandora                  0.0916101      0.14374      0.229729      0.140188      0.0360832       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.707733       1.75289       3.6658        1.61411      0.676244        30     
produce:pandoraShower:LArPandoraShowerCreation         0.491011       2.2153        4.68711       2.07982       1.01602        30     
produce:pandoracalo:Calorimetry                        0.268953       0.81282       1.77513      0.771057      0.302155        30     
produce:pandoracalonosce:Calorimetry                   0.261168      0.744451       1.45475      0.681825      0.296564        30     
produce:pandorapid:Chi2ParticleID                     0.00109718    0.00180376    0.00356483    0.00171056    0.000500248      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.346162       1.87254       4.10988       1.76882      0.834112        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.329613       1.82533       4.03188       1.65824      0.819197        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0619363      0.13018      0.203827      0.124539      0.0393767       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0242626     0.0477852     0.0771883     0.0456762     0.013913        30     
produce:emtrkmichelid:EmTrackMichelId                   18.5842       27.8818       36.2926       26.9072       4.95995        30     
[art]:TriggerResults:TriggerResultInserter            3.8011e-05    6.55618e-05   0.000119032   6.29525e-05   1.71515e-05      30     
end_path:out1:RootOutput                               9.117e-06    1.86582e-05   3.8161e-05    1.93515e-05   6.19183e-06      30     
end_path:michelremoving:michelremoving                 0.0211626     0.100421      0.327038      0.0698185     0.0726008       30     
end_path:michelremovinggnocchi:michelremoving          0.0223994     0.0944144     0.350374      0.0789466     0.0726304       30     
end_path:calibanagnocchi:CalibAnaTree                  0.168103      0.625262       1.37596      0.550636      0.291136        30     
end_path:out1:RootOutput(write)                        0.358137      0.646638      0.978712       0.64732      0.156313        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4935.61 MB
  Peak resident set size usage (VmHWM): 2349.22 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029081_0709_dataflow4_datawriter_0_20240905T041450_reco_stage1_reco_stage2_20240926T105019_keepup.root
\tHists: np04hd_raw_run029081_0709_dataflow4_datawriter_0_20240905T041450_reco_stage1_reco_stage2_20240926T105019_keepup_hists.root
Forming reco metadata
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
Error in reco metadata
justIN time: 2024-09-29 09:22:47 UTC       justIN version: 01.01.08