justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301484.26@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301484.26@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:51:32
SiteCA_SFU
EntryDUNE_CA_SFU_lcg-ce3
Last heartbeat2024-11-23 00:08:45
From worker nodeHostnamecdr232.int.cedar.computecanada.ca
cpuinfoIntel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit84598 (23 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:03:48
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74574126_793_20231208T032512Z_gen_g4_detsim_hitreco__20240510T042206Z_reco2.root
JobscriptExit code0
Real time55m (3324s)
CPU time38m (2330s = 70%)
Outputting started2024-11-22 23:59:14
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74574126_793_20231208T032512Z_gen_g4_detsim_hitreco__20240510T042206Z_reco2.root
Finished2024-11-23 00:08:45
Saved logsjustin-logs:301484.26-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 15:59:02 PST run: 74574126 subRun: 1 event: 79400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 15:59:02 PST run: 74574126 subRun: 1 event: 79400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 15:59:02 PST run: 74574126 subRun: 1 event: 79400
1st wire C:0 T:13 P:2 W:557 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 15:59:02 PST run: 74574126 subRun: 1 event: 79400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 15:59:02 PST run: 74574126 subRun: 1 event: 79400
1st wire C:0 T:13 P:2 W:655 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 15:59:02 PST run: 74574126 subRun: 1 event: 79400
1st wire C:0 T:13 P:2 W:789 does not exist (max wire number: 480)
%MSG
Boundary wire vector sizes: 74, 110, 78
minwire 0: 1221
minwire 1: 1076
minwire 2: 1429
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.906189, 0.00198659, 0.0918247, 
Output 1: 0.105311, 0.818438, 0.0748685, 0.00138283, 
Output 2: 0.0932211, 0.906779, 

574
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2058!
22-Nov-2024 15:59:12 PST  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74574126_793_20231208T032512Z_gen_g4_detsim_hitreco__20240510T042206Z_reco2_reco_data_2024-11-22T_230411Z.root"
22-Nov-2024 15:59:12 PST  Closed input file "root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/fardet-hd/fd/e9/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74574126_793_20231208T032512Z_gen_g4_detsim_hitreco__20240510T042206Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.25944       25.0713       159.083       13.6182       31.5095        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0734739      0.22637      0.782417      0.209084      0.0982932       100    
reco:linecluster:LineCluster                           0.488661       0.76815       1.58126      0.736066      0.135903        100    
reco:trajcluster:TrajCluster                           0.217521      0.499927       6.51059      0.229652      0.951249        100    
reco:pandora:StandardPandora                            0.23026       2.35626       16.1476       1.92403       1.73171        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000181762   0.00494013     0.048475     0.00174139    0.00871795       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000255071    0.0175921     0.769667     0.00340032     0.077303        100    
reco:pandoracalo:Calorimetry                          0.000144794    0.0114074     0.265277     0.00124093     0.0355093       100    
reco:pandorapid:Chi2ParticleID                        5.6888e-05    0.00018831    0.00164201    0.000161009   0.000171774      100    
reco:trkshowersplit:TrackShowerHits                   0.000126275   0.00717872      0.12304     0.000770295    0.0198381       100    
reco:pmtrack:PMAlgTrackMaker                          0.00173677      1.28606       15.3538      0.177457       2.83362        100    
reco:pmtrackcalo:Calorimetry                          0.000123505    0.0061888     0.102956     0.00115999     0.0156249       100    
reco:pmtrackpid:Chi2ParticleID                        5.1313e-05    0.000273064   0.00160024    0.000179528   0.000288784      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000286151     1.16631       12.3302      0.343517       2.28235        100    
reco:pmtrajfitcalo:Calorimetry                        0.000107894    0.0121417     0.270285     0.00153622     0.0364826       100    
reco:pmtrajfitpid:Chi2ParticleID                      4.8468e-05    0.000203872   0.00094868    0.000171101   0.000133212      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00157809      1.69945       25.7703      0.258489       4.43802        100    
reco:pmtracktccalo:Calorimetry                        0.000117644   0.00613232     0.119572     0.00118789     0.0171188       100    
reco:pmtracktcpid:Chi2ParticleID                      5.1479e-05    0.000276615   0.00175318    0.00018803    0.000269576      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000268262     1.15981        11.89       0.428106       2.17121        100    
reco:pmtrajfittccalo:Calorimetry                      0.000111865   0.00883103      0.14515     0.00147933     0.0228611       100    
reco:pmtrajfittcpid:Chi2ParticleID                    4.9112e-05    0.000332378   0.00233702    0.000193301   0.000383697      100    
reco:blurredcluster:BlurredClustering                 9.2869e-05      1.32115       8.2832       0.681212       1.70961        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000166491     9.99409       78.3448       3.75773       15.9993        100    
reco:emshower:EMShower                                0.00023159     0.0230135     0.195233     0.00362832     0.0400031       100    
reco:cvnmap:CVNMapper                                 2.9096e-05     0.0154242     0.0465323     0.0132807     0.0114794       100    
reco:cvneva:CVNEvaluator                              2.4319e-05     0.864994       2.78877       1.07291      0.516639        100    
reco:energyrecnumu:EnergyReco                         0.000386566    0.0432295      1.32858     0.00496811     0.152995        100    
reco:energyrecnue:EnergyReco                          0.000220396   0.00169503     0.0167252    0.000605926   0.00278751       100    
reco:energyrecnc:EnergyReco                           0.00307121    0.00445231     0.0195737    0.00346654    0.00279267       100    
reco:energyrecnumurange:EnergyReco                    0.000246142    0.041049       1.31898      0.0032201     0.151841        100    
reco:energyrecnumumcs:EnergyReco                      0.000918259    0.0428804      1.31932     0.00456324     0.151549        100    
reco:opdec:Deconvolution                               0.223453      0.821873       1.85812      0.760721      0.249729        100    
reco:ophitspe:OpHitFinderDeco                          0.660938       2.35579        3.721        2.34886      0.631373        100    
reco:opflash:OpFlashFinder                            0.00019383    0.00169513    0.00440393    0.00161782    0.000675809      100    
reco:rns:RandomNumberSaver                            2.1988e-05    3.64455e-05   0.00031051    3.2604e-05    2.89344e-05      100    
reco:anglereconue:NuAngularReco                       0.000195841   0.00112897     0.0130994    0.000383832   0.00221021       100    
reco:anglereconumu:NuAngularReco                      0.000114725   0.000987149    0.0127328    0.000286181    0.0020906       100    
reco:anglereconuepfps:NuAngularReco                   0.000175141   0.00113815     0.0127832    0.000419589   0.00211679       100    
reco:anglereconumupfps:NuAngularReco                  0.000165386   0.00109315     0.0128414    0.000379648   0.00211272       100    
[art]:TriggerResults:TriggerResultInserter            1.4407e-05    1.6743e-05    5.2432e-05    1.60515e-05   4.01292e-06      100    
end_path:out1:RootOutput                               2.648e-06    5.70627e-06    1.778e-05    4.6195e-06    3.0115e-06       100    
end_path:out1:RootOutput(write)                        0.0110647     0.295442      0.737322      0.316152      0.153758        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8138.95 MB
  Peak resident set size usage (VmHWM): 2162.5 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74574126_793_20231208T032512Z_gen_g4_detsim_hitreco__20240510T042206Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74574126_793_20231208T032512Z_gen_g4_detsim_hitreco__20240510T042206Z_reco2_reco_2024-11-22T_230411Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74574126_793_20231208T032512Z_gen_g4_detsim_hitreco__20240510T042206Z_reco2_reco_data_2024-11-22T_230411Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 11:19:55 UTC       justIN version: 01.01.09