Directory R_Tester/helpers/

Total Files:
9
Deleted Files:
1
Lines of Code:
1956

[root]/R_Tester/helpers

Lines of Code

R_Tester/helpers/ Lines of Code

Developers

Author Changes Lines of Code Lines per Change
Totals 49 (100.0%) 827 (100.0%) 16.8
harman 43 (87.8%) 716 (86.6%) 16.6
dav 1 (2.0%) 87 (10.5%) 87.0
bpeterson 2 (4.1%) 19 (2.3%) 9.5
ahumphrey 3 (6.1%) 5 (0.6%) 1.6

Most Recent Commits

harman 2016-12-02 17:18 Rev.: 56048

Added mechanism to modify the src code before running configure command on the nightly RT builds.
- use a fixed random number inside RayGPUKernel.cu so we can compare against GS. Only on cyrus.mech.


0 lines of code changed in 2 files:

  • R_Tester/helpers: build (new)
harman 2016-09-13 09:53 Rev.: 55739

Don't use
--enable-sci-malloc
when running on cyrus.mech.

4 lines of code changed in 1 file:

  • R_Tester/helpers: build (+4)
harman 2016-09-12 16:23 Rev.: 55736

Added "no_cuda" option. Skip the test if this is a cuda enabled build.

Disabled Arches:coal_channel_hi_vel test, covering up a bug in Arches + radprops/tabprobs that causes the
nightly RT scripts to lockup.


7 lines of code changed in 2 files:

  • R_Tester/helpers: runSusTests.py (+7)
ahumphrey 2016-08-26 10:18 Rev.: 55667

Remove SingleDevice (Unified_SingleDevice) debug stream in favor of masking visible devices with the prefered CUDA_VISIBLE_DEVICES env var.

see: http://www.acceleware.com/blog/cudavisibledevices-masking-gpus

0 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (-1)
harman 2016-08-17 15:23 Rev.: 55655

Reworked the verification dialog section. When the user replaces a large number of gold standards
a variable can exceed the system's word limit. Create a temp file that contains
the dialog options and use that instead. This requires the dialog "--file" option.


0 lines of code changed in 2 files:

  • R_Tester/helpers: replace_all_GS (new)
harman 2016-08-15 13:15 Rev.: 55637

compare_uda:
- changed cerr messages -> ostringstream and passing the stream into the abort_uncomparable();
abort_uncomparble(): slightly better reporting to the user why comparison aborted.

compare_sus_runs & runSusTests
- reduce the amount of noise pumped out by local/nightly RT when the input files differ.
- slightly better reporting to the user why a comparison failed.


62 lines of code changed in 3 files:

  • R_Tester/helpers: compare_sus_runs (new), runSusTests.py (+12 -6)
harman 2016-07-26 09:22 Rev.: 55538

On cyrus use the same optimization flags as uintah-build.

0 lines of code changed in 1 file:

  • R_Tester/helpers: build (-4)
bpeterson 2016-07-23 09:48 Rev.: 55535

The gold standard script properly used the MPIRUN environment variable when checking for OpenMPI or MPICH. But the local regression tester didn't. So this fixes that.

3 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (+3 -3)
harman 2016-07-20 16:00 Rev.: 55531

redirect output from cp command to /dev/null. This will hide an error when trying
to copy an input file that doesn't exist with restart from checkpoint tests.

1 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (+1 -1)
harman 2016-07-20 13:08 Rev.: 55530

compare_uda:
- added exit values to the usage

compare_sus_runs:
- fixed faulty logic. If the udas cannot be compared then abort.
- added comments describing the exit codes.

compare_dats:
- added comments describing the exit codes.
- clean up, 2 space indentation, lower case variable names

The following optimized tests will fail since the comparison failures weren't allowed to slip through.

Failed: ARCHES-opt tests
:isotropic-turbulence-decay__NEW: test failed comparison tests

Failed: ICE-opt tests
:CouettePoiseuille: test failed comparison tests
:CouettePoiseuille: (restart) test failed comparison tests

Failed: Wasatch-opt tests
:scalability-test: test failed comparison tests


80 lines of code changed in 3 files:

  • R_Tester/helpers: compare_dats (+49 -32), compare_sus_runs (+31 -12)
harman 2016-07-19 15:28 Rev.: 55528

unalias all commands
use rm -f for files

0 lines of code changed in 2 files:

  • R_Tester/helpers: replace_gold_standard (new)
harman 2016-07-15 10:29 Rev.: 55519

moved guts of compare_sus_runs_by_udas into a function in compare_sus_runs

compare_sus_runs:
- only the owner of the gold standards can copy an uda to that directory.
- overall clean up and improved output.

216 lines of code changed in 2 files:

  • R_Tester/helpers: compare_sus_runs (+216 -46), compare_sus_runs_by_udas (del)
harman 2016-07-13 16:59 Rev.: 55516

Only create a gold standard component directory if the user creating it owns the current directory.

The nightly RT gold standards are group writeable and we don't want the buildbot or another
user that points to the GS directory via the GOLD_STANDARDS environmental variable creating them.


14 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (+14 -4)
harman 2016-07-12 16:18 Rev.: 55513

If the merged malloc_stats file does not exist in the gold standard directory perform the merge, before doing the memory comparison.

0 lines of code changed in 2 files:

  • R_Tester/helpers: mem_leak_check (changed)
harman 2016-07-11 16:44 Rev.: 55510

changes for the new RT machine

1 lines of code changed in 1 file:

  • R_Tester/helpers: build (+1 -1)
harman 2016-07-08 09:57 Rev.: 55497

parse the correct tmp file.

0 lines of code changed in 2 files:

  • R_Tester/helpers: compareUdaFailedTests (changed)
harman 2016-07-08 09:45 Rev.: 55496

# This script runs compare_uda on all failing tests for a component with user defined tolerances
# This is useful if something minor has changed and you want to test if
# the failing tests have excessive numerical fuzz

40 lines of code changed in 1 file:

  • R_Tester/helpers: compareUdaFailedTests (+40)
harman 2016-07-07 17:15 Rev.: 55495

Turn off memory tests if sus was compiled with cuda. The memory results haven't been verified and
are orders of magnitude larger than what a CPU build reports.


124 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (+124 -120)
harman 2016-07-06 08:08 Rev.: 55485

cyrus: enable ICE and MPM.

2 lines of code changed in 1 file:

  • R_Tester/helpers: build (+2)
harman 2016-07-05 17:20 Rev.: 55484

cyrus:
--enable-all-components -> --enable-arches

All components causes the tests to timeout.

1 lines of code changed in 1 file:

  • R_Tester/helpers: build (+1 -1)
harman 2016-06-30 14:48 Rev.: 55481

Fixed timer output format

2 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (+2 -2)
harman 2016-06-29 17:00 Rev.: 55479

updated configure line

4 lines of code changed in 1 file:

  • R_Tester/helpers: build (+4 -1)
ahumphrey 2016-06-22 15:38 Rev.: 55461

Better solution coming down the pipeline soon after discussion with Dan and Dav.
Still good though, that we cleaned up code in this script related to unused machines.

1 lines of code changed in 1 file:

  • R_Tester/helpers: build (+1 -4)
ahumphrey 2016-06-22 13:39 Rev.: 55460

A temporary hack to get around const correctness enforced by the new MPI wrappers. This is ONLY for the old RT/buildbot machine, due to the ancient MPI installations on all the VMs, etc.

NOTE: This quick fix is temporary, and will be removed once the new RT/buildbot machine is online, which should be soon. We simply need to maintain continuous integration and testing until that time. If we need, we will update the MPI on the VMs (e.g. the new RT machine is not online soon enough).

4 lines of code changed in 1 file:

  • R_Tester/helpers: build (+4 -47)
harman 2016-06-10 15:55 Rev.: 55434

runSustests:
added function to return the build path.

Wasatch:
- added example of how to parse a sci_def file for a preprocess flag and
create a new set of tests based on the preprocess flag. Commented out.

5 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (+5)
harman 2016-05-25 11:00 Rev.: 55380

cyrus.mech.utah.edu:
- changed optimization flag from -O3 to -O2 so I can compare against the RT gold standards

27 lines of code changed in 1 file:

  • R_Tester/helpers: build (+27 -17)
harman 2016-05-13 13:27 Rev.: 55349

because osx and linux sed don't behave the same.

0 lines of code changed in 2 files:

  • R_Tester/helpers: modUPS.py (changed)
harman 2016-05-13 11:15 Rev.: 55348

Append a number to the file name. You need to return a unique filename if a base ups file
is modified more than once from multiple modUPS calls.

16 lines of code changed in 1 file:

  • R_Tester/helpers: modUPS.py (+16 -2)
harman 2016-05-11 17:19 Rev.: 55341

modUPS.py

added modUPS2() which allows the user to modify xml tags that appear more than once in a ups file. For example:

RMCRT_DO_perf_GPU_ups = modUPS2( the_dir, \
"RMCRT_DO_perf.ups", \
["/Uintah_specification/Grid/Level/Box[@label=0]/resolution :[32,32,32]",
"/Uintah_specification/Grid/Level/Box[@label=0]/patches :[2,2,2]",
"/Uintah_specification/Grid/Level/Box[@label=1]/resolution :[64,64,64]",
"/Uintah_specification/Grid/Level/Box[@label=1]/patches :[4,4,4]",
"Uintah_specification/RMCRT/nDivQRays : 100"
] )

You could also use it to modify boundary conditons.

I'm not 100% happy with this solution since it depends on (xmlstarlet), which isn't in the standard linux/OSX. It's trival to install
on the debian/ubunbu OSs. If it's not installed it will warn the user and move on.

Examples.py:

Added RMCRT performance tests 1L and DO for the GPU.


93 lines of code changed in 1 file:

  • R_Tester/helpers: modUPS.py (+93 -25)
harman 2016-05-02 15:18 Rev.: 55286

Cyrus: updated cuda version cuda-6.5 -> 7.5

1 lines of code changed in 1 file:

  • R_Tester/helpers: build (+1 -1)
harman 2016-04-28 17:30 Rev.: 55263

set the CUDA_VISIBLE_DEVICES environment variable. Soon this will need
to be machine dependent variable.

2 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (+2 -1)
harman 2016-04-27 11:16 Rev.: 55248

updated configure line for cyrus.mech.utah.edu

2 lines of code changed in 1 file:

  • R_Tester/helpers: build (+2 -1)
harman 2016-04-27 10:34 Rev.: 55247

Older version of python crash on the previous commit. Trying a different approach to determine if a environmental var is set.

2 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (+2 -2)
harman 2016-04-27 10:14 Rev.: 55246

Newer versions of openmpi won't take -x MALLOC_STATS if the environmental variable is unset.
Added a workaround.


9 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (+9 -4)
harman 2016-04-22 09:37 Rev.: 55208

Source the csafe-tester's .cshrc file before running configure command. I had that disabled for a reason and now I can't remember.....



1 lines of code changed in 1 file:

  • R_Tester/helpers: build (+1 -1)
dav 2016-03-14 00:56 Rev.: 55019

This commit changes the way Uintah checks for the file system it
will use to save UDAs. Previously (and still available via a
command line flag to sus) Uintah had every process create a file,
and then every other process look for (some of the files) in order
to determine if everyone was running on the same file system or on
a local system. Currently we don't use any machines that have
local (per node) disks, so we don't need to do this work and,
because on 100K+ jobs, this hammers the file system, can take
minutes, and possibly cause errors, we will now default to assuming
a shared file system (we do a single file check for this).

M CCA/Components/SimulationController/AMRSimulationController.cc

- Remove warning by putting VISIT var into #if HAVE_VISIT.

M CCA/Components/SimulationController/SimulationController.h
M CCA/Components/SimulationController/SimulationController.cc

- Store d_usingLocalFileSystems in the shared state.

M CCA/Components/MPM/ReactionDiffusion/NonLinearDiff1.cc

- Remove warning by putting unused var inside #if.

M CCA/Components/OnTheFlyAnalysis/MinMax.cc
M CCA/Components/ICE/ICE.cc

- Replace GetVisIt() with renamed getVisIt().

M CCA/Components/DataArchiver/DataArchiver.h
M CCA/Components/DataArchiver/DataArchiver.cc

- Main changes to file system check in this file.
- Re-wrote the check for a common FS in setupSharedFileSystem().
- Mostly has process 0 create a file and all the others look for it.
- Put old code that was in initializeOutput() into setupLocalFileSystems().

M CCA/Components/Schedulers/SingleProcessorScheduler.cc
M CCA/Components/Schedulers/UnifiedScheduler.cc
M CCA/Components/Schedulers/MPIScheduler.cc
M CCA/Components/Schedulers/ThreadedMPIScheduler.cc
M CCA/Components/Schedulers/DynamicMPIScheduler.cc

- Minor white space.

M CCA/Components/Schedulers/SchedulerCommon.h
M CCA/Components/Schedulers/SchedulerCommon.cc

- Update names of some class variables to be consistent (_) with
naming convention in file.
- OCD formatting.

M R_Tester/helpers/runSusTests.py
M R_Tester/toplevel/generateGoldStandards.py

- Fix generateGoldStandards check for correct version of python (need 2.7 or better).
- Update "print" statement to be "print()". This allows local RT python scripts
to run under python 3.

M Core/Grid/SimulationState.h
M Core/Grid/SimulationState.cc

- Added d_usingLocalFileSystems var. Few minor whitespace fixes.
- Uintah uses lower case letters to begin functions. Updated setVisIt() and getVisIt()).

M StandAlone/inputs/MPM/disks.ups

- Minor whitespace edit.

M StandAlone/sus.cc

- Check for/handle new command line arg: -local_filesystem
- Most likely no one will ever use this...
- As we do note have access to a system with local file systems, this has not been
tested but the code just passes through to the original code for checking
for a local FS.
- Minor whitespace / formatting.

87 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (+87 -88)
bpeterson 2016-01-04 18:21 Rev.: 54624

All updates from the gpu_dev branch merged back into trunk.

16 lines of code changed in 1 file:

  • R_Tester/helpers: runSusTests.py (+16 -9)
Generated by StatSVN 0.7.0