Commit Graph

308 Commits

Author SHA1 Message Date
William F Godoy f02300275b Bump nightly wc time on spock 2021-11-01 15:48:16 -05:00
William F Godoy bc1de4b9eb Enable spock olcf nightly
Add real and complex build tests
Add recursion for nightly runs
2021-10-28 17:11:02 -04:00
William F Godoy 972b382de4 Address CI bug for finding libraries
Add LD_LIBRARY_PATH
2021-10-15 14:25:53 -04:00
William F Godoy be9e2d8774 Self-hosted CI real offload afqmc 2021-10-14 15:37:26 -04:00
William F Godoy 7d96230e94 Add CI for AFQMC CUDA
Add 4 variants to run on self-hosted runner
2021-10-07 11:29:26 -04:00
Ye Luo 0a13c01192 Fix and update nightly test scripts. 2021-10-02 11:29:44 -05:00
William F Godoy 72d4c01983 Add macOS CI on GitHub Actions
gcc-11 real build
brew dependencies
2021-10-01 14:11:08 -05:00
Paul Kent d23dc7e81c Current production scripts 2021-09-21 10:33:13 -04:00
William F Godoy a675c06d47 Enable ASAN/LSAN checks to full suite of deterministic tests
From unit to deterministic using clang
Update docs
2021-08-31 12:24:07 -04:00
William F Godoy 9f061d0e3d Add gcc11-real-werror and gcc11-comple-werror jobs
Run on recent Ubuntu 21 and gcc 11 docker container
2021-08-18 16:48:11 -04:00
William F Godoy d039a7fde8 Add full precision CUDA legacy tests on self-hosted CI
Existing tests only run on half precision on self-hosted CI
real: full, half
complex: full, half
2021-07-26 13:46:52 -04:00
Steven Hahn e38ea65fa8 Remove noasan labal from CI script
Signed-off-by: Steven Hahn <hahnse@ornl.gov>
2021-07-22 20:52:47 -04:00
Ye Luo 3d462bd278 Disable Clang helper threads in github CI offload. 2021-07-13 01:26:06 -05:00
William F Godoy 5df150aebc Check for out-of-source build directory existence
Affect self-hosted runners which must rerun in a clean directory
Add log messages
2021-06-30 12:51:02 -04:00
William F Godoy 275eea7b5a Add set -x in CI script 2021-06-29 21:37:17 -04:00
William F Godoy 0e5243d02e Enable GPU CI on GitHub Actions self-hosted runner
Set new workflow configuration file to trigger with current on-demand
workflow
Set LD_LIBRARY_PATH to point at CUDA runtime libraries
Check user against allowed users to run the workflow in GitHub secrets
2021-06-25 14:33:02 -04:00
Ye Luo eca0605946 Fix github-actions/ci/run_step.sh 2021-05-27 18:20:21 -05:00
William F Godoy 9ede4da94c Limit GitHub Actions asan checks to unit excluding current failures
Configure with non-MPI mode only
2021-05-27 17:54:58 -04:00
William F Godoy a89c13c326 Enable unit test on clang-latest-openmp-offload job GA CI 2021-05-13 15:12:13 -04:00
William F Godoy 3b37248213 Fix typo in run_step.sh script caught by CI 2021-05-13 15:12:13 -04:00
William F Godoy 0e80990707 Add /usr/lib/llvm-12 to LD_LIBRARY_PATH
Needed for clang-latest container for offloading
2021-05-13 15:12:13 -04:00
William F Godoy 4a2f7cd188 Configure GitHub Actions
Enable new matrix job for openmp offload build only
2021-05-13 15:12:13 -04:00
William F Godoy a594f0be25 Enable asan sanitizer on GitHub Actions
Start with Real build
Skip failing tests with noasan label
2021-04-07 21:28:00 -04:00
William F Godoy da94970f5c Add ctest --output-on-failure 2021-04-05 14:31:00 -04:00
William F Godoy 2488a21978 Reorganize GitHub Actions
Enable real and complex builds
Attempt to merge real and complex code coverage in codecov
Unify coverage and sanitizer matrices
2021-04-05 11:04:10 -04:00
William F Godoy 7d4a90a5c7 Add gcovr to docker image
Already updated in DockerHub
Allow user in sudoers to be able to install packages
Remove installing gcovr in coverage pipeline
2021-03-30 21:14:08 -04:00
William F Godoy 48f85274f1 Switch to RelWithDebInfo mode for code coverage 2021-03-30 17:07:01 -04:00
William F Godoy 91cf1239de Add Codecov coverage using gcovr
Uses QMC_COMPLEX=1 and deterministic tests
Enable Codecov configuration
Install gcovr in docker container
2021-03-30 16:04:12 -04:00
William F Godoy 54d3962cc7 Address review comments
Make sanitizer options lower case: none, asan, ubsan, tsan, msan
Check if sanitizer option is not valid
Remove debug mode restriction for asan
Run in RelWithDebInfo mode in GitHub Actions CI
Clean up previous LLVM sanitizers implementation
2021-03-24 16:23:46 -04:00
William F Godoy 209a698e91 Set recommended MPI compiler flags
To not overwrite CC and CXX for clang
2021-03-24 16:23:46 -04:00
William F Godoy 91875ae32d Change GitHub actions workflow names
Add openmpi in sanitizer workflows names to enable oversubscription and
be more explicit
Add log messages
2021-03-24 16:23:46 -04:00
William F Godoy a705ef986b Sanitizers workflows in GitHub Actions
Use Clang sanitizers
Add ASAN, UBSAN, TSAN, MSAN workflows
Separate dynamic checks from regular Linux builds
2021-03-24 16:23:46 -04:00
Paul Kent 4b8f5c1b2c Update nightly testing versions 2021-03-24 14:06:54 -04:00
William F Godoy 206f5f60b0 Address reviewers comments
Move GitHub Actions scripts to tests/test_automation
Add CMake compiler arguments
2021-03-19 14:08:24 -04:00
Paul Kent 589d2a7ed3 Reduce soa references 2021-02-16 10:44:45 -05:00
Paul Kent 0dc9a36c3c Remove oxygen files 2021-02-15 11:00:41 -05:00
Paul Kent 8ee169a927 Update ORNL nightlies 2021-02-15 10:30:03 -05:00
Paul Kent f47418963c Current spack recipes 2021-01-05 20:45:22 -05:00
Ye Luo 1068556f66 Remove ENABLE_MKL in docs and test scripts. 2020-10-28 22:18:24 -05:00
Paul Kent ea0c84e78f Latest versions 2020-09-04 11:46:06 -04:00
Ye Luo 6fa798dab8 Add Ye-Dell-Laptop nightly scripts. 2020-09-02 18:39:22 -05:00
Ye Luo d9ec795578 Add Ye-Ryzen-Box nightly script. 2020-09-02 18:36:57 -05:00
Ye Luo 39d10c4c10 Update bora test script. 2020-09-02 18:32:23 -05:00
Ye Luo 0deb911fe9 Update bora nightly test script. 2020-08-25 16:36:42 -05:00
Ye Luo 2048b1d128 Use RESOURCE_LOCK to run GPU tests exclusively. 2020-07-02 11:29:22 -05:00
Paul Kent 113042b1b2 Updated nightlies 2020-06-18 14:45:32 -04:00
Ye Luo 36eae67e38 Update nightly_anl_bora script. 2020-06-15 15:52:31 -05:00
Ye Luo 28c021b8e1 Update theta and bora nightly scripts 2020-06-05 20:51:52 -05:00
Paul Kent 5f90d8f928 update nightly scripts 2020-05-22 14:49:51 -04:00
Paul Kent f406c69307 Update nightly integration test scripts 2020-05-19 13:29:27 -04:00
Paul Kent fff5d4330e Rearrange nightlies 2020-04-16 13:13:03 -04:00
Paul R. C. Kent 405f6ee370
Fix typos 2020-04-01 21:25:00 -04:00
Paul R. C. Kent 96eb26cc3d
Merge branch 'develop' into SpackRegressionTestUpdateMarch2020 2020-04-01 21:21:22 -04:00
naromero77 eab5e3e285 README file for Spack integration tests. 2020-04-01 16:27:42 -05:00
naromero77 b003bc4f16 move and rename Spack integration tests 2020-04-01 16:27:13 -05:00
naromero77 b665a39efb Test AFQMC seperately 2020-03-27 11:38:55 -05:00
naromero77 67341f6259 Default compiler preferences now set in packages.yaml. 2020-03-27 11:26:35 -05:00
naromero77 895e2c6940 Installing Python via Spack frequently fails. Use available version of Python 3.x provided by Argonne GCE. 2020-03-27 11:22:14 -05:00
naromero77 53b121abf9 Add libflame and blis. Also, for non-intel MKL cases use fftw compiled with gcc 2020-03-27 11:13:52 -05:00
naromero77 5ba8428856 Bump up latest version of QMCPACK that is being tested. 2020-03-27 11:12:47 -05:00
naromero77 2ae7a75605 Add Spack regression test YAML config YAML files. 2020-03-27 11:11:38 -05:00
Peter Doak 05bc263c87 removing uneeded parameter to commonpipline from Jenkinsfile_vm 2020-03-26 20:36:09 -04:00
Peter Doak a97fce7867 trigger CI a last time and fix prefix for vm 2020-03-26 14:42:01 -04:00
Peter Doak c2877aae05 prefix shouldn't have trailing_ 8 threads per build oxygen 2020-03-26 14:30:58 -04:00
Peter Doak 366a7c49ab adding custom workspace and thread control to all oxygen Jenkinsfile 2020-03-26 13:47:13 -04:00
Peter Doak 90a5d55d00 repeating somewhat less bash script 2020-03-26 13:43:06 -04:00
Peter Doak 5fc4311a27 update to test on vm 2020-03-26 13:06:21 -04:00
Peter Doak 479ffc424d better way to handle custom workspac 2020-03-26 12:51:05 -04:00
Peter Doak 7f15b96289 using simpler path solution and propagating it 2020-03-26 11:31:41 -04:00
Peter Doak 4d96435ed8 getting out of my own way 2020-03-26 11:22:07 -04:00
Peter Doak cbf3747a49 this should fix the workspace relative patch issue 2020-03-26 11:20:20 -04:00
Peter Doak 4a78e9aa11 Is ParentWorkspace wrong on oxygen 2020-03-26 10:55:58 -04:00
Peter Doak 0fef7f7042 Merge branch 'CI_knowns_its_nexus' of github.com:PDoakORNL/qmcpack into CI_knowns_its_nexus 2020-03-26 10:51:24 -04:00
Peter Doak b50a065532 checking to see if bug is in ram_disk path 2020-03-26 10:50:35 -04:00
Peter Doak 1d20c8dfe3
Merge branch 'develop' into CI_knowns_its_nexus 2020-03-26 10:32:58 -04:00
Peter Doak 783de40cec find the source in parent workspace 2020-03-25 17:03:02 -04:00
Paul Kent d6a0d024c2 Nitrogen updates 2020-03-24 16:17:19 -04:00
Peter Doak d54c07d72c
Ci pipeline network retry (#2351)
Ci pipeline network retry
2020-03-20 13:35:35 -05:00
Paul Kent 55e1ffff2c Fix script locations 2020-03-11 13:08:02 -04:00
Peter Doak a90b052352
New setup for oxygen CI (#2322)
* New setup for oxygen CI

Testing easier pipeline config Jenkinsfile

misunderstood file format?

attempting to keep enough to find issue

nodes are somewhat puzzling

fixing directories maybe

continuing struggle with pipeline syntax

considering taking this to test repo

now I see what label refers to I think

adding actual paths for configuration

adding boost

setting up matrix based pipeline, reduces amount of copy paste

jenkinsfile syntax

jenkins runtime behavior

jenkins syntax

jenkins relative directories

jenkin permissions

jenkin more relative path issue

better thread control

small improvement to pipeline output

moving Jenkinsfile to better longterm location

first try at gpu build test pipline

guessing at pipeline DSL syntax

another try

working workaround for split paths

giving up on running groovy script in env section

adding u+x to jenkins_build_gpu.sh

obviously mpi can't be build with a compiler nvcc snubs

moving spack for jenkins

wrong path fixed

consistent setup between cpu and gpu ci

captilization of failFast

vexing syntax

undeleting JNK_THREADS

failed to change gpu to cpu

* added missing spack env file

* renaming files to reflect site and machine

* updating for revised file names

* alternate setup for email

* better single email handling

* breakage to test fail email

* another syntax fix for email

* hopefully adding log attachment

* hopefully adding default recipients from global config

* field labels and tokens for email-ext aren't consistent

* tricky syntax

* needs to be string not array list

* this could be the right way to get maintainer emails in

* these belong in a separate secure repo

* fixed pipeline type faster fail

* attempt to diagnose missing binding

* I miss C++ template errrors

* maybe this works

* I think this is the final form for the Jenkinsfile's

* removed breakage

* even with implicit loading library needs to be called

* adding enable_cuda variant

* blind stab at new variant with maximum logical deduplication

* deduplicating cpu variant

* so syntax

* fixing execute permission

* fix bad relative path

* fixing relative path issue and naming

* last variant using common_pipeline.sh

* update readme, remove files made redundant

* added todo to use spack_supported_package_versions.sh

* fixed goovy Map syntax

* Fix bad ENABLE_SOA flag
2020-03-04 01:59:03 +07:00
Ye Luo 78aea5a21b Merge branch 'refine-cmake-dependence' into use-more-FindMPI 2020-02-07 13:06:23 +08:00
Peter Doak 7bdfd5a839 added missing spaces 2020-02-06 06:56:31 -05:00
Ye Luo 65609be789 Use MPI::MPI_CXX target and rely on dependency. 2020-02-06 16:40:13 +08:00
Peter Doak 20f6690b1d Apply QMC_NO_SLOW_CUSTOM_TESTING_COMMANDS to CI scripts 2020-02-05 23:29:56 -05:00
Paul R. C. Kent f3f08561d2
Add nexus ntest to jenkins_oxygen_cpu.sh
Full precision real build only since nexus ntest tests are independent of QMCPACK
2020-01-31 11:28:26 -05:00
Paul Kent 3be67408bf CUDA 10.2 2020-01-14 17:19:14 -05:00
Paul Kent a7892bfc2b Update oxygen nightly configuration 2020-01-14 13:02:19 -05:00
Ye Luo 04a4db31bb Remove testing scripts for retired machine. 2020-01-13 04:40:48 -06:00
Ye Luo 61489edb8f Enable nightly tests on ALCF Theta. 2020-01-13 04:38:34 -06:00
Ye Luo 439c1f3b45 Remove rhea CI scripts. 2020-01-10 10:52:25 +08:00
Ye Luo a55679ed0e Reduce all the CI tests' timeout. 2020-01-10 10:52:25 +08:00
Ye Luo 9e431a04e3 Fix parallel testing on bora. 2019-12-20 23:45:09 -06:00
naromero77 2a9b0d90aa Excise lines from local testing. 2019-12-11 21:34:07 -06:00
naromero77 5f3fb07d6a strings in single quotes have fewer suprises than springs with double quotes in bash. 2019-12-11 12:17:46 -06:00
naromero77 670a64ef5d Erase prior SPACK_CONFLICTS file at every new start. 2019-12-11 12:13:58 -06:00
naromero77 109f43ea63 Less ambiguous syntax for conditional. 2019-12-11 12:12:46 -06:00
naromero77 433db5d90e Need GCC 7.x series to support CUDA. Bump up to latest CUDA version. 2019-12-11 12:11:12 -06:00
naromero77 eed44877ea Log conflicts and failures seperately. 2019-12-11 12:09:41 -06:00
naromero77 c43afa59b9 Better to have more logging information on by default. 2019-12-11 12:07:01 -06:00
naromero77 11e6fd9e2c Need additional shell script to support CELS computing environment. 2019-12-11 12:06:18 -06:00