aboutsummaryrefslogtreecommitdiff
path: root/infra/cifuzz
AgeCommit message (Collapse)Author
2021-10-11Update requirements.txt (#6574)Oliver Chang
2021-10-11[cifuzz] Improve handling of coverage builds. (#6573)jonathanmetzman
Don't delete unaffected fuzzers and don't do bad build check.
2021-10-06Fix CIFuzz coverage generation. (#6523)Oliver Chang
Also clean up the external action definitions: - Set default values for the storage repo branches. - Remove storage repo options from build_fuzzers.
2021-10-05[cifuzz] Use javascript actions library for uploading artifacts (#6552)jonathanmetzman
Delete our python implementation which appears buggy and will be annoying to maintain. Fixes: https://github.com/google/oss-fuzz/issues/6526
2021-10-05[cifuzz][prow] Support docker in docker to support prow. (#6556)jonathanmetzman
2021-10-04clusterfuzzlite: Upload builds after bad build check. (#6531)jonathanmetzman
Fixes: #6525 Depends on: #6530
2021-10-04ClusterFuzzLite: Install nodejs in cifuzz-base. (#6534)jonathanmetzman
We will use this to upload artifacts in the future.
2021-10-01[clusterfuzzlite] Keep unaffected fuzzers when uploading a build. (#6530)jonathanmetzman
Otherwise incomplete builds may be uploaded. Fixes: https://github.com/google/oss-fuzz/issues/6529 Related: https://github.com/google/oss-fuzz/issues/6525
2021-09-24Use libClusterFuzz for reproduction. (#6495)Oliver Chang
Fixes #6326.
2021-09-17Add a cloudbuild.yaml for building CIFuzz base images. (#6457)Oliver Chang
2021-09-15Update libClusterFuzz. (#6445)Oliver Chang
2021-09-15CFLite: Fix corpus pruning for git store. (#6434)Oliver Chang
Fixes #6376.
2021-09-13Use libClusterFuzz for CIFuzz fuzzing and pruning. (#6375)Oliver Chang
Part of #6326.
2021-08-31[languages] Handle language builders in cifuzz and ↵jonathanmetzman
build_and_push_test_images. (#6359)
2021-08-30[cifuzz] Install docker for focal. (#6339)jonathanmetzman
2021-08-26[cifuzz] Fix bug caused by Ubuntu upgrade. (#6318)jonathanmetzman
* [cifuzz] Fix bug caused by Ubuntu upgrade. systemd-detect-virt isn't being found. * fix
2021-08-26[cifuzz] Handle upgrade to Ubuntu 20.04 (#6249)jonathanmetzman
Handle upgrade to Ubuntu 20.04 1. Don't do any special handling for MSAN anymore. It isn't needed. 2. Don't do any special handling for msan-libs-builder it doesn't exist anymore. Related: https://github.com/google/oss-fuzz/issues/6180
2021-08-17Don't upload builds in run_fuzzers. (#6151)Oliver Chang
The current way adds a lot of ordering assumptions, and doesn't fit too well with parallel batch fuzzing either. Add a "upload-build" boolean action input that can be added to "build_fuzzers" to upload latest builds instead. Builds are now uploaded by commit hash, rather than a fixed "latest" name. ClusterFuzzLite's download_latest_build will check the last 3 commits and download the first available build by git hash.
2021-08-12[infra][tests][NFC] Change mocked function prefix from "mocked_" to "mock_" ↵jonathanmetzman
(#6198) Also rename mock_ functions to have impl suffix so we can use mock_ in place of mocked_
2021-08-10[cifuzz] Add pruning task (#6188)jonathanmetzman
Fixes: #6064
2021-08-06[cifuzz][nfc] Switch log info to log error (#6178)jonathanmetzman
2021-08-05[cifuzz] Add feedback for bad build check (#6174)jonathanmetzman
2021-08-05[cifuzz] Fuzz in cifuzz-base (#6142)jonathanmetzman
Fixes: #5926
2021-08-04[infra][NFC] Use one source of truth for engines, languages etc. (#6163)jonathanmetzman
Do this only where it makes sense. For example, since CIFuzz doesn't support dataflow, maintain a separate source of truth.
2021-08-04[CIFuzz] Force external to use .clusterfuzzlite for build integrations. (#6167)jonathanmetzman
2021-08-04[CIFuzz][NFC] Add function for setting env vars in docker command. (#6162)jonathanmetzman
2021-08-03[cifuzz] Only grab github-specific env vars on github (#6150)jonathanmetzman
This removes need for non-OSS-Fuzz users to fake using OSS-Fuzz. Fixes: #6129
2021-08-03[cifuzz][NFC] Move default configs to config_utils.py (#6157)jonathanmetzman
2021-08-03[cifuzz][NFC] Move Workspace to workspace_utils. (#6158)jonathanmetzman
In hindsight, it doesn't have a lot to do with the rest of config_utils. And config_utils is getting crowded.
2021-08-03[cifuzz] Add basic end-to-end tests. (#6139)jonathanmetzman
This test doesn't really do diffing or affected fuzzers properly. Nor does it check the workspace for existence of certain things, nor does check the filesystem for proof things happened. It is still a WIP.
2021-08-02[cifuzz] Create validate method on BaseConfig (#6135)jonathanmetzman
* [cifuzz] Create validate method on BaseConfig Use it to validate that either OSS_FUZZ_PROJECT_NAME or BUILD_INTEGRATION_PATH is set. Also use it to validate that workspace is set (rather than duplicate code). Add tests. * Use env var hack to bypass valdiation * fix * fix * fmt * fix * tmp * fix
2021-07-30[cifuzz] Don't delete base-runner (#6143)jonathanmetzman
We shouldn't delete it, because we need to use it again. This saves about 13 seconds per run. Fixes: #5982
2021-07-30Handle CI fuzz builds from events other than push or pull_request. (#6055)Oliver Chang
Don't try to find unaffected fuzzers by diffing against a base commit as they don't exist in those contexts. For #6053.
2021-07-29[CIFuzz] Allow users to specify if unreproducible crashes are reported (#6138)jonathanmetzman
2021-07-29[NFC][cifuzz] Improve env var handling. (#6137)jonathanmetzman
Also delete useless TODOs.
2021-07-29[CIFuzz] Change behavior of PROJECT_SRC_PATH to be clearer. (#6136)jonathanmetzman
Don't assume that path is relative to workspace if it is not absolute. Only make this assumption on GitHub where it will always be true. Also, add tests.
2021-07-29[cifuzz] Implement get_files_covered_by_target for external users (#6132)jonathanmetzman
This should mostly complete support for affected fuzzers for external users. This implementation is still imperfect however. It relies on the name of the repo being the same as the name of the directory in $SRC/ that the repo is checked out in (i.e. repo must be checked out in $SRC/$REPO_NAME).
2021-07-29[CIFuzz] Don't overwrite the repo in external builds. (#6131)jonathanmetzman
Fixes: #6119 Also add more tests for continuous_integration module.
2021-07-28[CIFuzz][NFC] Add tests for config_utils and do some minor refactoring (#6128)jonathanmetzman
2021-07-28[CIFuzz][NFC] Fix some comments. (#6130)jonathanmetzman
2021-07-28[cifuzz][NFC] Make changes suggested in #6118 (#6127)jonathanmetzman
2021-07-27[NFC][cifuzz] Move Workspace from docker into config_utils. (#6117)jonathanmetzman
It doesn't really fit into docker.
2021-07-27[CIFuzz] Add script to run cifuzz (#6118)jonathanmetzman
This can be used by non-github users. Related: #6100
2021-07-27[cifuzz] Get rid of MANUAL_SRC_PATH (#6120)jonathanmetzman
2021-07-27Add a Git backed filestore. (#6088)Oliver Chang
- Add storage-repo, storage-repo-branch, and storage-repo-branch-coverage fields to the actions, to indicate that the Git filestore should be used. - The CI provided filestore is still used for crashes and builds. - Replace generic Filestore.upload_directory with typed upload methods which matches the download methods. - Rename upload_latest_build to upload_build to make it more generic. - Make artifact name prefixes an implementation detail of the store. For #6052.
2021-07-23[cifuzz] Fix last commit pushed to masterJonathan Metzman
2021-07-23[cifuzz][github_actions] Create methods/functions for uploading without tarJonathan Metzman
This can be useful for artifacts we want to upload that we know do not need to be tarred, such as crashes. It's important not to tar these because they will need to be viewed by users.
2021-07-23Add external actions. (#6086)Oliver Chang
This will be used for testing and can be moved elsewhere later.
2021-07-22[CIFuzz] Fix build uploading. (#6096)jonathanmetzman
Previously, the downloaded build was uploaded instead of the new build. This regression was introduced when the big workspace change was made. Also, add more logging.
2021-07-22[NFC][cifuzz] Add tests for github actions. (#6094)jonathanmetzman
To avoid issues like #6087 before they land.