aboutsummaryrefslogtreecommitdiff
path: root/infra/build_specified_commit.py
AgeCommit message (Collapse)Author
2021-01-20build_specified_commit: Remove an exception. (#5009)Oliver Chang
Return None rather than exceptioning out when a suitable base-builder cannot be found to allow more graceful error handling.
2021-01-14build_specified_commit: Return failure rather than raise exception when ↵Oliver Chang
rebuild fails. (#4964)
2020-12-08Rename BaseRepoManager -> RepoManager. (#4800)Oliver Chang
This was renamed in b0b99d5ccdf5e2e49cfe3138fbcf64e6fef6ea7f
2020-12-07Cifuzz external build (#4656)jonathanmetzman
* Support building fuzzers for projects outside of OSS-Fuzz * Use retry wrapper * Fix some tests.
2020-12-04build_specified_commit: fallback to oldest integration commit. (#4779)Oliver Chang
When we fail a build, we attempt to identify the first OSS-Fuzz commit prior to the upstream commit date. If this does not exist, we bailed out. This commit changes it such that we at least try on the oldest integration commit.
2020-11-24[infra] Add retry decorator and use it. (#4702)jonathanmetzman
2020-06-10build_specified_commit: Handle build.sh which are part of upstream repo. (#3932)Oliver Chang
This is a best effort attempt to parse the relevant copy command from the Dockerfile. Also add a main function to build_specified_commit to make it easier to test.
2020-06-01Retry building project images in build_specified_commit. (#3915)Oliver Chang
To mitigate transient network issues.
2020-05-26build_specified_commit: Don't replace gitdir if already relative. (#3875)Oliver Chang
Upgraded git broke this.
2020-05-25build_specified_commit: revert to using cp. (#3871)Oliver Chang
rsync seems to have disappeared in the latest images somehow, and we can't rely on it always existing.
2020-05-04bisector: Increase rsync performance. (#3757)Oliver Chang
2020-04-28bisector: Re-copy /src in between runs. (#3720)Oliver Chang
Some builds won't work if there are remaining artifacts in /src. Also fix a bug from last commit.
2020-04-28Use base-builder close to commit date. (#3715)Oliver Chang
2020-04-27Address comment from last commit. (#3714)Oliver Chang
2020-04-24bisector: Don't attempt to checkout old OSS-Fuzz revision if it does not ↵Oliver Chang
exist. (#3707)
2020-04-23build_specified_commit: Make submodules work. (#3691)Oliver Chang
Submodules weren't working correctly due to absolute paths being set. We add a step to turn those paths to relative after copying them to host.
2020-04-21Bisector: Be a bit smarter about picking which OSS-Fuzz commit to build ↵Oliver Chang
with. (#3665) When the build fails against HEAD OSS-Fuzz, we find the date of the commit for the project, and use the latest revision of OSS-Fuzz before it to rebuild the project builder container. Subsequent runs will use the last built container, and if that fails that will again find the closest revision of OSS-Fuzz. Also factor BaseRepoManager out of RepoManager to provide a generic repo manager class for dealing with existing checkouts (which don't need a clone).
2020-04-15bisector: Don't clean when checking out commits. (#3652)Oliver Chang
2020-04-15bisector: raise exceptions when building new or old commit fails. (#3653)Oliver Chang
Let build failures continue during the actual bisection for now to keep the bisection going. A future PR can improve the logic of that when it happens.
2020-04-15bisector: Preserve file metadata when copying /src to host. (#3649)Oliver Chang
Otherwise changed timestamps may cause build issues.
2020-04-14Bisector fixes. (#3601)Oliver Chang
- Copy /src from host instead of checking out repo on host. This fixes issues with dependencies in the main repo. - Add some more logging.
2020-04-09Log output when we fail to detect main repo. (#3599)Oliver Chang
2020-02-05Move detect_repo.py script into /opt (#3337)Leo Neat
2020-02-04[Infra] Update execute function in utils.py (#3319)Leo Neat
2020-01-31Moving execute to utils.py (#3313)Leo Neat
2020-01-29[Infra] Update print statements (#3305)Leo Neat
2020-01-29[Infra] CIFuzz pipeline complete. (#3281)Leo Neat
* Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Testing action build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working build * Working fuzzers with out error surface * Working fuzzers with out error surface * Working fuzzers with out error surface * Printing std err * Adding fuzzer timeout * Adding fuzzer timeout * Changing fuzzer timeout to fuzz time * Formatting and refactoring * Spelling in fuzz_target.py * Spelling in fuzz_target.py * Spelling in fuzz_target.py * Upload artifact fix * Upload artifact fix * Upload artifact fix * Upload artifact fix * Upload artifact fix * Upload artifact fix * Upload artifact fix * Refactoring error codes. * reverting helper.py * reverting helper.py * reverting helper.py * chaning method to static * moving cifuzz file * Jonathan changes * Oliver and Jonathan comments * Oliver and Jonathan comments * Oliver and Jonathan comments * Utils unit tests * Test formatting and documentation * Build fuzzer test added * Changed repo manager errors * Unit and integration tests complete * Jonathan comments pt.1 * Jonathan comments pt.1 * Jonathan comments pt.1 * adding cifuzz_test * Build fuzzer test completed * Run fuzzers test finished. * Removed SRC dependency * Jonathan comments pt.2 * Max comments pt.1 * Max comments pt.2 * removing log specified out stream * Max comments pt.3 * Adding OSS_FUZZ_HOME env var * Jonathan comments pt.3 * Formatting * Olivers comments * Jonathan comments
2020-01-23[cifuzz][bisection] Make BuildData a namedtuple (#3282)jonathanmetzman
2020-01-15[infra] Scripts for building fuzzers with CIFuzz (#3207)Leo Neat
2020-01-06[infra] Fixing bisection to work with more OSS-Fuzz projects (#3152)Leo Neat
* Max comments * Added bisection tests * Added test cases * Docker run command added to build_specific commit * Infer main repo uses docker image rather than docker file * Added mores tests for repo infer * With verbosity * Formatting * Bisection fixed * Formatting updates * Oliver small comments. * Script infer main repo * Detect repo and test module finished * Detect main repo from script * Regex searching * Regex searching * Max comments + bisector test script * Oliver comments * Max's comments * String concat update * Jonathan comments
2019-12-16[infra] Add support for Bisecting Git Commits Introducing Crashes(#3119)Leo Neat
2019-12-12[infra] Add functionality to check out a specific commit for a project (#3092)Leo Neat
* Starting the git python API * repo manager working with tests * Docker repo manager working, can update image with specific commit * Working bisection * Formatting and linting * Working bisection * Specific commit checkout * Specific commit checkout * Removed bisector and updated helper * remove branch bug * Max comments * Added tests for infer main repo * Oliver comments * helper.py function names change * Oliver comments pt. 2 * Olivers comments * Formatting updates * Removing DockerRepoManager class * Removing DockerRepoManager class * Changing from copying repo to docker image to mounting repo on docker image * Jonathan comments * Build image from commit tests * Oliver comments pt.3 * Oliver comments pt.4 * Linting * Max comments pt. 2 * change check commit exists * Max comments pt. 3 * Regex updated * Formatting updates