Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/vuln: tests consistently failing on Android builders due to missing "compile" tool starting 2022-11-02 #57147

Closed
bcmills opened this issue Dec 7, 2022 · 5 comments
Assignees
Labels
FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done. OS-Android Testing An issue that has been verified to require only test changes, not just a test failure. vulncheck or vulndb Issues for the x/vuln or x/vulndb repo x/vuln

Comments

@bcmills
Copy link
Contributor

bcmills commented Dec 7, 2022

--- FAIL: TestInits (0.20s)
    callstacks_test.go:191: err: exit status 2: stderr: go: no such tool "compile"
        
FAIL
exitcode=1
FAIL	golang.org/x/vuln/internal/govulncheck	46.719s

ok  	golang.org/x/vuln/internal/semver	46.828s

ok  	golang.org/x/vuln/internal/web	47.031s

ok  	golang.org/x/vuln/osv	46.925s
--- FAIL: TestSlicing (0.04s)
    slicing_test.go:96: err: exit status 2: stderr: go: no such tool "compile"
        
--- FAIL: TestImports (0.95s)
    source_test.go:117: err: exit status 2: stderr: go: no such tool "compile"
        
--- FAIL: TestRequires (0.07s)
    source_test.go:259: err: exit status 2: stderr: go: no such tool "compile"
        
--- FAIL: TestCalls (0.06s)
    source_test.go:496: err: exit status 2: stderr: go: no such tool "compile"
        
--- FAIL: TestFiltering (0.06s)
    source_test.go:595: err: exit status 2: stderr: go: no such tool "compile"
        
--- FAIL: TestAllSymbolsVulnerable (0.05s)
    source_test.go:686: err: exit status 2: stderr: go: no such tool "compile"
        
--- FAIL: TestNoSyntheticNodes (0.04s)
    source_test.go:752: err: exit status 2: stderr: go: no such tool "compile"
        
--- FAIL: TestRecursion (0.07s)
    source_test.go:833: err: exit status 2: stderr: go: no such tool "compile"
        
--- FAIL: TestConvert (0.09s)
    vulncheck_test.go:414: err: exit status 2: stderr: go: no such tool "compile"
        
FAIL
exitcode=1
FAIL	golang.org/x/vuln/vulncheck	48.377s

greplogs -l -e '\Aandroid.*(\n.*)*no such tool "compile"(.*\n)*FAIL\s+golang\.org/x/vuln' --since=2022-07-01 --details

2022-12-07T18:18:50-05fb725-7c7cd56/android-386-emu
2022-12-07T18:18:50-05fb725-7c7cd56/android-amd64-emu
2022-12-07T16:56:12-05fb725-e57e673/android-386-emu
2022-12-07T16:56:12-05fb725-e57e673/android-amd64-emu
2022-12-07T16:49:08-05fb725-3ec5085/android-386-emu
2022-12-07T16:49:08-05fb725-3ec5085/android-amd64-emu
2022-12-07T16:26:42-05fb725-f715d28/android-386-emu
2022-12-07T16:26:42-05fb725-f715d28/android-amd64-emu
2022-12-07T16:09:09-05fb725-7ed50cf/android-386-emu
2022-12-07T16:09:09-05fb725-7ed50cf/android-amd64-emu
2022-12-07T14:20:49-05fb725-a4a86c7/android-386-emu
2022-12-07T14:20:49-05fb725-a4a86c7/android-amd64-emu
2022-12-07T03:45:50-05fb725-a398963/android-386-emu
2022-12-07T03:45:50-05fb725-a398963/android-amd64-emu
2022-12-07T00:51:44-05fb725-8cd931f/android-386-emu
2022-12-07T00:51:44-05fb725-8cd931f/android-amd64-emu
2022-12-07T00:25:27-05fb725-10bb003/android-386-emu
2022-12-07T00:25:27-05fb725-10bb003/android-amd64-emu
2022-12-06T23:50:47-05fb725-7dc9fcb/android-386-emu
2022-12-06T23:50:47-05fb725-7dc9fcb/android-amd64-emu
2022-12-06T22:07:25-05fb725-e535d67/android-386-emu
2022-12-06T22:07:25-05fb725-e535d67/android-amd64-emu
2022-12-06T20:53:50-05fb725-89871dd/android-386-emu
2022-12-06T20:53:50-05fb725-89871dd/android-amd64-emu
2022-12-06T20:19:47-05fb725-5167e5c/android-386-emu
2022-12-06T20:19:47-05fb725-5167e5c/android-amd64-emu
2022-12-06T19:52:35-05fb725-03bf6f4/android-386-emu
2022-12-06T19:52:35-05fb725-03bf6f4/android-amd64-emu
2022-12-06T18:32:51-05fb725-dfd13ce/android-386-emu
2022-12-06T18:32:51-05fb725-dfd13ce/android-amd64-emu
2022-12-06T18:11:17-05fb725-98da0fb/android-386-emu
2022-12-06T18:11:17-05fb725-98da0fb/android-amd64-emu
2022-12-06T15:55:39-05fb725-fe67a21/android-386-emu
2022-12-06T15:55:39-05fb725-fe67a21/android-amd64-emu
2022-12-06T05:12:12-05fb725-1eb0465/android-386-emu
2022-12-06T05:12:12-05fb725-1eb0465/android-amd64-emu
2022-12-05T23:21:07-05fb725-9dde2de/android-386-emu
2022-12-05T23:21:07-05fb725-9dde2de/android-amd64-emu
2022-12-05T22:29:44-05fb725-0b323a3/android-386-emu
2022-12-05T22:29:44-05fb725-0b323a3/android-amd64-emu
2022-12-05T22:22:11-05fb725-9e05963/android-386-emu
2022-12-05T22:22:11-05fb725-9e05963/android-amd64-emu
2022-12-05T22:01:50-05fb725-185e1a7/android-386-emu
2022-12-05T22:01:50-05fb725-185e1a7/android-amd64-emu
2022-12-05T20:45:49-05fb725-a5b10be/android-386-emu
2022-12-05T20:45:49-05fb725-a5b10be/android-amd64-emu
2022-12-05T19:25:34-05fb725-b45cb0c/android-386-emu
2022-12-05T19:25:34-05fb725-b45cb0c/android-amd64-emu
2022-12-05T18:57:04-05fb725-2986358/android-386-emu
2022-12-05T18:57:04-05fb725-2986358/android-amd64-emu
2022-12-05T16:41:48-05fb725-ad55b87/android-386-emu
2022-12-05T16:41:48-05fb725-ad55b87/android-amd64-emu
2022-12-03T17:08:51-05fb725-3a7a528/android-386-emu
2022-12-03T17:08:51-05fb725-3a7a528/android-amd64-emu
2022-12-02T23:40:37-05fb725-c0497d1/android-386-emu
2022-12-02T23:40:37-05fb725-c0497d1/android-amd64-emu
2022-12-02T22:24:00-05fb725-7ab3615/android-386-emu
2022-12-02T22:24:00-05fb725-7ab3615/android-amd64-emu
2022-12-02T21:15:10-05fb725-45f5ef4/android-386-emu
2022-12-02T21:15:10-05fb725-45f5ef4/android-amd64-emu
2022-11-22T16:07:28-fac3670-9160e15/android-386-emu
2022-11-22T16:07:28-fac3670-9160e15/android-amd64-emu
2022-11-22T15:58:43-fac3670-5c9a506/android-386-emu
2022-11-22T15:58:43-fac3670-5c9a506/android-amd64-emu
2022-11-22T14:09:24-fac3670-9efc5a5/android-386-emu
2022-11-22T14:09:24-fac3670-9efc5a5/android-amd64-emu
2022-11-22T03:11:31-fac3670-6a72514/android-386-emu
2022-11-22T03:11:31-fac3670-6a72514/android-amd64-emu
2022-11-22T02:52:19-fac3670-f41fdc1/android-386-emu
2022-11-22T02:52:19-fac3670-f41fdc1/android-amd64-emu
2022-11-22T02:27:05-fac3670-14a4138/android-386-emu
2022-11-22T02:27:05-fac3670-14a4138/android-amd64-emu
2022-11-22T01:42:49-fac3670-1521199/android-386-emu
2022-11-22T01:42:49-fac3670-1521199/android-amd64-emu
2022-11-21T22:49:25-fac3670-1c9eba1/android-386-emu
2022-11-21T22:49:25-fac3670-1c9eba1/android-amd64-emu
2022-11-21T22:43:41-fac3670-7656cba/android-386-emu
2022-11-21T22:43:41-fac3670-7656cba/android-amd64-emu
2022-11-21T22:21:04-fac3670-d58f2e7/android-386-emu
2022-11-21T22:21:04-fac3670-d58f2e7/android-amd64-emu
2022-11-21T22:16:06-fac3670-995c0f3/android-386-emu
2022-11-21T22:16:06-fac3670-995c0f3/android-amd64-emu
2022-11-21T21:55:53-fac3670-089dcd7/android-386-emu
2022-11-21T21:55:53-fac3670-089dcd7/android-amd64-emu
2022-11-21T21:14:38-fac3670-85a2c19/android-386-emu
2022-11-21T21:14:38-fac3670-85a2c19/android-amd64-emu
2022-11-16T20:18:50-50a0e29-e6eaf39/android-386-emu
2022-11-16T20:18:50-50a0e29-e6eaf39/android-amd64-emu
2022-11-16T19:00:20-50a0e29-cd9d26f/android-386-emu
2022-11-16T19:00:20-50a0e29-cd9d26f/android-amd64-emu
2022-11-16T17:22:19-50a0e29-8c17505/android-386-emu
2022-11-16T17:22:19-50a0e29-8c17505/android-amd64-emu
2022-11-16T16:42:18-50a0e29-0266671/android-386-emu
2022-11-16T16:42:18-50a0e29-0266671/android-amd64-emu
2022-11-16T16:25:58-50a0e29-38218f3/android-386-emu
2022-11-16T16:25:58-50a0e29-38218f3/android-amd64-emu
2022-11-16T15:10:02-50a0e29-70f585f/android-386-emu
2022-11-16T15:10:02-50a0e29-70f585f/android-amd64-emu
2022-11-16T14:42:36-50a0e29-978ce7e/android-386-emu
2022-11-16T14:42:36-50a0e29-978ce7e/android-amd64-emu
2022-11-16T14:38:38-50a0e29-7c8c209/android-386-emu
2022-11-16T14:38:38-50a0e29-7c8c209/android-amd64-emu
2022-11-16T13:26:16-50a0e29-5947a07/android-386-emu
2022-11-16T13:26:16-50a0e29-5947a07/android-amd64-emu
2022-11-16T04:04:52-50a0e29-b1678e5/android-386-emu
2022-11-16T04:04:52-50a0e29-b1678e5/android-amd64-emu
2022-11-16T02:02:26-50a0e29-cb5534c/android-386-emu
2022-11-16T02:02:26-50a0e29-cb5534c/android-amd64-emu
2022-11-15T23:48:34-50a0e29-c085c6c/android-386-emu
2022-11-15T23:48:34-50a0e29-c085c6c/android-amd64-emu
2022-11-15T22:52:03-50a0e29-8477562/android-386-emu
2022-11-15T22:52:03-50a0e29-8477562/android-amd64-emu
2022-11-11T16:04:21-3af8368-fcd14bd/android-386-emu
2022-11-11T16:04:21-3af8368-fcd14bd/android-amd64-emu
2022-11-11T14:51:14-3af8368-fffda6b/android-386-emu
2022-11-11T14:51:14-3af8368-fffda6b/android-amd64-emu
2022-11-11T14:48:29-3af8368-73f987c/android-386-emu
2022-11-11T14:48:29-3af8368-73f987c/android-amd64-emu
2022-11-11T04:31:34-3af8368-185766d/android-386-emu
2022-11-11T04:31:34-3af8368-185766d/android-amd64-emu
2022-11-11T01:42:03-3af8368-d62f8d5/android-386-emu
2022-11-11T01:42:03-3af8368-d62f8d5/android-amd64-emu
2022-11-11T01:35:11-3af8368-ffc4496/android-386-emu
2022-11-11T01:35:11-3af8368-ffc4496/android-amd64-emu
2022-11-11T01:29:15-3af8368-4d37f96/android-386-emu
2022-11-11T01:29:15-3af8368-4d37f96/android-amd64-emu
2022-11-10T23:11:59-3af8368-1b03568/android-386-emu
2022-11-10T23:11:59-3af8368-1b03568/android-amd64-emu
2022-11-10T22:41:06-3af8368-5497300/android-386-emu
2022-11-10T22:41:06-3af8368-5497300/android-amd64-emu
2022-11-10T21:11:02-3af8368-79950a4/android-386-emu
2022-11-10T21:11:02-3af8368-79950a4/android-amd64-emu
2022-11-10T20:44:45-3af8368-14018c8/android-386-emu
2022-11-10T20:44:45-3af8368-14018c8/android-amd64-emu
2022-11-10T20:38:57-3af8368-d96eb82/android-386-emu
2022-11-10T20:38:57-3af8368-d96eb82/android-amd64-emu
2022-11-10T20:24:57-3af8368-f57ebed/android-386-emu
2022-11-10T20:24:57-3af8368-f57ebed/android-amd64-emu
2022-11-09T20:13:45-fc17c87-d02fceb/android-386-emu
2022-11-09T20:13:45-fc17c87-d02fceb/android-amd64-emu
2022-11-09T19:40:02-1943a78-d02fceb/android-386-emu
2022-11-09T19:40:02-1943a78-d02fceb/android-amd64-emu
2022-11-09T18:21:12-1943a78-342751a/android-386-emu
2022-11-09T18:21:12-1943a78-342751a/android-amd64-emu
2022-11-09T18:07:37-1943a78-4f13067/android-386-emu
2022-11-09T18:07:37-1943a78-4f13067/android-amd64-emu
2022-11-09T18:05:45-1943a78-2f4d5c3/android-386-emu
2022-11-09T18:05:45-1943a78-2f4d5c3/android-amd64-emu
2022-11-09T17:41:34-6a111ce-2f4d5c3/android-386-emu
2022-11-09T17:41:34-6a111ce-2f4d5c3/android-amd64-emu
2022-11-09T17:33:07-6a111ce-7a92c4f/android-386-emu
2022-11-09T17:33:07-6a111ce-7a92c4f/android-amd64-emu
2022-11-09T16:52:00-6a111ce-9ff2a66/android-386-emu
2022-11-09T16:52:00-6a111ce-9ff2a66/android-amd64-emu
2022-11-09T14:47:58-55c64d8-9ff2a66/android-386-emu
2022-11-09T14:47:58-55c64d8-9ff2a66/android-amd64-emu
2022-11-09T14:05:53-55c64d8-821e310/android-386-emu
2022-11-09T14:05:53-55c64d8-821e310/android-amd64-emu
2022-11-09T06:30:59-55c64d8-3a41094/android-386-emu
2022-11-09T06:30:59-55c64d8-3a41094/android-amd64-emu
2022-11-09T06:10:55-55c64d8-268f462/android-386-emu
2022-11-09T06:10:55-55c64d8-268f462/android-amd64-emu
2022-11-09T04:03:15-55c64d8-6b45863/android-386-emu
2022-11-09T04:03:15-55c64d8-6b45863/android-amd64-emu
2022-11-09T03:01:33-55c64d8-27c3814/android-386-emu
2022-11-09T03:01:33-55c64d8-27c3814/android-amd64-emu
2022-11-08T23:11:32-55c64d8-fe4e59e/android-386-emu
2022-11-08T23:11:32-55c64d8-fe4e59e/android-amd64-emu
2022-11-08T22:14:56-55c64d8-896faf3/android-386-emu
2022-11-08T22:14:56-55c64d8-896faf3/android-amd64-emu
2022-11-08T21:50:06-55c64d8-8befe0e/android-386-emu
2022-11-08T21:50:06-55c64d8-8befe0e/android-amd64-emu
2022-11-08T21:31:58-55c64d8-2df6c1a/android-386-emu
2022-11-08T21:31:58-55c64d8-2df6c1a/android-amd64-emu
2022-11-08T21:26:09-55c64d8-9944ba7/android-386-emu
2022-11-08T21:26:09-55c64d8-9944ba7/android-amd64-emu
2022-11-08T20:59:42-55c64d8-a7538d7/android-386-emu
2022-11-08T20:59:42-55c64d8-a7538d7/android-amd64-emu
2022-11-08T14:15:17-4f561ca-be3184c/android-386-emu
2022-11-08T14:15:17-4f561ca-be3184c/android-amd64-emu
2022-11-08T13:51:16-4f561ca-5b42f89/android-386-emu
2022-11-08T13:51:16-4f561ca-5b42f89/android-amd64-emu
2022-11-08T08:14:37-4f561ca-0b7aa9f/android-386-emu
2022-11-08T08:14:37-4f561ca-0b7aa9f/android-amd64-emu
2022-11-08T05:24:43-4f561ca-9860faa/android-386-emu
2022-11-08T05:24:43-4f561ca-9860faa/android-amd64-emu
2022-11-03T21:13:39-6f7a8cb-69abfab/android-386-emu
2022-11-03T21:13:39-6f7a8cb-69abfab/android-amd64-emu
2022-11-03T20:35:31-6f7a8cb-aa6240a/android-386-emu
2022-11-03T20:35:31-6f7a8cb-aa6240a/android-amd64-emu
2022-11-03T20:32:06-6f7a8cb-48ff5c1/android-386-emu
2022-11-03T20:32:06-6f7a8cb-48ff5c1/android-amd64-emu
2022-11-03T19:59:19-6f7a8cb-d031e9e/android-386-emu
2022-11-03T19:59:19-6f7a8cb-d031e9e/android-amd64-emu
2022-11-03T19:40:36-6f7a8cb-c065bc7/android-386-emu
2022-11-03T19:40:36-6f7a8cb-c065bc7/android-amd64-emu
2022-11-03T19:34:40-6f7a8cb-3511c82/android-386-emu
2022-11-03T19:34:40-6f7a8cb-3511c82/android-amd64-emu
2022-11-03T18:33:42-6f7a8cb-44cabb8/android-386-emu
2022-11-03T18:33:42-6f7a8cb-44cabb8/android-amd64-emu
2022-11-03T18:31:08-6f7a8cb-0b76e32/android-386-emu
2022-11-03T18:31:08-6f7a8cb-0b76e32/android-amd64-emu
2022-11-03T17:41:32-f9bfb22-0b76e32/android-386-emu
2022-11-03T17:41:32-f9bfb22-0b76e32/android-amd64-emu
2022-11-03T17:08:32-f9bfb22-667c53e/android-386-emu
2022-11-03T17:08:32-f9bfb22-667c53e/android-amd64-emu
2022-11-03T17:01:54-995372c-667c53e/android-386-emu
2022-11-03T17:01:54-995372c-667c53e/android-amd64-emu
2022-11-03T16:00:30-995372c-b07e845/android-386-emu
2022-11-03T16:00:30-995372c-b07e845/android-amd64-emu
2022-11-03T15:53:45-995372c-932330f/android-386-emu
2022-11-03T15:53:45-995372c-932330f/android-amd64-emu
2022-11-03T15:34:01-995372c-ebb71ad/android-386-emu
2022-11-03T15:34:01-995372c-ebb71ad/android-amd64-emu
2022-11-03T15:18:40-995372c-a367981/android-386-emu
2022-11-03T15:18:40-995372c-a367981/android-amd64-emu
2022-11-03T14:38:29-995372c-56ad133/android-386-emu
2022-11-03T14:38:29-995372c-56ad133/android-amd64-emu
2022-11-03T12:16:35-995372c-2af48cb/android-386-emu
2022-11-03T12:16:35-995372c-2af48cb/android-amd64-emu
2022-11-02T21:06:46-995372c-fb4f7fd/android-386-emu
2022-11-02T21:06:46-995372c-fb4f7fd/android-amd64-emu
2022-11-02T20:14:56-995372c-a5b4283/android-386-emu
2022-11-02T20:14:56-995372c-a5b4283/android-amd64-emu
2022-11-02T19:08:10-995372c-ca8b319/android-386-emu
2022-11-02T19:08:10-995372c-ca8b319/android-amd64-emu
2022-11-02T18:43:27-995372c-be7068f/android-386-emu
2022-11-02T18:43:27-995372c-be7068f/android-amd64-emu
2022-11-02T18:19:04-995372c-07a70bc/android-386-emu
2022-11-02T18:19:04-995372c-07a70bc/android-amd64-emu
2022-11-02T18:15:21-995372c-581a822/android-386-emu
2022-11-02T18:15:21-995372c-581a822/android-amd64-emu
2022-11-02T17:01:39-995372c-03f6d81/android-386-emu
2022-11-02T17:01:39-995372c-03f6d81/android-amd64-emu
2022-11-02T14:43:52-995372c-3ba3b48/android-386-emu
2022-11-02T14:43:52-995372c-3ba3b48/android-amd64-emu

(236 matching logs)

(attn @golang/vulndb)

@bcmills bcmills added Testing An issue that has been verified to require only test changes, not just a test failure. OS-Android NeedsFix The path to resolution is known, but the work has not been done. vulncheck or vulndb Issues for the x/vuln or x/vulndb repo x/vuln labels Dec 7, 2022
@gopherbot gopherbot modified the milestones: Unreleased, vuln/unplanned Dec 7, 2022
@bcmills
Copy link
Contributor Author

bcmills commented Dec 7, 2022

Either the tests should be fixed, or the android builders should be configured not to run for x/vuln — either way, we shouldn't be wasting resources on test runs that are doomed to fail.

@zpavlinovic zpavlinovic self-assigned this Dec 7, 2022
@zpavlinovic
Copy link
Contributor

zpavlinovic commented Dec 7, 2022

The issue is not triggered by changes to x/vuln. It seems to come and go. I believe it is likely related to GOROOT only on Android since we use packagestest to build unit-test code. I could add t.Skip for each test, but I guess it is better to not run android builders on x/vuln.

@bcmills
Copy link
Contributor Author

bcmills commented Dec 8, 2022

If it's using packagestest, then #47257 may be what triggered the tests to start failing. I wonder if it's feasible for packagestest to add that skip itself?

@bcmills
Copy link
Contributor Author

bcmills commented Dec 8, 2022

Or, maybe it would suffice to update the x/tools dependency past CL 451597?

@bcmills
Copy link
Contributor Author

bcmills commented Dec 8, 2022

Looks like that will do it. (Mailed CL 456122, which is passing on an android-amd64-emu SlowBot.)

@bcmills bcmills self-assigned this Dec 8, 2022
@bcmills bcmills closed this as completed Dec 8, 2022
@golang golang locked and limited conversation to collaborators Dec 8, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done. OS-Android Testing An issue that has been verified to require only test changes, not just a test failure. vulncheck or vulndb Issues for the x/vuln or x/vulndb repo x/vuln
Projects
None yet
Development

No branches or pull requests

3 participants