Commit graph

36 commits

Author SHA1 Message Date
JJ Kasper
613e4c91e3
Update yarn PnP tests and disable swc file reading for PnP (#33236)
* Update yarn PnP tests and disable swc file reading for PnP

* update job

* Update test

* add env variable

* update destory

* test one

* bump timeout

* update pnp install command

* only run pnp test

* add more logs

* handle exit signal

* dont inherit stdio for install

* update server start

* re-add test type

* add build log

* additional logging

* update build command

* remove separate timeout

* update install command

* install separate for better time info

* add cache pre-warming

* update yarn config

* enable other pnp tests

* Separate out tests

* fix-lint

* update path

* update test concurrency for isolated tests

* update retries

* Revert "update test concurrency for isolated tests"

This reverts commit 3a6e924df8ec61d55d3ee8a58d24cd50f0141195.

* re-enable production tests

* apply suggestions
2022-01-14 09:43:30 -06:00
David Ramos
36a6e436b3
Don't swallow test failures caused by POSIX signals (#32688)
* Don't swallow test failures caused by POSIX signals

* Update tests to not import() inside jest

* Update tests

* apply suggestion

Co-authored-by: JJ Kasper <jj@jjsweb.site>
2021-12-21 12:52:07 -06:00
JJ Kasper
bf097f1d0f
Update resolving for node_modules trace pass (#30985)
* Update resolving for node_modules trace pass

* Update test
2021-11-04 20:09:37 -05:00
JJ Kasper
17adc24297
Update test traces to only run on retry (#30459) 2021-10-27 14:06:36 -05:00
JJ Kasper
cd6d4c35da
Disable using polling for webpack on test retry (#30372)
## Bug

- [ ] Related issues linked using `fixes #number`
- [ ] Integration tests added
- [ ] Errors have helpful link attached, see `contributing.md`

## Feature

- [ ] Implements an existing feature request or RFC. Make sure the feature request has been accepted for implementation before opening a PR.
- [ ] Related issues linked using `fixes #number`
- [ ] Integration tests added
- [ ] Documentation added
- [ ] Telemetry added. In case of a feature if it's used or not.
- [ ] Errors have helpful link attached, see `contributing.md`

## Documentation / Examples

- [ ] Make sure the linting passes by running `yarn lint`
2021-10-27 09:24:37 +00:00
JJ Kasper
474f1e7d93
Add initial test trace outputs (#30246) 2021-10-25 08:21:57 +02:00
Tobias Koppers
ad565c4087
avoid running multiple test from the same directory in parallel (#29830) 2021-10-11 21:23:33 +02:00
JJ Kasper
a4dee7b254
Update test timings endpoint (#29443)
* Update test timings endpoint

* bump
2021-09-28 10:15:04 -05:00
JJ Kasper
a92a5caec2
Update test set-up to leverage playwright when able to (#28634)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-13 14:36:25 +02:00
JJ Kasper
f71d3f2c09
Trim large test output to not exceed limit (#28881)
This ensures we trim test output that will exceed the amount that can be shown in GitHub actions so that we can still see which tests failed instead of un-helpful test logs.
2021-09-07 15:02:29 +00:00
JJ Kasper
005b13f1ac
Move unit tests to one folder and migrate them to TypeScript (#28427)
* Move unit tests to one folder

* Migrate unit tests to TypeScript

* add test types to lint

* Ensure ts(x) tests are run with util

* Add tsx extension to jest config

* bump
2021-08-24 07:52:45 -05:00
JJ Kasper
a342fba00a
Update polling env var for tests in CI (#28264)
* Update polling env var for tests in CI

* Update polling value

* always use polling

* Revert "always use polling"

This reverts commit 281875de921874592a6755d67acaad7441c06e22.

* test disabling tcp/udp offloading

* fix quotes
2021-08-18 15:29:15 -05:00
JJ Kasper
b24cd1eaba
Use @vercel/fetch for run-tests requests (#27815)
* Use @vercel/fetch for run-tests requests

* update precompileld
2021-08-06 10:20:05 -05:00
JJ Kasper
f5ee9ed5af
Only output test logs on failure in CI (#27604)
This updates to only output a test's logs when it fails to reduce the noise in the CI's logs to allow easier investigating a failure. This also updates azure to leverage the `run-tests` script when testing ie11 to allow retrying similar to our other tests.
2021-07-29 15:35:13 +00:00
JJ Kasper
069f7e82d6
Run acceptance tests non-concurrently (#25861) 2021-06-07 20:57:15 +02:00
JJ Kasper
7038b623e0
Fix occasional test failures (#25855) 2021-06-07 18:17:55 +02:00
Shu Ding
1bf4cf3e76
Upgrade jest-worker (#23077)
This PR upgrades `jest-worker` and `jest-cli` to the latest pre-release version, also removed `jest-circus` which is included in Jest by default. `jest-worker@next` includes a fix for memory leak that we need (https://github.com/facebook/jest/pull/11187). 

Fixes #22925. This will also improve the OOM issue for `next dev` #15855.
2021-03-16 21:08:35 +00:00
JJ Kasper
cf4665539a
Fix failing Azure tests (#19877)
Noticed Azure tests have started failing after https://github.com/vercel/next.js/pull/19758 due to the middleware taking longer than the allotted threshold which adds unexpected logs to stderr. This attempts to resolve these test failures by increasing the allotted time for the middleware when running on Azure. 

x-ref: https://dev.azure.com/nextjs/next.js/_build/results?buildId=22617&view=logs&jobId=5ee44de4-e310-59d9-0ba5-4a271a649fb0&j=5ee44de4-e310-59d9-0ba5-4a271a649fb0&t=af3fb693-3771-5a1a-ec97-2ba4cc77f25c
x-ref: https://dev.azure.com/nextjs/next.js/_build/results?buildId=22619&view=logs&jobId=5ee44de4-e310-59d9-0ba5-4a271a649fb0&j=5ee44de4-e310-59d9-0ba5-4a271a649fb0&t=af3fb693-3771-5a1a-ec97-2ba4cc77f25c
2020-12-08 09:24:22 +00:00
JJ Kasper
18494fe3fb
Break-up unit tests to separate step (#18992) 2020-11-10 12:25:50 -05:00
JJ Kasper
3cece4d2ad
Update Azure config (#18931) 2020-11-09 00:56:39 -05:00
Jan Potoms
2f50f1f8c9
Stabilize more tests (#15470)
jest retries seem to be masking test failures, like the `auto-export` one (and maybe others). I turned it off for now. The `auto-export` test fails when retries are turned off.
the output of this test failure was a bit unhelpful so I also improved it.
Many tests have anonymous page functions.
2020-07-26 04:57:06 +00:00
Jan Potoms
e6e2722b11
Tweak test retries for invalid-href suite (#15459)
- Reduce jest retries to 2 for a total of 3 attempts
- Disable retries in `invalid-href` test. I noticed jest retries don't help when this test fails (see log output of https://github.com/vercel/next.js/runs/904147534).
2020-07-24 20:04:53 +00:00
Joe Haddad
86160a5190
Upgrade to Prettier 2 (#13061) 2020-05-18 15:24:37 -04:00
Jan Potoms
9f8076be43
Only retry tests on CI (#12998) 2020-05-17 12:10:02 -04:00
JJ Kasper
13c9439973
Update to run tests in headless mode on Azure (#12574) 2020-05-06 19:21:31 -04:00
JJ Kasper
d00180bba8
Update to track test timings separate for Azure and Actions (#12083)
* Update to track test timings separate for Azure and Actions

* Add azure test flag
2020-04-21 16:11:04 -04:00
JJ Kasper
8390a474fe
Update to output jest data for posting failed tests comment (#10814)
* Update to output jest data for posting failed tests comment

* Add failing test

* Reset retries

* Revert change for testing
2020-03-04 09:54:49 +01:00
JJ Kasper
9145d9ea63
Migrate CircleCi config to GitHub actions (#10274)
* Add initial config

* Comment out other action

* Update config

* Update config

* Update configs

* rename requires -> needs

* Update configs

* Update configs

* Enable headless mode

* Disable circleci while testing

* Disable build-test-deploy in circle

* Update build step

* Disable fail fast

* Update configs

* Add runs-on to publish steps

* bump

* Update config

* Update group count

* Update checkout path

* Update test all concurrency

* Handle EPIPE errors

* Revert "Handle EPIPE errors"

This reverts commit a993565bbdd77df136e07d54eb83ed32b18e5963.

* Update test to handle EPIPE in test

* Remove CircleCi config

* Revert "Update test to handle EPIPE in test"

This reverts commit c8cb72d5303b5fd165016f9eba6c8c888d8a1907.

* Update to use node 10 and see if EPIPE error is still present

* Revert "Revert "Update test to handle EPIPE in test""

This reverts commit efd2abe7c35c12bf78530064796d853c171efcf1.

* Revert "Update to use node 10 and see if EPIPE error is still present"

This reverts commit 893da4f31279228ebec6fa208c34ef179a6ebaf4.

* Add todo for node issue

* undo lint change as it should be correct

* Add dummy step to require

* Add runs-on for dummy job
2020-01-27 14:07:31 -06:00
JJ Kasper
c1cbad0155 Update tests running and add splitting by timings for Azure (#10214)
* Add splitting by timings for Azure

* Add --timings flag for azure

* Update timings API

* Update timings var

* Fix test directory not being reset before re-trying

* Update to re-use CircleCI timing data

* Bump concurrency for Azure

* Remove extra logging

* Update timeout for create-next-app tests

Co-authored-by: Joe Haddad <timer150@gmail.com>
2020-01-23 12:37:01 -05:00
JJ Kasper
80533f5d62 Add file attribute to timings data (#9535)
* Add file attribute to timings data

* bump

* bump
2019-11-26 12:11:56 -05:00
JJ Kasper
12cbb2e95a
Add custom timings for CircleCi (#9523)
* Add custom timings for CircleCi

* Re-add split-by flag

* Add testcase item to junit.xml

* Log tests being run

* Update junit.xml path

* bump
2019-11-25 16:50:46 -06:00
Joe Haddad
18a9c7e371
Improve linting rules to catch more errors (#9374)
* Update `packages/`

* Update examples

* Update tests

* Update bench

* Update top level files

* Fix build

* trigger
2019-11-10 19:24:53 -08:00
JJ Kasper
2d9f199105 Add warning for getStaticParams without getStaticProps (#9226)
* Add warning for getStaticParams without getStaticProps

* Throw error instead of logging to make sure it's noticed

* Lower default concurrency for tests
2019-10-28 10:24:29 -07:00
JJ Kasper
ba07cc6237 Revert "Add hard retrying for Azure test runs (#8761)" (#8772)
This reverts commit 664cd3fa04.
2019-09-17 19:01:46 +02:00
JJ Kasper
664cd3fa04 Add hard retrying for Azure test runs (#8761)
* Test killing proceses before retrying on Azure

* catch error while killing process
2019-09-17 12:17:34 -04:00
JJ Kasper
7b933f675a Optimize test setup (#8644)
* Tweak test set-up

* Update azure config

* Add cleaning test files and windows handling

* Limit windows test to one at a time

* Tweak test settings

* Update tests splitting

* remove custom concurrency for azure

* Test Azure var

* Update Azure config

* bump

* Simplify cleaning up
2019-09-10 13:11:55 -04:00