Commit graph

217 commits

Author SHA1 Message Date
LongYinan
e08865cafd Merge turbo crate into cargo workspace (vercel/turbo#2577) 2022-11-03 23:01:50 +08:00
Alex Kirszenberg
e8c027ffb2 Use mimalloc in next-dev (vercel/turbo#2467) 2022-11-03 07:01:39 +00:00
Tobias Koppers
beed9fb626 add benchmark documentation and blog post (vercel/turbo#2492)
Co-authored-by: Anthony Shew <anthony.shew@vercel.com>
Co-authored-by: Jared Palmer <jared@jaredpalmer.com>
Co-authored-by: Maia Teegarden <dev@padmaia.rocks>
Co-authored-by: Will Binns-Smith <wbinnssmith@gmail.com>
Co-authored-by: Alex Kirszenberg <alex.kirszenberg@vercel.com>
Co-authored-by: Matt Pocock <mattpocockvoice@gmail.com>
2022-11-01 00:08:56 +01:00
OJ Kwon
36daa2bf52 feat(next/dev): allow to retry bind (vercel/turbo#2480) 2022-10-30 12:05:37 -07:00
Tobias Koppers
091af50322 add TURBOPACK_BENCH_PROGRESS to show captured values during bench (vercel/turbo#2490) 2022-10-29 18:13:39 +02:00
Alex Kirszenberg
9b5c2e39ea Simplify benchmark warmup (vercel/turbo#2483)
* Simplify benchmark warmup

* Update crates/next-dev/benches/mod.rs

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>

* fmt

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-29 09:37:52 +02:00
Justin Ridgewell
9fc8c13877 Faster source map tracing (vercel/turbo#2426)
* Store the sourcemap::SourceMap directly, instead of encoding it

* Implement GenerateSourceMap trait and use it to retrieve live maps

* Cleanup and comments!

* Update safety comment

* Rename var

* Update snapshots

* Update snapshots

* Fix tracing errors in SSR

SSR has access to `EcmascriptChunkVc`, not `EcmascriptChunkContentVc`. Client gets access only to `EcmascriptChunkContentVc`

* Fix source map sources on client

Because the JS is nested in dirs, the source needs to be an absolute path.

Co-authored-by: Jared Palmer <jared@jaredpalmer.com>
2022-10-29 01:16:05 +02:00
Tobias Koppers
befc272a8c remove require hook (vercel/turbo#2473) 2022-10-29 00:24:25 +02:00
Tobias Koppers
f9fb452b32 improve startup and warmup of benchmarks (vercel/turbo#2463) 2022-10-28 21:56:33 +02:00
Tobias Koppers
69d98a5bde make sure to exit the process in case of errors during errors sending (vercel/turbo#2457) 2022-10-28 20:56:40 +02:00
OJ Kwon
2af748edd4 refactor(next/dev): reusable start_server (vercel/turbo#2455) 2022-10-28 09:41:46 -07:00
阿豪
5f00509321 chore: typo (vercel/turbo#2404)
* chore: typo

* Remove hot_module_replacement from snapshot tests

Re: vercel/turbo#2351

Co-authored-by: Justin Ridgewell <justin@ridgewell.name>
2022-10-28 11:59:21 -04:00
Alex Kirszenberg
f2d661c0bb Fix large regression with turning ModuleRuleCondition::matches into a tt::fun (vercel/turbo#2450)
* Fix large regression with turning ModuleRuleConditionVc::matches into a tt::fun

* Remove Vcs from ModuleRule altogether
2022-10-28 17:53:13 +02:00
OJ Kwon
0d12445d6a refactor(next/dev): allow devserver args serializable (vercel/turbo#2446) 2022-10-28 08:28:04 -07:00
Allan
b12e0d8f46 Fix unnecessary question mark warnings (vercel/turbo#2443)
* Fix unused question marks warnings

Fix some return types that were giving clippy warnings, mostly `needless_question_mark`.
Remaining warnings are either `too_many_arguments` or `type_complexity`.

* Fix unncessary let binding

Co-authored-by: Justin Ridgewell <justin@ridgewell.name>
2022-10-28 01:40:49 -04:00
Tobias Koppers
2e4f40ae31 prettier fixes (vercel/turbo#2436) 2022-10-28 00:39:56 -04:00
Alex Kirszenberg
eca1e994f1 Update Next.js dependency for the TP benchmark (vercel/turbo#2435) 2022-10-28 00:39:33 -04:00
Alex Kirszenberg
201259af94 More forgiving timeout when waiting for Node.js to connect (vercel/turbo#2417)
* More forgiving timeout when waiting for Node.js to connect

* 10ms -> 30s
2022-10-28 00:35:30 -04:00
Justin Ridgewell
d4cb480fca Source map tracing fixes (vercel/turbo#2402) 2022-10-27 21:30:30 -07:00
JJ Kasper
8788e1f7d1 Add Next.js require hook (vercel/turbo#2434)
This hook is needed to ensure we properly map compiled modules like `styled-jsx` correctly. 

x-ref: [slack thread](https://vercel.slack.com/archives/CGU8HUTUH/p1666824437456749?thread_ts=1666819473.031139&cid=CGU8HUTUH)
2022-10-27 22:19:47 +00:00
Will Binns-Smith
52da74e39d Implement nsObj helper from webpack tests and pass basic import test (vercel/turbo#2385) 2022-10-27 01:22:58 +02:00
Tobias Koppers
d80eb2e0a0 fix node.js 18.9 (vercel/turbo#302) 2022-10-25 10:19:03 +02:00
Tobias Koppers
9c352406ee sort errors by relevance (vercel/turbo#299) 2022-10-25 09:15:51 +02:00
Tobias Koppers
50ca47eb8f fix inconsistent asset writes (vercel/turbo#296) 2022-10-25 09:01:03 +02:00
Tobias Koppers
2bc7c10228 use error overlay in app layouts (vercel/turbo#294) 2022-10-25 08:33:16 +02:00
LongYinan
ce4a8ed6bb Fix format check (vercel/turbo#289) 2022-10-25 13:45:08 +08:00
Tobias Koppers
395dbc9402 improve node.js pool process error handling (vercel/turbo#287) 2022-10-25 07:05:16 +02:00
Alex Kirszenberg
7d6212b064 Use a TCP connection for IPC between Node and TP (vercel/turbo#251)
Instead of using stdout for communication between the Node.js process
and the Turbopack instance, this PR switches to a TCP connection.
Furthermore, stdout and stderr are now piped between the Node.js process
and Turbopack.
2022-10-25 05:31:08 +02:00
Alex Kirszenberg
880205ef37 Fix bad merge (vercel/turbo#281) 2022-10-24 19:42:55 -07:00
Tobias Koppers
150155b741 expose assets from fallback page (vercel/turbo#280) 2022-10-24 19:39:47 -07:00
Justin Ridgewell
c2bb12d0bf Fix tracing of node_modules files not emitted by pages (vercel/turbo#249)
Because the static SSR renderer doesn't emit files that exist in
`node_modules` (because we take advantage of node's native `require`
resolution), any paths that traced into `node_modules` would output the
full file system path. It's just verbose and annoying.

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-24 19:16:35 -07:00
Tobias Koppers
43d86a1bfa clippy (vercel/turbo#266) 2022-10-25 03:38:43 +02:00
Will Binns-Smith
dc74ca31c0 Create an app root layout if app/page.{js,tsx} exists but layout does not (vercel/turbo#264)
This makes turbopack automatically create `app/layout.js` if
`app/page.js` exists, or `app/layout.tsx` if `app/page.tsx` exists, and
neither layout file already exists.

**Note that I'd prefer this issue to have info severity, but even with a
higher log level of info, the issue is never shown**. Filed vercel/turbo#265 to
track this.

Test Plan:
In a new `create-next-app`, opt into appDirectory and create
`app/page.js`. Run turbopack and verify:
* [x] the index page renders correctly
* [x] An issue with Warning level is logged notifying the user an
`app/layout.js` was created
* [x] `app/layout.js` is actually created with basic root layout

In a new `create-next-app`, opt into appDirectory and create
`app/page.tsx`. Run turbopack and verify:
* [x] the index page renders correctly
* [x] An issue with Warning level is logged notifying the user an
`app/layout.tsx` was created
* [x] `app/layout.tsx` is actually created with basic root layout

In a new `create-next-app`, opt into appDirectory and create
`app/page.tsx`. Also create a basic `app/layout.js` (note js layout with
tsx page). Add a custom `<title>` to the layout. Run turbopack and
verify:
* [x] the index page renders correctly
* [x] No issue is logged
* [x] No files are modified
* [x] The custom `<title>` is reflected.
2022-10-24 17:30:04 -07:00
Alex Kirszenberg
c8067af03f Fix fallback page error overlay (vercel/turbo#268) 2022-10-24 17:05:21 -07:00
Tobias Koppers
dca015b121 move feature detection to next.js (vercel/turbo#263) 2022-10-24 16:19:14 -07:00
Tobias Koppers
233b69d203 App CSS and fixes (vercel/turbo#246)
fix app layout transition
add global css support
2022-10-25 00:27:17 +02:00
Tobias Koppers
36f7545c33 add HMR for RSC component changes (vercel/turbo#202) 2022-10-24 22:23:40 +02:00
Alex Kirszenberg
09273bdab1 Apply Next SSG transform (vercel/turbo#130)
This adds the Next SSG transform. This transform does a few things, but
the one we're most interested in right now is the removal of
`getStaticProps`/`getServerSideProps`/etc. from page modules. HMR will
be disabled if these exports are preserved.

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-24 22:23:00 +02:00
Justin Ridgewell
e4f6bbf6ab Implement source map tracing for errors (vercel/turbo#227)
Fixes https://github.com/vercel/web-tooling-internal/issues/67
2022-10-24 22:21:12 +02:00
Alex Kirszenberg
b0d8d36429 Add back Next's React compiled dists (vercel/turbo#209)
Required to get the layout-playground demo working.
2022-10-23 18:34:13 -07:00
Tobias Koppers
8fa162d5c5 fix app layouts (vercel/turbo#190)
Seems like app layout was left behind while shipping features to normal
SSR rendering

* fixes fallback error pages (update to error fallback changes)
* fixes process communication (update to api route changes)
* avoid busy looping
* update to next.js updates
* fix resolving cycle
* fix HMR of client components
* add some hard coded external packages
2022-10-22 19:47:59 +02:00
OJ Kwon
722930a006 feat(devserver): try to bind instead of explicit (vercel/turbo#187)
This PR attempts to try to bind server and bubbles up error, instead of
explicit `bind` which panics internally if it wasn't possible to bind.
2022-10-21 19:54:24 -07:00
Will Binns-Smith
4569ef779d Transform ecmascript with emotion (vercel/turbo#170)
Enabled in next-dev and snapshot tests.

There are quite a few output snapshot files. Maybe we make stubs for the
third-party packages to reduce the noise...

Test Plan: Added new snapshot tests. Verified transformed code contains
a digest, inline source map string.
2022-10-21 12:31:01 -07:00
Alex Kirszenberg
243bc9fbc0 Add support for API routes (vercel/turbo#163)
This reworks our Node.js rendering logic to allow for:
* passing binary request bodies in and out of Node.js: API routes can
accept request bodies in POST, and can reply with any content type.
* content source results that are recomputed every time: we don't want
API routes to be cached (at least not by turbopack for now).

It also reworks the `END_OF_OPERATION` logic to avoid hard coding a
single end of operation marker (they're now unique per pool), and allow
multiple kinds of operation events (`Step`, `Success`, `Error`).

This is not a particularly good implementation for this. A better
implementation would proxy the request from the client to the Node.js
server in a more direct manner. We also need a way to tell turbo tasks
"don't bother ever caching this", as right now every single API request
and result will still be cached, even if we know they will never be used
again. Finally, we should communicate with Node.js processes via a
better mechanism than stdout. I made some progress on a prototype for
using https://github.com/servo/ipc-channel with NAPI a while back, which
I'd like to pick up some time after conf.

However, it seems to work well enough for now, so yay.

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-21 21:03:52 +02:00
Tobias Koppers
06cc52ecbc remove fouc optimization (vercel/turbo#169) 2022-10-21 20:44:29 +02:00
Will Binns-Smith
dd7278c0e3 Next-dev and snapshot tests: transform ecmascript with styled_components (vercel/turbo#44)
To do:
* [x] The transform doesn't seem to be running properly yet. Fix this.
2022-10-21 09:32:39 -07:00
Will Binns-Smith
7b4f51f8fb Create a package.json with type: "commonjs" in .next/server (vercel/turbo#145)
Closes vercel/turbo#109

Note a difference between this and stable Next.js: at turbopack this
file is placed in .next/server/package.json, while Next.js currently
creates this file at .next/package.json.

Test Plan: Verified that the `hello-world-esm` no longer fails to SSR
(it's now blocked by vercel/turbo#111).

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-21 08:38:56 -07:00
Tobias Koppers
7d8d351d5e fix hydration bench again (vercel/turbo#162) 2022-10-21 16:29:52 +02:00
Tobias Koppers
451dccdeb8 fix startup benchmarks for CSR bundlers (vercel/turbo#152) 2022-10-21 16:11:25 +02:00
Tobias Koppers
790ff6c05c add some strongly consistent reads into nodejs source (vercel/turbo#154)
to improve performance

It doesn't fix the performance completely but makes it less bad
2022-10-21 14:23:49 +02:00