Commit graph

182 commits

Author SHA1 Message Date
Tobias Koppers
233b69d203 App CSS and fixes (vercel/turbo#246)
fix app layout transition
add global css support
2022-10-25 00:27:17 +02:00
Tobias Koppers
36f7545c33 add HMR for RSC component changes (vercel/turbo#202) 2022-10-24 22:23:40 +02:00
Alex Kirszenberg
09273bdab1 Apply Next SSG transform (vercel/turbo#130)
This adds the Next SSG transform. This transform does a few things, but
the one we're most interested in right now is the removal of
`getStaticProps`/`getServerSideProps`/etc. from page modules. HMR will
be disabled if these exports are preserved.

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-24 22:23:00 +02:00
Justin Ridgewell
e4f6bbf6ab Implement source map tracing for errors (vercel/turbo#227)
Fixes https://github.com/vercel/web-tooling-internal/issues/67
2022-10-24 22:21:12 +02:00
Alex Kirszenberg
b0d8d36429 Add back Next's React compiled dists (vercel/turbo#209)
Required to get the layout-playground demo working.
2022-10-23 18:34:13 -07:00
Tobias Koppers
8fa162d5c5 fix app layouts (vercel/turbo#190)
Seems like app layout was left behind while shipping features to normal
SSR rendering

* fixes fallback error pages (update to error fallback changes)
* fixes process communication (update to api route changes)
* avoid busy looping
* update to next.js updates
* fix resolving cycle
* fix HMR of client components
* add some hard coded external packages
2022-10-22 19:47:59 +02:00
OJ Kwon
722930a006 feat(devserver): try to bind instead of explicit (vercel/turbo#187)
This PR attempts to try to bind server and bubbles up error, instead of
explicit `bind` which panics internally if it wasn't possible to bind.
2022-10-21 19:54:24 -07:00
Will Binns-Smith
4569ef779d Transform ecmascript with emotion (vercel/turbo#170)
Enabled in next-dev and snapshot tests.

There are quite a few output snapshot files. Maybe we make stubs for the
third-party packages to reduce the noise...

Test Plan: Added new snapshot tests. Verified transformed code contains
a digest, inline source map string.
2022-10-21 12:31:01 -07:00
Alex Kirszenberg
243bc9fbc0 Add support for API routes (vercel/turbo#163)
This reworks our Node.js rendering logic to allow for:
* passing binary request bodies in and out of Node.js: API routes can
accept request bodies in POST, and can reply with any content type.
* content source results that are recomputed every time: we don't want
API routes to be cached (at least not by turbopack for now).

It also reworks the `END_OF_OPERATION` logic to avoid hard coding a
single end of operation marker (they're now unique per pool), and allow
multiple kinds of operation events (`Step`, `Success`, `Error`).

This is not a particularly good implementation for this. A better
implementation would proxy the request from the client to the Node.js
server in a more direct manner. We also need a way to tell turbo tasks
"don't bother ever caching this", as right now every single API request
and result will still be cached, even if we know they will never be used
again. Finally, we should communicate with Node.js processes via a
better mechanism than stdout. I made some progress on a prototype for
using https://github.com/servo/ipc-channel with NAPI a while back, which
I'd like to pick up some time after conf.

However, it seems to work well enough for now, so yay.

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-21 21:03:52 +02:00
Tobias Koppers
06cc52ecbc remove fouc optimization (vercel/turbo#169) 2022-10-21 20:44:29 +02:00
Will Binns-Smith
dd7278c0e3 Next-dev and snapshot tests: transform ecmascript with styled_components (vercel/turbo#44)
To do:
* [x] The transform doesn't seem to be running properly yet. Fix this.
2022-10-21 09:32:39 -07:00
Will Binns-Smith
7b4f51f8fb Create a package.json with type: "commonjs" in .next/server (vercel/turbo#145)
Closes vercel/turbo#109

Note a difference between this and stable Next.js: at turbopack this
file is placed in .next/server/package.json, while Next.js currently
creates this file at .next/package.json.

Test Plan: Verified that the `hello-world-esm` no longer fails to SSR
(it's now blocked by vercel/turbo#111).

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-21 08:38:56 -07:00
Tobias Koppers
7d8d351d5e fix hydration bench again (vercel/turbo#162) 2022-10-21 16:29:52 +02:00
Tobias Koppers
451dccdeb8 fix startup benchmarks for CSR bundlers (vercel/turbo#152) 2022-10-21 16:11:25 +02:00
Tobias Koppers
790ff6c05c add some strongly consistent reads into nodejs source (vercel/turbo#154)
to improve performance

It doesn't fix the performance completely but makes it less bad
2022-10-21 14:23:49 +02:00
Tobias Koppers
d1db10cd37 Bugfixes for merged PRs (vercel/turbo#155) 2022-10-21 12:44:40 +02:00
Florentin / 珞辰
b1caa9ec34 terminal improvements (vercel/turbo#133)
* Adds next-like event type styling
* No tasks in logs

Closes:
- https://github.com/vercel/web-tooling-internal/issues/58

Screenshot: 
![CleanShot 2022-10-20 at 17 59
45@2x](https://user-images.githubusercontent.com/8146736/196999636-dcf3757d-6c5f-4c52-9257-86caabf6a5d6.png)

Co-authored-by: Maia Teegarden <dev@padmaia.rocks>
Co-authored-by: Justin Ridgewell <justin@ridgewell.name>
Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-21 11:50:37 +02:00
Justin Ridgewell
a442eab26e Update default server IP to 0.0.0.0 (vercel/turbo#150)
Small nit, but if we want to listen on 0.0.0.0, then we should set that
to the default. The difference is that other computers can connect when
we listen on 0.0.0.0, while only this computer can connect if we listen
on 127.0.0.1.
2022-10-21 02:01:54 -04:00
Maia Teegarden
ff5f95fd47 Match Next.js server startup message (vercel/turbo#148)
![Screen Shot 2022-10-20 at 8 13 41
PM](https://user-images.githubusercontent.com/2865858/197102924-5970972b-7177-4c30-b7b2-35932d2c66fb.png)
2022-10-20 22:27:27 -07:00
Leah
88d0a40a96 fix tests (vercel/turbo#143) 2022-10-21 02:28:46 +02:00
Leah
276c844152 prettier fixes (vercel/turbo#41) 2022-10-21 01:46:26 +02:00
Chris Olszewski
d87b96bb49 add postcss and tailwindcss to unimplemented files (vercel/turbo#137)
Note that this doesn't completely close out
[vercel/turbo#54](https://github.com/vercel/web-tooling-internal/issues/54) as the
[tailwindcss config is
optional](https://tailwindcss.com/docs/configuration). I'm digging
deeper at additional ways to detect tailwind, but putting this up since
it's a strict improvement.

```
olszewski@chriss-mbp next-dev % cargo run -p next-dev -- /tmp/with-tailwindcss-app
   Compiling next-dev v0.1.0 (/Users/olszewski/code/vercel/the-three-body/crates/next-dev)
    Finished dev [unoptimized + debuginfo] target(s) in 11.61s
     Running `/Users/olszewski/code/vercel/the-three-body/target/debug/next-dev /tmp/with-tailwindcss-app`
server listening on: http://localhost:3000
error [unimplemented]
  /private/tmp/with-tailwindcss-app/next.config.js
    Feature not yet supported
    Handling the file `next.config.js` is currently unimplemented

  /private/tmp/with-tailwindcss-app/postcss.config.js
    Feature not yet supported
    Handling the file `postcss.config.js` is currently unimplemented

  /private/tmp/with-tailwindcss-app/tailwind.config.js
    Feature not yet supported
    Handling the file `tailwind.config.js` is currently unimplemented

[200] / (3045ms)
initial compilation 3468ms (3044ms task execution, 48380 tasks)
updated in 874ms (8990 tasks)
```
2022-10-20 19:03:17 -04:00
Will Binns-Smith
3cb06901df Derive a runtime version from NodeJsEnvironment's node_version (vercel/turbo#15)
Ported from https://github.com/vercel/turbo-tooling/pull/452.

To do:

* [x] Read and use node version from PATH

Test Plan:

Temporarily lowered the default version and verified core-js was
resolved when /page is visited.

Co-authored-by: Justin Ridgewell <justin@ridgewell.name>
2022-10-20 14:46:47 -07:00
Leah
ca98d275cf fallback page (vercel/turbo#69) 2022-10-20 22:26:53 +02:00
Leah
12d723059b prepare crates for publishing (vercel/turbo#29) 2022-10-20 19:49:35 +02:00
Florentin / 珞辰
2eae9f180c add unimplemented warning for next/babel configs (vercel/turbo#124)
PR for: 
- https://github.com/vercel/web-tooling-internal/issues/56
- https://github.com/vercel/web-tooling-internal/issues/55

Screenshot:
<img width="662" alt="CleanShot 2022-10-20 at 11 12 13@2x"
src="https://user-images.githubusercontent.com/8146736/196907628-e5c73d54-87a7-4f3a-9130-d08bc539a5b1.png">

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-20 18:53:27 +02:00
Tobias Koppers
3ca2fe4fd5 adds support for app directory (vercel/turbo#125)
This can be tested with https://github.com/vercel/layouts-playground

But since tailwind is not supported you need to add:

``` html
<script src="https://cdn.tailwindcss.com/3.1.6"></script>
```

into `<head>` in `app/layout.tsx`
2022-10-20 18:49:12 +02:00
Leah
4bb347ae39 error overlay (vercel/turbo#39)
transferred from https://github.com/vercel/turbo-tooling/pull/396

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-20 18:04:19 +02:00
Justin Ridgewell
be1537881c DeterminsticHash cleanup (vercel/turbo#108)
Fixes a few issues:

1. Removes `Hasher` impl for `Xxh3Hash64Hasher`
- Importing the `Hash` trait allows you to call `vc.hash(&mut
xxh3_hasher)`, which defeats our goal of deterministic hashing
2. Fixes hashing of 2 contiguous strings
   - `"fo"` and `"o"` should hash differently than `"f"` and `"oo"`.
3. Fixes hashes of enums
   - `Foo::Bar(1)` should hash differently than `Foo::Baz(1)`
4. Standardizes `usize`/`isize` as 8 bytes
2022-10-19 18:21:29 -04:00
Tobias Koppers
c5bc290c32 add node: prefixed aliases for polyfills (vercel/turbo#102) 2022-10-19 18:07:28 +02:00
Alex Kirszenberg
aff0a0f7c5 Fix CSS HMR for SSR (vercel/turbo#85)
Since we used to build the HTML using our own `<Document>` component, we
were previously adding a data-turbopack-chunk-id attribute to our
`<link>` tags to reconcile chunk paths with their chunk ids when
initializing HMR. However, Next.js is now responsible for building the
HTML, and it has no such mechanism.

**NOTE:** HMR is currently broken for non-Next-SSR rendering
(HtmlAsset). This PR does not fix that.
2022-10-19 18:06:40 +02:00
Tobias Koppers
381badcde3 Improvements to benchmarks (vercel/turbo#99)
* remove 100 modules form the default modules count
* rename bench_restart -> bench_hydration_cached
* add bench_startup_cached
* run npm install only once per test case and copy the result instead
* use multi-threaded copy
* Run `cached` tests only when `TURBOPACK_BENCH_CACHED` is set
* add `TURBOPACK_BENCH_BENCH` too measure the time it takes to run the
full benchmark (including startup and teardown) instead.
* add `TURBOPACK_BENCH_HEAD` to run non-headless
* add `TURBOPACK_BENCH_DEVTOOLS` to auto open devtools
* retry initial warmup change when it fails to detect that

This should make the benchmarks about 3 times faster... at least on
windows^^
2022-10-19 13:39:05 +02:00
Tobias Koppers
06ee2efe8e remove get_by_id (for performance) (vercel/turbo#88)
I also needed to remove the old html runtime, use new runtime for CSP to
update the CSS HMR code
2022-10-19 07:33:58 +02:00
Leah
0f40ec8327 ts HMR runtime (vercel/turbo#38) 2022-10-18 20:37:33 +02:00
Will Binns-Smith
50ab6dab18 [Rebased] Remove automatic core-js polyfills (vercel/turbo#91)
Rebase of vercel/turbo#68, which was merged into a now-closed PR.

Closes vercel/turbo#65.

When configured to use preset-env, this stops turbopack from inserting
dependencies on core-js. It's:

* Buggy/error-prone, at least through swc preset-env: 
  * https://github.com/vercel/the-three-body/issues/65
* setImmediate "polyfills" always inserted for this nonstandard feature
when
    React (scheduler, iirc) does feature detection of it
* Big. Updating the snapshot alone for a test that only used [].includes
  resulted in a diff with nearly 4700 line deletions
* Not done by Next.js for modern targets in the past couple of years:
https://twitter.com/timneutkens/status/1234548900272517120

Test Plan: Added [].includes to preset_env snapshot test and verified no
references to core-js are inserted.
2022-10-18 11:04:41 -07:00
Alex Kirszenberg
7bf4a27e6a Ensure Next.js uses React 18 APIs, enable styled_jsx transform in SSR (vercel/turbo#90)
This will remove the warning about using `hydrate` instead of
`hydrateRoot`, and fix a mismatch between SSR and CSR when using
styled-jsx (`<style jsx>`).
2022-10-18 19:30:46 +02:00
Alex Kirszenberg
9062ad91f4 Add polyfills to Node.js externals on the client-side (vercel/turbo#89)
We can't use the normal `ImportMap` because we stop resolving if looking
up a request within yields a result. However, for module polyfills, we
only need to look up the request when normal resolving fails. Hence the
dichotomy between the `import_map` and the `fallback_import_map`.

In a more modular architecture, we would model this as a stack of three
resolvers:

1. ImportMapResolver
2. DefaultResolver
3. FallbackImportMapResolver

I'm guessing this is what we'll have in the future, but this requires a
bigger refactoring than what I'm comfortable with implementing for now.
2022-10-18 19:30:07 +02:00
Alex Kirszenberg
59b7290933 Remove unused pages/_app and pages/_document (vercel/turbo#78)
These are no longer used, as we are now using Next.js' own components
instead.
2022-10-18 14:53:01 +02:00
Tobias Koppers
105ff16578 remove ContentSource::vary to avoid many tasks (vercel/turbo#71) 2022-10-18 13:00:10 +02:00
Justin Ridgewell
feb8c9ac39 Implement support for static assets directory (vercel/turbo#73)
Fixes https://github.com/vercel/web-tooling-internal/issues/7

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-18 10:05:37 +02:00
Tobias Koppers
5c1d113f1e node.js needs a fetch polyfill (vercel/turbo#58) 2022-10-18 09:56:24 +02:00
Tobias Koppers
aed7fa4d0b add basic support for browser alias field (vercel/turbo#56) 2022-10-18 03:17:06 +02:00
Leah
fcc806e1e5 embedded next.js package (vercel/turbo#37) 2022-10-17 23:33:25 +02:00
Alex Kirszenberg
44c2e1f570 Optimize Next.js SSR (vercel/turbo#48)
This PR also includes the changes in vercel/turbo#12 

This optimizes Next.js SSR by marking `react[/*]` and `next[/*]` imports
as externals in Node.js, which means that they will be `require`d
directly instead of bundled.

This optimization reduces the number of modules to analyze on the server
for a single component app from ~1000 (Next.js SSR imports a lot of
modules, including amp-optimizer which includes more) to <10.

Co-authored-by: Tobias Koppers <tobias.koppers@googlemail.com>
2022-10-17 19:54:19 +02:00
Tobias Koppers
2f3edac20c add introspection for assets and content sources (vercel/turbo#47)
add very simple explorer to introspect the graph via `/__turbopack__/`

Allows to "walk" through the content sources and asset graph. Some
assets allows to access inner assets, e. g. from the ecmascript chunk
you can access the entry module asset, so you can go a level deeper.

It works by a `Introspectable` trait which can be implemented by
anything we want to allow the user to inspect. In future the in browser
UI should offer a nice UI to explore your application.

In future we probably also want to add some `metrics` to the
`Introspectable` trait, e. g. to report size of an asset.

This UI is very basic currently, but that works for debugging:


![image](https://user-images.githubusercontent.com/1365881/196007862-2fb2a0e9-19ba-45c5-8a82-926418e0d479.png)
2022-10-17 17:19:29 +02:00
Tobias Koppers
3c821767ce use browser field for the browser (vercel/turbo#26)
add module field
2022-10-17 08:36:30 +02:00
Tobias Koppers
cabb72fa53 avoid emitting source maps for node.js (vercel/turbo#30) 2022-10-16 10:39:18 +02:00
Leah
f39152cef6 add From<T> impl for File (vercel/turbo#35)
transferred from https://github.com/vercel/turbo-tooling/pull/519
2022-10-15 18:42:14 +02:00
Leah
003a1ed013 add FileSystem::root() function to replace FileSystemPathVc::new(fs, path) (vercel/turbo#34)
transferred from https://github.com/vercel/turbo-tooling/pull/518
2022-10-15 18:40:02 +02:00
Tobias Koppers
280e909131 Deduplicate issues for logging (vercel/turbo#27)
see https://github.com/vercel/turbo-tooling/pull/523

Co-authored-by: Justin Ridgewell <justin@ridgewell.name>
2022-10-14 17:52:59 +02:00