Commit graph

93 commits

Author SHA1 Message Date
Yuchen Wu
2169f19db4 Address Rust 1.80 clippy warnings.
Also remove the doc_async_trait cfg since it is no longer viable.
2024-07-26 09:47:29 -07:00
Andrew Hauck
dfecdc4777 Add ability to ignore informational responses when proxying downstream 2024-07-24 22:56:53 +00:00
Yuchen Wu
1aeda29dd0 Add the support for custom L4 connector
This allows user defined L4 connect() to be used so that they can
customize the connect behavior such as changing socket options and
simulating errors in tests.
2024-07-18 16:56:40 -07:00
Yuchen Wu
9f70abe97b Release 0.3.0 2024-07-12 11:24:29 -07:00
Andrew Hauck
604390cb14 Add support for setting DSCP on client and server sockets 2024-07-12 11:24:29 -07:00
Yuchen Wu
aa06317ec7 Correctly cast H2 error for GOAWAY 2024-07-12 11:24:29 -07:00
Yuchen Wu
2ff09e727d Ignore 0.0.0.0 when checking fd mismatch
Avoid false positive since 0.0.0.0 in some systems is mapped
to other IPs.
2024-07-12 11:24:29 -07:00
Yuchen Wu
5397e2bd56 Change from debug to display when socket mismatch happens
The display format contains more useful info.
2024-07-12 11:24:29 -07:00
Yuchen Wu
0035064d04 Provide a group key for connection reuse isolation 2024-07-12 11:24:29 -07:00
Yuchen Wu
ee7f66082f Allow to create a new connection when the current one is shutting down
When we see a GOAWAY(NO_ERROR), the connector no longer fail the entire request.
Now the connector creates a new connection instead.
2024-07-12 11:24:29 -07:00
Kevin Guthrie
c67b5d0141 Add a replacement cli-parsing function for Opt that can be used in quickstart with no external dependencies 2024-06-28 12:34:25 -07:00
Wladimir Palant
86e6cd2912 Fixes #261 - Better Default implementation for Opt
---
Empty commit to trigger checks again
---
Another empty commit to trigger checks

Includes-commit: 0e9d853e05
Includes-commit: 1237b26493
Includes-commit: 6fdaf38b63
Replicated-from: https://github.com/cloudflare/pingora/pull/272
2024-06-28 12:34:25 -07:00
Andrew Hauck
ace9d4f135 Update comments on digest functions 2024-06-28 12:34:25 -07:00
Wladimir Palant
23c0378ce6 Fixes #270 - Add Session::digest_mut() method
Includes-commit: 5dd90aadd2
Replicated-from: https://github.com/cloudflare/pingora/pull/271
2024-06-28 12:34:25 -07:00
Yuchen Wu
92bbeb1139 Parse UDS with prefix
Now UDS can be parsed from string with prefix "unix:". The raw path
support will be deprecated.

From https://github.com/cloudflare/pingora/pull/141

Co-authored-by: blackanger <blackanger.z@gmail.com>
2024-06-28 12:34:25 -07:00
Yuchen Wu
1176af300b Make type alias http::Module public
Easier for 3rd party to implement the trait.
2024-06-28 12:34:25 -07:00
Edward Wang
03bd29044e Always respect_keepalive when releasing http session
When a user calls `release_http_session` on an http Connector, it is
usually implied that they intend to reuse the underlying connection if
possible. Previously for H1 this involved reaching into the H1 client
Session and calling `respect_keepalive`. The new behavior always
respects keepalive as part of releasing the http session, as it was very
easy to overlook this step and unintentionally disable connection reuse
for H1 sessions.
2024-06-28 12:34:25 -07:00
Andrew Hauck
fbf3a95749 Add a write timeout to write body buf and an option to set a minimum send rate 2024-06-28 12:34:25 -07:00
Yuchen Wu
c0b23c6736 Expose a few more TLS APIs 2024-06-28 12:34:25 -07:00
Wladimir Palant
05005e2a4d Fixes #234 - Clarify ServerConf documentation
Includes-commit: d9a37a1f38
Replicated-from: https://github.com/cloudflare/pingora/pull/273
2024-06-21 09:54:09 -07:00
Matthew Gumport
c943fc1c78 compression: allow setting level per algorithm
Fixes https://github.com/cloudflare/pingora/issues/228

This adds a function to set the compression level per supported algorithm. The
behavior of `adjust_level` is changed to set the level for all of the algorithms
such that it still behaves the same.
2024-06-21 09:54:09 -07:00
Edward Wang
9500e62855 Make ipv6_only flag an Option<bool>
Fixes #279. This allows falling back to the system default on None, or
explicitly setting false if the system default happens to be true.
2024-06-21 09:54:09 -07:00
Edward Wang
02111515c6 Expose TCP_INFO fields as pub 2024-06-21 09:54:09 -07:00
Andrew Hauck
a1f1ad8a43 h2c support 2024-06-21 09:54:09 -07:00
Wladimir Palant
2d30077683 Fixed typo in docs: connnection => connection
Includes-commit: bbef4bdd75
Replicated-from: https://github.com/cloudflare/pingora/pull/274
2024-06-21 09:54:09 -07:00
Yuchen Wu
4e251f663a Fxi clippy for Rust 1.79 2024-06-21 09:54:09 -07:00
Yuchen Wu
708e03211d Auto generate the size and verify it for setsockops calls
This avoids human error with stronger validation.
2024-06-21 09:54:09 -07:00
Ivan Babrou
bf07ed3f10 add get_socket_cookie helper
This cab be used for tracing to match the sockets in the kernel.
2024-06-21 09:54:09 -07:00
Andrew Hauck
d86c5855a0 Track write duration on Poll::Ready(Err) 2024-06-21 09:54:09 -07:00
Andrew Hauck
35b9f1db00 Remove Accept-Ranges header when response is compressed 2024-06-21 09:54:09 -07:00
Alex Severin
20cac2e673 expose new_uds err 2024-06-14 16:00:03 -07:00
Yuchen Wu
8a8302cf7b Respect the keepalive setting sent in HTTP client
Before this change, a HTTP client would only respect
the Connection header returned from the server.

Now, if the client sends "Connection: closed", it would not
keepalive regardless what the server returns.
2024-06-07 15:42:30 -04:00
Yuchen Wu
11863d27a2 Introduce HttpModules to pingora-proxy.
This feature allows to plug in 3rd party extensions with minimal code
required.

The downstream compression logic is now a module.

Add: a new early_request_filter API to fine tune the behavior of the modules.
Add: a few APIs to write the response with these modules enabled. This
should address issues like compression is not applied to custom
responses.
2024-06-07 15:42:30 -04:00
Wladimir Palant
b7ac8a50fc Fixes #231 - Remove Markdown code from the long CLI help
---
While at it, fix grammar in the description of the --daemon flag

Includes-commit: a8dee4e975
Includes-commit: f420f36c53
Replicated-from: https://github.com/cloudflare/pingora/pull/247
2024-05-31 11:04:36 -07:00
Alex Severin
d41231191c finish todo
---
reafactor

Includes-commit: 41ca473605
Includes-commit: f5870a985c
Replicated-from: https://github.com/cloudflare/pingora/pull/215
2024-05-31 11:04:36 -07:00
Andrew Hauck
4579a780c6 get_tcp_info and get_recv_buf should return None for UDS 2024-05-31 11:04:36 -07:00
Yuchen Wu
fa071eb506 Refactor Service API: Arc is no longer needed for apps.
This change makes a bit cleaner to use the API. It also allows to
modify the application logic before starting the service.
2024-05-31 11:04:36 -07:00
Yuchen Wu
4019aa0819 Simplify vectored write API
Provide a write_vec_all() API so that users don't have to loop
themselves.
2024-05-31 11:04:36 -07:00
Yuchen Wu
ea1db2fb9d Add read and write pending time info
These APIs show how much time a socket spends on waiting for data and
the time waiting for data to be sent. They are good indicators of
performance bottlenecks.
2024-05-31 11:04:36 -07:00
Andrew Hauck
47844a7ea4 Add ability to get TCP_INFO through SocketDigest, add get_recv_buf function 2024-05-31 11:04:36 -07:00
Yuchen Wu
2902dc5365 Redesign the API of HTTP module
Make it async and more natural.
2024-05-31 11:04:36 -07:00
Kevin Guthrie
479d9badbf Addressing github #231 - Cleaning up cli-help text 2024-05-24 10:00:06 -07:00
Kevin Guthrie
9dee8e6775 Dropping the clap version to the most recent compatible with our rust 1.72 2024-05-24 10:00:06 -07:00
Wladimir Palant
795594db83 Fixes #235 - Replace unmaintained structopt crate by clap
---
Fixed formatting

Includes-commit: 05f9754166
Includes-commit: 29286c7e71
Replicated-from: https://github.com/cloudflare/pingora/pull/239
2024-05-24 10:00:06 -07:00
Andrew Hauck
6db86b6929 Add ability to set server side tcp keepalive 2024-05-24 10:00:06 -07:00
Andrew Hauck
cd5134431c Ignore write_response_header on upgraded websockets 2024-05-24 10:00:06 -07:00
Yuchen Wu
a40175412c avoid a possible race condition when releasing h2 connections
It is possible that when two threads try to release streams of the same
h2 connection, one thread would register the connection in the in_use_pool
while the other register it in the idle_pool.

The solution is to put a lock so that the connection can only appear in
one pool at a time.
2024-05-24 10:00:06 -07:00
Yuchen Wu
840367359d Don't panic when h2 fails to allocate a stream
There is still a bug but change to this to help debug.
2024-05-24 10:00:06 -07:00
Yuchen Wu
34b2a35d7b TCP fast open server side support.
Provide default and non_exhaustive for TcpSocketOptions to future proof
its changes.

Also fix an issue that TcpScoketOptions can't be used for IPv4 sockets
at all.
2024-05-17 14:16:31 -07:00
Daniel Dao
2272112c56 set SO_RCVBUF before connect
SO_RCVBUF needs to be set before connect otherwise tcp settings will
not be finalized correctly. And since autotuning is not engaged in this
case, the throughput will suffer.
2024-05-17 14:16:31 -07:00