Commit graph

155 commits

Author SHA1 Message Date
Yuchen Wu
2a080423cd Use Rust 1.80 2024-08-09 14:30:49 -07:00
Yuchen Wu
9f50e6ccb0 Handle bare IPv6 address in raw connect Host 2024-08-09 14:30:49 -07:00
Yuchen Wu
32303b9258 Address Rust 1.80 clippy warnings.
Also remove the doc_async_trait cfg since it is no longer viable.
2024-07-26 13:35:13 -07:00
Yuchen Wu
ff2582a64a Fix a rebase merge error 2024-07-26 13:35:13 -07:00
Andrew Hauck
be97e35031 Add ability to ignore informational responses when proxying downstream 2024-07-26 13:35:13 -07:00
Yuchen Wu
999e379064 Support opaque extension field in Backend
Sometimes service dicovery can carry arbitrary information, such as
SNI and request path to instrument how to connect to backend servers.

Backend now support to carry this type of information.
2024-07-26 13:35:13 -07:00
Andrew Hauck
a51874039f Add callback function to Backends update() to address atomicity issue when building selector 2024-07-26 13:35:13 -07:00
Yuchen Wu
7c122e7f36 Add the support for custom L4 connector
This allows user defined L4 connect() to be used so that they can
customize the connect behavior such as changing socket options and
simulating errors in tests.
2024-07-26 13:35:13 -07:00
pluveto
60787db4a1 chore(openssl): Update OpenSSL function signatures to use *mut instead of *const
This PR updates the function signatures in the `ext.rs` file to use `*mut` instead of `*const` for the `ssl` and `cert` parameters in the `SSL_use_certificate` and `SSL_use_PrivateKey` functions. This indicates that the functions can modify the SSL and certificate objects as intended.

Ref:
- https://www.openssl.org/docs/man1.1.1/man3/SSL_use_certificate.html
https://boringssl.googlesource.com/boringssl/+/refs/tags/~~~/ssl/ssl_cert.cc#292

Refactor the `cvt` function to use `c_long` instead of `c_int` for the return type for better compatibility with the types used in the OpenSSL library.

Also, add a test case for the `ssl_set_groups_list` function to ensure it handles valid and invalid input correctly.
---
chore(openssl):fix increase X509 reference count

Includes-commit: 7841271b4a
Includes-commit: e132431889
Replicated-from: https://github.com/cloudflare/pingora/pull/308
2024-07-26 13:35:13 -07:00
Wladimir Palant
18db42cd2c Fixes #311 - Make timeouts Sync
Includes-commit: 3faed99e26
Replicated-from: https://github.com/cloudflare/pingora/pull/312
2024-07-26 13:35:13 -07:00
Yuchen Wu
9220e6be2d Fix bleep commit hash 2024-07-26 09:42:33 -07:00
Andrew Hauck
604390cb14 Add support for setting DSCP on client and server sockets 2024-07-12 11:24:29 -07:00
Yuchen Wu
3978afb39f Upgrade to Rust 1.79 2024-07-12 11:24:29 -07:00
Yuchen Wu
aa06317ec7 Correctly cast H2 error for GOAWAY 2024-07-12 11:24:29 -07:00
Yuchen Wu
2ff09e727d Ignore 0.0.0.0 when checking fd mismatch
Avoid false positive since 0.0.0.0 in some systems is mapped
to other IPs.
2024-07-12 11:24:29 -07:00
Yuchen Wu
09b5e03fb1 Provide or_fail() for convenience error conversion. 2024-07-12 11:24:29 -07:00
Yuchen Wu
9a68268da5 Add an example to create and import 3rd party modules 2024-07-12 11:24:29 -07:00
Yuchen Wu
5397e2bd56 Change from debug to display when socket mismatch happens
The display format contains more useful info.
2024-07-12 11:24:29 -07:00
Yuchen Wu
0035064d04 Provide a group key for connection reuse isolation 2024-07-12 11:24:29 -07:00
Yuchen Wu
cdefa5c431 Mark the error source from get_http_session()
Although it is implied that fail_to_connect() errors are already caused
by upstream connections, it is more clear for the user's code inside this callback
by marking the error source in this case.
2024-07-12 11:24:29 -07:00
Yuchen Wu
65b1d6c733 Invoke request_body_filter of modules for proxies 2024-07-12 11:24:29 -07:00
Yuchen Wu
ee7f66082f Allow to create a new connection when the current one is shutting down
When we see a GOAWAY(NO_ERROR), the connector no longer fail the entire request.
Now the connector creates a new connection instead.
2024-07-12 11:24:29 -07:00
Matthew Gumport
38a9d556b5 make seeded estimator and plumbing for tests
I started fidgeting with another one of the tests breaking because of the
estimator not being deterministic, and then decided to do this another way.

This adds `seeded` and `seeded_compact` constructors to the estimator which are
used in tests to override the LFU. These are hidden behind `cfg(test)`. The
`random_status` field of the UFO object is also overridden with the same seeds
as used for the seeded LFU.

These make the tests pass consistently without requiring further monkeying.
2024-06-28 12:34:25 -07:00
Edward Wang
a483902c46 Change max allowed resp headers in HeaderSerde to match H1 max
Currently the allowed max is hardcoded, the HeaderSerde should match the
H1 max count to avoid problems deserializing from cache.
2024-06-28 12:34:25 -07:00
Kevin Guthrie
c67b5d0141 Add a replacement cli-parsing function for Opt that can be used in quickstart with no external dependencies 2024-06-28 12:34:25 -07:00
Wladimir Palant
86e6cd2912 Fixes #261 - Better Default implementation for Opt
---
Empty commit to trigger checks again
---
Another empty commit to trigger checks

Includes-commit: 0e9d853e05
Includes-commit: 1237b26493
Includes-commit: 6fdaf38b63
Replicated-from: https://github.com/cloudflare/pingora/pull/272
2024-06-28 12:34:25 -07:00
Andrew Hauck
ace9d4f135 Update comments on digest functions 2024-06-28 12:34:25 -07:00
Wladimir Palant
23c0378ce6 Fixes #270 - Add Session::digest_mut() method
Includes-commit: 5dd90aadd2
Replicated-from: https://github.com/cloudflare/pingora/pull/271
2024-06-28 12:34:25 -07:00
Yuchen Wu
92bbeb1139 Parse UDS with prefix
Now UDS can be parsed from string with prefix "unix:". The raw path
support will be deprecated.

From https://github.com/cloudflare/pingora/pull/141

Co-authored-by: blackanger <blackanger.z@gmail.com>
2024-06-28 12:34:25 -07:00
Yuchen Wu
62ddb7ebae Move adding ResponseCompression module logic to init_downstream_modules
So that users can override this behavior.
2024-06-28 12:34:25 -07:00
Wladimir Palant
dda7bec58c Added init_downstream_modules phase allowing modules to be set up before startup
Includes-commit: 1bf3d4dfea
Replicated-from: https://github.com/cloudflare/pingora/pull/284
2024-06-28 12:34:25 -07:00
Yuchen Wu
1176af300b Make type alias http::Module public
Easier for 3rd party to implement the trait.
2024-06-28 12:34:25 -07:00
Yuchen Wu
f9148430db Report evction/invalidtion types
This helps the storage to log/track different type of cache deletions.
2024-06-28 12:34:25 -07:00
Edward Wang
03bd29044e Always respect_keepalive when releasing http session
When a user calls `release_http_session` on an http Connector, it is
usually implied that they intend to reuse the underlying connection if
possible. Previously for H1 this involved reaching into the H1 client
Session and calling `respect_keepalive`. The new behavior always
respects keepalive as part of releasing the http session, as it was very
easy to overlook this step and unintentionally disable connection reuse
for H1 sessions.
2024-06-28 12:34:25 -07:00
Andrew Hauck
fbf3a95749 Add a write timeout to write body buf and an option to set a minimum send rate 2024-06-28 12:34:25 -07:00
Edward Wang
6e83d51ab1 Add is_hit fn to RTCache CacheStatus 2024-06-28 12:34:25 -07:00
Yuchen Wu
c0b23c6736 Expose a few more TLS APIs 2024-06-28 12:34:25 -07:00
Wladimir Palant
05005e2a4d Fixes #234 - Clarify ServerConf documentation
Includes-commit: d9a37a1f38
Replicated-from: https://github.com/cloudflare/pingora/pull/273
2024-06-21 09:54:09 -07:00
Matthew Gumport
c943fc1c78 compression: allow setting level per algorithm
Fixes https://github.com/cloudflare/pingora/issues/228

This adds a function to set the compression level per supported algorithm. The
behavior of `adjust_level` is changed to set the level for all of the algorithms
such that it still behaves the same.
2024-06-21 09:54:09 -07:00
Edward Wang
9500e62855 Make ipv6_only flag an Option<bool>
Fixes #279. This allows falling back to the system default on None, or
explicitly setting false if the system default happens to be true.
2024-06-21 09:54:09 -07:00
Matthew Gumport
899d86c5d4 change tinyufo test to be deterministic
Previously the test would fail because the item evicted may be the entry (4,4,1)
failing admission. I adjusted the weights so that all weights for items besides
the one we want moved to the main cache are equal and the cache can only hold
three. The test then checks that 1 is moved to the main, the evicted key is
gone, and the other two are present.
2024-06-21 09:54:09 -07:00
Edward Wang
02111515c6 Expose TCP_INFO fields as pub 2024-06-21 09:54:09 -07:00
Andrew Hauck
a1f1ad8a43 h2c support 2024-06-21 09:54:09 -07:00
Wladimir Palant
2d30077683 Fixed typo in docs: connnection => connection
Includes-commit: bbef4bdd75
Replicated-from: https://github.com/cloudflare/pingora/pull/274
2024-06-21 09:54:09 -07:00
Yuchen Wu
4e251f663a Fxi clippy for Rust 1.79 2024-06-21 09:54:09 -07:00
Yuchen Wu
708e03211d Auto generate the size and verify it for setsockops calls
This avoids human error with stronger validation.
2024-06-21 09:54:09 -07:00
Ivan Babrou
bf07ed3f10 add get_socket_cookie helper
This cab be used for tracing to match the sockets in the kernel.
2024-06-21 09:54:09 -07:00
Andrew Hauck
d86c5855a0 Track write duration on Poll::Ready(Err) 2024-06-21 09:54:09 -07:00
Andrew Hauck
35b9f1db00 Remove Accept-Ranges header when response is compressed 2024-06-21 09:54:09 -07:00
James Munns
a432c2da9b Fix a couple of typos/grammar issues 2024-06-14 16:00:03 -07:00