averello/linux-stable-mirror
1
0
Fork 0
mirror of https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git synced 2026-08-14 06:22:34 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
792000fbcd0ca32f358c4e14eaa40a73690be24c
linux-stable-mirror/net/ipv4
T
History
Eric Dumazet 0ae1ac7335 tcp: remove one ktime_get() from recvmsg() fast path 
Each time some payload is consumed by user space (recvmsg() and friends),
TCP calls tcp_rcv_space_adjust() to run DRS algorithm to check
if an increase of sk->sk_rcvbuf is needed.

This function is based on time sampling, and currently calls
tcp_mstamp_refresh(tp), which is a wrapper around ktime_get_ns().

ktime_get_ns() has a high cost on some platforms.
100+ cycles for rdtscp on AMD EPYC Turin for instance.

We do not have to refresh tp->tcp_mpstamp, using the last cached value
is enough. We only need to refresh it from __tcp_cleanup_rbuf()
if an ACK must be sent (this is a rare event).

Signed-off-by: Eric Dumazet <edumazet@google.com>
Reviewed-by: Kuniyuki Iwashima <kuniyu@google.com>
Link: https://patch.msgid.link/20251024120707.3516550-1-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
2025-10-27 18:15:38 -07:00
..
netfilter
netfilter: nf_reject: don't reply to icmp error messages
2025-09-11 15:40:55 +02:00
af_inet.c
sctp: Use sctp_clone_sock() in sctp_do_peeloff().
2025-10-27 18:04:58 -07:00
ah4.c
…
arp.c
neighbour: Convert rwlock of struct neigh_table to spinlock.
2025-10-24 17:57:20 -07:00
bpf_tcp_ca.c
tcp: Pass flags to __tcp_send_ack
2025-03-17 13:56:38 +00:00
cipso_ipv4.c
ipv4: icmp: Pass IPv4 control block structure as an argument to __icmp_send()
2025-09-11 12:22:38 +02:00
datagram.c
net: dst: annotate data-races around dst->obsolete
2025-07-02 14:32:29 -07:00
devinet.c
ipv4: Fix NULL vs error pointer check in inet_blackhole_dev_init()
2025-09-03 16:58:44 -07:00
esp4_offload.c
…
esp4.c
tcp: Don't pass hashinfo to socket lookup helpers.
2025-08-25 17:53:35 -07:00
fib_frontend.c
ipv4: Convert ->flowi4_tos to dscp_t.
2025-08-26 17:34:31 -07:00
fib_lookup.h
…
fib_notifier.c
…
fib_rules.c
ipv4: Convert ->flowi4_tos to dscp_t.
2025-08-26 17:34:31 -07:00
fib_semantics.c
net: s/dev_get_flags/netif_get_flags/
2025-07-18 17:27:47 -07:00
fib_trie.c
ipv4: fib: Move fib_valid_key_len() to rtm_to_fib_config().
2025-03-03 15:04:11 -08:00
fou_bpf.c
…
fou_core.c
net: gro: remove is_ipv6 from napi_gro_cb
2025-09-25 12:42:49 +02:00
fou_nl.c
netlink: specs: fou: change local-v6/peer-v6 check
2025-09-03 15:16:49 -07:00
fou_nl.h
…
gre_demux.c
net: ip_gre: Fix spelling mistake "demultiplexor" -> "demultiplexer"
2025-04-24 18:20:40 -07:00
gre_offload.c
…
icmp.c
ipv4: icmp: Fix source IP derivation in presence of VRFs
2025-09-11 12:22:38 +02:00
igmp_internal.h
…
igmp.c
ipv4: adopt dst_dev, skb_dst_dev and skb_dst_dev_net[_rcu]
2025-07-02 14:32:30 -07:00
inet_connection_sock.c
tcp: Save lock_sock() for memcg in inet_csk_accept().
2025-10-16 12:04:47 -07:00
inet_diag.c
inet_diag: avoid cache line misses in inet_diag_bc_sk()
2025-08-29 19:29:24 -07:00
inet_fragment.c
net: replace use of system_wq with system_percpu_wq
2025-09-22 17:40:30 -07:00
inet_hashtables.c
inet: Avoid ehash lookup race in inet_ehash_insert()
2025-10-17 16:08:43 -07:00
inet_timewait_sock.c
inet: Avoid ehash lookup race in inet_twsk_hashdance_schedule()
2025-10-17 16:08:43 -07:00
inetpeer.c
…
ip_forward.c
…
ip_fragment.c
ipv4: start using dst_dev_rcu()
2025-08-29 19:36:32 -07:00
ip_gre.c
ipv4: Convert ->flowi4_tos to dscp_t.
2025-08-26 17:34:31 -07:00
ip_input.c
net: ipv4: convert ip_rcv_options to drop reasons
2025-09-19 17:35:52 -07:00
ip_options.c
net: Switch to skb_dstref_steal/skb_dstref_restore for ip_route_input callers
2025-08-19 17:54:35 -07:00
ip_output.c
net: psp: don't assume reply skbs will have a socket
2025-10-03 10:23:50 -07:00
ip_sockglue.c
…
ip_tunnel_core.c
tunnels: reset the GSO metadata before reusing the skb
2025-09-09 13:03:33 +02:00
ip_tunnel.c
net/ip6_tunnel: Prevent perpetual tunnel growth
2025-10-13 17:43:46 -07:00
ip_vti.c
ipv4: adopt dst_dev, skb_dst_dev and skb_dst_dev_net[_rcu]
2025-07-02 14:32:30 -07:00
ipcomp.c
xfrm: delete x->tunnel as we delete x
2025-07-08 13:28:27 +02:00
ipconfig.c
net: ipconfig: convert timeouts to secs_to_jiffies()
2025-07-09 19:25:01 -07:00
ipip.c
ipv4: ip_tunnel: Convert ip_tunnel_delete_nets() callers to ->exit_rtnl().
2025-04-14 17:08:42 -07:00
ipmr_base.c
…
ipmr.c
ipv4: start using dst_dev_rcu()
2025-08-29 19:36:32 -07:00
Kconfig
tcp: Convert tcp-md5 to use MD5 library instead of crypto_ahash
2025-10-17 17:14:54 -07:00
Makefile
…
metrics.c
…
netfilter.c
ipv4: Convert ->flowi4_tos to dscp_t.
2025-08-26 17:34:31 -07:00
netlink.c
…
nexthop.c
Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net
2025-09-25 11:00:59 -07:00
ping.c
inet: ping: use EXPORT_IPV6_MOD[_GPL]()
2025-09-01 13:15:14 -07:00
proc.c
ipv4: snmp: do not use SNMP_MIB_SENTINEL anymore
2025-09-08 18:06:20 -07:00
protocol.c
…
raw_diag.c
inet_diag: change inet_diag_bc_sk() first argument
2025-08-29 19:29:24 -07:00
raw.c
inet: raw: add drop_counters to raw sockets
2025-08-28 13:14:50 +02:00
route.c
ipv4: icmp: Pass IPv4 control block structure as an argument to __icmp_send()
2025-09-11 12:22:38 +02:00
syncookies.c
tcp: accecn: AccECN negotiation
2025-09-18 08:47:51 +02:00
sysctl_net_ipv4.c
tcp: accecn: AccECN option send control
2025-09-18 08:47:52 +02:00
tcp_ao.c
Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net
2025-09-18 11:26:06 -07:00
tcp_bbr.c
…
tcp_bic.c
…
tcp_bpf.c
tcp_bpf: Call sk_msg_free() when tcp_bpf_send_verdict() fails to allocate psock->cork.
2025-09-10 06:53:56 -07:00
tcp_cdg.c
tcp: cdg: remove redundant __GFP_NOWARN
2025-08-12 14:05:43 -07:00
tcp_cong.c
…
tcp_cubic.c
…
tcp_dctcp.c
tcp: helpers for ECN mode handling
2025-03-17 13:54:11 +00:00
tcp_dctcp.h
tcp: Pass flags to __tcp_send_ack
2025-03-17 13:56:38 +00:00
tcp_diag.c
inet_diag: change inet_diag_bc_sk() first argument
2025-08-29 19:29:24 -07:00
tcp_fastopen.c
tcp: use dst_dev_rcu() in tcp_fastopen_active_disable_ofo_check()
2025-08-29 19:36:32 -07:00
tcp_highspeed.c
…
tcp_htcp.c
…
tcp_hybla.c
…
tcp_illinois.c
…
tcp_input.c
tcp: remove one ktime_get() from recvmsg() fast path
2025-10-27 18:15:38 -07:00
tcp_ipv4.c
tcp: Convert tcp-md5 to use MD5 library instead of crypto_ahash
2025-10-17 17:14:54 -07:00
tcp_lp.c
…
tcp_metrics.c
Merge tag 'net-next-6.18' of git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net-next
2025-10-02 15:17:01 -07:00
tcp_minisocks.c
tcp: Convert tcp-md5 to use MD5 library instead of crypto_ahash
2025-10-17 17:14:54 -07:00
tcp_nv.c
…
tcp_offload.c
net: gso: restore ids of outer ip headers correctly
2025-09-25 12:42:49 +02:00
tcp_output.c
net: Allow opt-out from global protocol memory accounting.
2025-10-16 12:04:47 -07:00
tcp_plb.c
…
tcp_rate.c
…
tcp_recovery.c
tcp: update the outdated ref draft-ietf-tcpm-rack
2025-07-08 09:01:52 -07:00
tcp_scalable.c
…
tcp_sigpool.c
…
tcp_timer.c
tcp: annotate data-races around icsk->icsk_probes_out
2025-08-25 16:20:59 -07:00
tcp_ulp.c
…
tcp_vegas.c
…
tcp_vegas.h
…
tcp_veno.c
…
tcp_westwood.c
…
tcp_yeah.c
…
tcp.c
tcp: remove one ktime_get() from recvmsg() fast path
2025-10-27 18:15:38 -07:00
tunnel4.c
…
udp_bpf.c
…
udp_diag.c
inet_diag: change inet_diag_bc_sk() first argument
2025-08-29 19:29:24 -07:00
udp_impl.h
udp: move udp_memory_allocated into net_aligned_data
2025-07-02 14:22:02 -07:00
udp_offload.c
net: gro: remove is_ipv6 from napi_gro_cb
2025-09-25 12:42:49 +02:00
udp_tunnel_core.c
ipv4: Convert ->flowi4_tos to dscp_t.
2025-08-26 17:34:31 -07:00
udp_tunnel_nic.c
udp_tunnel: use netdev_warn() instead of netdev_WARN()
2025-09-11 19:09:48 -07:00
udp_tunnel_stub.c
…
udp.c
udp: do not use skb_release_head_state() before skb_attempt_defer_free()
2025-10-16 16:03:07 +02:00
udplite.c
udp: move udp_memory_allocated into net_aligned_data
2025-07-02 14:22:02 -07:00
xfrm4_input.c
xfrm: Set transport header to fix UDP GRO handling
2025-07-02 09:19:56 +02:00
xfrm4_output.c
ipv4: adopt dst_dev, skb_dst_dev and skb_dst_dev_net[_rcu]
2025-07-02 14:32:30 -07:00
xfrm4_policy.c
ipv4: Convert ->flowi4_tos to dscp_t.
2025-08-26 17:34:31 -07:00
xfrm4_protocol.c
…
xfrm4_state.c
…
xfrm4_tunnel.c
…