Peter Xu fb04a1eddb KVM: X86: Implement ring-based dirty memory tracking ... This patch is heavily based on previous work from Lei Cao <lei.cao@stratus.com> and Paolo Bonzini <pbonzini@redhat.com>. [1] KVM currently uses large bitmaps to track dirty memory. These bitmaps are copied to userspace when userspace queries KVM for its dirty page information. The use of bitmaps is mostly sufficient for live migration, as large parts of memory are be dirtied from one log-dirty pass to another. However, in a checkpointing system, the number of dirty pages is small and in fact it is often bounded---the VM is paused when it has dirtied a pre-defined number of pages. Traversing a large, sparsely populated bitmap to find set bits is time-consuming, as is copying the bitmap to user-space. A similar issue will be there for live migration when the guest memory is huge while the page dirty procedure is trivial. In that case for each dirty sync we need to pull the whole dirty bitmap to userspace and analyse every bit even if it's mostly zeros. The preferred data structure for above scenarios is a dense list of guest frame numbers (GFN). This patch series stores the dirty list in kernel memory that can be memory mapped into userspace to allow speedy harvesting. This patch enables dirty ring for X86 only. However it should be easily extended to other archs as well. [1] https://patchwork.kernel.org/patch/10471409/ Signed-off-by: Lei Cao <lei.cao@stratus.com> Signed-off-by: Paolo Bonzini <pbonzini@redhat.com> Signed-off-by: Peter Xu <peterx@redhat.com> Message-Id: <20201001012222.5767-1-peterx@redhat.com> Signed-off-by: Paolo Bonzini <pbonzini@redhat.com>		2020-11-15 09:49:15 -05:00
..
9p.h	…
afs.h	afs: Fix afs_invalidatepage to adjust the dirty region	2020-10-29 13:53:04 +00:00
alarmtimer.h	…
asoc.h	…
avc.h	selinux: add basic filtering for audit trace events	2020-08-21 17:07:29 -04:00
bcache.h	bcache: add set_uuid in struct cache_set	2020-10-02 14:25:30 -06:00
block.h	blktrace: Provide event for request merging	2020-06-25 21:06:11 -06:00
bpf_test_run.h	selftests: bpf: test writable buffers in raw tps	2019-04-26 19:04:19 -07:00
bridge.h	net: bridge: fdb: br_fdb_update can take flags directly	2019-11-01 10:32:43 -07:00
btrfs.h	btrfs: use own btree inode io_tree owner id	2020-10-07 12:13:22 +02:00
cachefiles.h	treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 36	2019-05-24 17:27:11 +02:00
cgroup.h	cgroup: use cgrp->kn->id as the cgroup ID	2019-11-12 08:18:04 -08:00
clk.h	treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 282	2019-06-05 17:36:37 +02:00
cma.h	…
compaction.h	mm/page_alloc: integrate classzone_idx and high_zoneidx	2020-06-03 20:09:44 -07:00
context_tracking.h	…
cpuhp.h	treewide: Switch printk users from %pf and %pF to %ps and %pS, respectively	2019-04-09 14:19:06 +02:00
devfreq.h	trace: events: add devfreq trace event file	2019-04-16 09:29:18 +09:00
devlink.h	devlink: Add a tracepoint for trap reports	2020-09-30 18:01:26 -07:00
dma_fence.h	tracing: Fix header include guards in trace event headers	2019-07-30 21:49:06 -04:00
erofs.h	erofs: convert uncompressed files from readpages to readahead	2020-06-02 10:59:07 -07:00
ext4.h	ext4: disable fast commit with data journalling	2020-11-06 23:01:05 -05:00
f2fs.h	f2fs: trace: fix typo	2020-09-11 11:11:25 -07:00
fib.h	net: Replace nhc_has_gw with nhc_gw_family	2019-04-08 15:22:40 -07:00
fib6.h	ipv6: Add fib6_type and fib6_flags to fib6_result	2019-04-17 23:11:30 -07:00
filelock.h	locks: Remove extra "0x" in tracepoint format specifier	2020-09-01 18:09:34 -04:00
filemap.h	ftrace: Rework event_create_dir()	2019-11-27 07:44:25 +01:00
fs_dax.h	…
fscache.h	treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 36	2019-05-24 17:27:11 +02:00
fsi.h	trace: fsi: Print transfer size unsigned	2019-11-08 11:23:37 +01:00
fsi_master_aspeed.h	fsi: aspeed: Add trace points	2019-11-08 11:28:20 +01:00
fsi_master_ast_cf.h	…
fsi_master_gpio.h	…
gpio.h	tracing: stop making gpio tracing configurable	2019-04-08 15:11:48 +02:00
gpu_mem.h	gpu/trace: Minor comment updates for gpu_mem_total tracepoint	2020-05-07 13:32:57 -04:00
host1x.h	treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 1	2019-05-21 11:28:39 +02:00
huge_memory.h	khugepaged: introduce 'max_ptes_shared' tunable	2020-06-03 20:09:46 -07:00
hwmon.h	…
i2c.h	treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 36	2019-05-24 17:27:11 +02:00
ib_mad.h	IB/MAD: Add SMP details to MAD tracing	2019-03-27 15:52:01 -03:00
ib_umad.h	IB/UMAD: Add umad trace points	2019-03-27 15:52:01 -03:00
initcall.h	…
intel-sst.h	…
intel_iommu.h	iommu/vt-d: trace: Extend map_sg trace event	2020-01-07 14:05:57 +01:00
intel_ish.h	…
io_uring.h	io_uring: use poll driven retry for files that support it	2020-03-02 14:06:38 -07:00
iocost.h	iocost: add iocg_forgive_debt tracepoint	2020-09-25 08:35:02 -06:00
iommu.h	…
ipi.h	…
irq.h	…
irq_matrix.h	…
iscsi.h	…
jbd2.h	jbd2: Provide trace event for handle restarts	2019-11-05 16:00:49 -05:00
kmem.h	mm, tracing: print symbol name for kmem_alloc_node call_site events	2020-01-31 10:30:38 -08:00
kvm.h	KVM: X86: Implement ring-based dirty memory tracking	2020-11-15 09:49:15 -05:00
kyber.h	…
libata.h	…
lock.h	…
mce.h	…
mdio.h	…
migrate.h	mm/vmstat: add events for THP migration without split	2020-08-12 10:57:57 -07:00
mlxsw.h	mlxsw: spectrum_acl: Rename rehash_dis trace	2019-03-31 11:01:23 -07:00
mmap.h	mm: mmap: add trace point of vm_unmapped_area	2020-04-02 09:35:30 -07:00
mmc.h	…
mmflags.h	mm: Add PG_arch_2 page flag	2020-09-04 12:46:06 +01:00
module.h	…
napi.h	tracing: Fix header include guards in trace event headers	2019-07-30 21:49:06 -04:00
nbd.h	nbd: add tracepoints for send/receive timing	2019-04-26 19:04:19 -07:00
neigh.h	neighbor: Add tracepoint to __neigh_create	2019-05-22 17:50:24 -07:00
net.h	net: add a generic tracepoint for TX queue timeout	2019-05-04 00:41:41 -04:00
net_probe_common.h	…
nilfs2.h	…
nmi.h	…
objagg.h	…
oom.h	…
page_isolation.h	…
page_pool.h	page_pool: Add API to update numa node	2019-11-20 11:47:36 -08:00
page_ref.h	…
pagemap.h	…
percpu.h	…
power.h	PM: QoS: Simplify definitions of CPU latency QoS trace events	2020-02-13 11:26:39 +01:00
power_cpu_migrate.h	…
preemptirq.h	tracing: Change offset type to s32 in preempt/irq tracepoints	2020-01-03 11:34:37 -05:00
printk.h	…
pwc.h	…
pwm.h	pwm: Implement tracing for .get_state() and .apply_state()	2020-01-20 12:28:37 +01:00
qdisc.h	net_sched: add a tracepoint for qdisc creation	2020-05-27 15:05:49 -07:00
qla.h	scsi: qla2xxx: Suppress two recently introduced compiler warnings	2020-05-19 21:43:01 -04:00
qrtr.h	net: qrtr: Add tracepoint support	2020-04-22 12:55:54 -07:00
random.h	random32: add a tracepoint for prandom_u32()	2020-08-13 15:11:14 -07:00
rcu.h	rcu/trace: Print negative GP numbers correctly	2020-08-24 18:36:04 -07:00
rdma.h	RDMA/core: Move the rdma_show_ib_cm_event() macro	2020-08-24 16:01:47 -03:00
rdma_core.h	RDMA/core: Add trace points to follow MR allocation	2020-01-07 16:10:53 -04:00
regulator.h	regulator: core: Add regulator bypass trace points	2020-05-29 17:17:02 +01:00
rpcgss.h	SUNRPC: Augment server-side rpcgss tracepoints	2020-07-13 17:28:24 -04:00
rpcrdma.h	NFS Client Updates for Linux 5.10	2020-10-20 13:26:30 -07:00
rpm.h	PM-runtime: add tracepoints for usage_count changes	2020-01-13 12:28:29 +01:00
rseq.h	…
rtc.h	…
rxrpc.h	rxrpc: Fix a missing NULL-pointer check in a trace	2020-09-14 16:18:59 +01:00
sched.h	sched/debug: Add new tracepoint to track cpu_capacity	2020-10-03 16:30:52 +02:00
scmi.h	firmware: arm_scmi: Use signed integer to report transfer status	2020-06-30 14:07:08 +01:00
scsi.h	…
sctp.h	sctp: move trace_sctp_probe_path into sctp_outq_sack	2019-12-26 13:06:45 -08:00
signal.h	…
siox.h	…
skb.h	…
smbus.h	treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 36	2019-05-24 17:27:11 +02:00
sock.h	tcp: Define IPPROTO_MPTCP	2020-01-09 18:41:41 -08:00
spi.h	spi/trace: Cap buffer contents at 64 bytes	2019-05-02 10:37:52 +09:00
spmi.h	…
sunrpc.h	SUNRPC: Fix general protection fault in trace_rpc_xdr_overflow()	2020-11-05 17:20:12 -05:00
sunvnet.h	…
swiotlb.h	…
syscalls.h	syscalls: Remove start and number from syscall_get_arguments() args	2019-04-05 09:26:43 -04:00
target.h	scsi: target: core: Add CONTROL field for trace events	2020-10-02 18:36:19 -04:00
task.h	…
tcp.h	tcp: remove redundant new line from tcp_event_sk_skb	2019-11-09 19:41:50 -08:00
tegra_apb_dma.h	tracing: Fix header include guards in trace event headers	2019-07-30 21:49:06 -04:00
thermal.h	…
thermal_power_allocator.h	…
thp.h	…
timer.h	y2038: syscall implementation cleanups	2019-12-01 14:00:59 -08:00
tlb.h	…
udp.h	…
ufs.h	scsi: ufs: Add trace event for UIC commands	2020-06-15 23:35:06 -04:00
v4l2.h	media: v4l2: abstract timeval handling in v4l2_buffer	2020-01-03 15:43:35 +01:00
vb2.h	…
vmscan.h	mm/page_alloc: integrate classzone_idx and high_zoneidx	2020-06-03 20:09:44 -07:00
vsock_virtio_transport_common.h	…
wbt.h	bdi: use bdi_dev_name() to get device name	2020-05-09 16:07:39 -06:00
workqueue.h	workqueue: remove workqueue_work event class	2020-01-15 08:02:59 -08:00
writeback.h	writeback: Drop I_DIRTY_TIME_EXPIRE	2020-06-15 09:18:46 +02:00
xdp.h	bpf: cpumap: Implement XDP_REDIRECT for eBPF programs attached to map entries	2020-07-16 17:00:32 +02:00
xen.h	x86/paravirt: Remove set_pte_at() pv-op	2020-08-15 13:52:12 +02:00