Commit 29915202 authored Mar 24, 2011 by Mustafa Mesanovic Committed by Alasdair G Kergon Mar 24, 2011

dm stripe: implement merge method



Implement a merge function in the striped target.

When the striped target's underlying devices provide a merge_bvec_fn
(like all DM devices do via dm_merge_bvec) it is important to call down
to them when building a biovec that doesn't span a stripe boundary.

Without the merge method, a striped DM device stacked on DM devices
causes bios with a single page to be submitted which results
in unnecessary overhead that hurts performance.

This change really helps filesystems (e.g. XFS and now ext4) which take
care to assemble larger bios.  By implementing stripe_merge(), DM and the
stripe target no longer undermine the filesystem's work by only allowing
a single page per bio.  Buffered IO sees the biggest improvement
(particularly uncached reads, buffered writes to a lesser degree).  This
is especially so for more capable "enterprise" storage LUNs.

The performance improvement has been measured to be ~12-35% -- when a
reasonable chunk_size is used (e.g. 64K) in conjunction with a stripe
count that is a power of 2.

In contrast, the performance penalty is ~5-7% for the pathological worst
case stripe configuration (small chunk_size with a stripe count that is
not a power of 2).  The reason for this is that stripe_map_sector() is
now called once for every call to dm_merge_bvec().  stripe_map_sector()
will use slower division if stripe count isn't a power of 2.

Signed-off-by: Mustafa Mesanovic <mume@linux.vnet.ibm.com>
Signed-off-by: Mike Snitzer <snitzer@redhat.com>
Signed-off-by: Alasdair G Kergon <agk@redhat.com>

parent a490a07a

drivers/md/dm-stripe.c

+22 −1

Original line number	Diff line number	Diff line
		@@ -396,9 +396,29 @@ static void stripe_io_hints(struct dm_target *ti,
		blk_limits_io_opt(limits, chunk_size * sc->stripes);
		}

		static int stripe_merge(struct dm_target ti, struct bvec_merge_data bvm,
		struct bio_vec *biovec, int max_size)
		{
		struct stripe_c *sc = ti->private;
		sector_t bvm_sector = bvm->bi_sector;
		uint32_t stripe;
		struct request_queue *q;

		stripe_map_sector(sc, bvm_sector, &stripe, &bvm_sector);

		q = bdev_get_queue(sc->stripe[stripe].dev->bdev);
		if (!q->merge_bvec_fn)
		return max_size;

		bvm->bi_bdev = sc->stripe[stripe].dev->bdev;
		bvm->bi_sector = sc->stripe[stripe].physical_start + bvm_sector;

		return min(max_size, q->merge_bvec_fn(q, bvm, biovec));
		}

		static struct target_type stripe_target = {
		.name = "striped",
		.version = {1, 3, 1},
		.version = {1, 4, 0},
		.module = THIS_MODULE,
		.ctr = stripe_ctr,
		.dtr = stripe_dtr,
		@@ -407,6 +427,7 @@ static struct target_type stripe_target = {
		.status = stripe_status,
		.iterate_devices = stripe_iterate_devices,
		.io_hints = stripe_io_hints,
		.merge = stripe_merge,
		};

		int __init dm_stripe_init(void)

Admin message