[PATCH 00/23] per device dirty throttling -v8

Per device dirty throttling patches

These patches aim to improve balance_dirty_pages() and directly address three
issues:
1) inter device starvation
2) stacked device deadlocks
3) inter process starvation

1 and 2 are a direct result from removing the global dirty limit and using
per device dirty limits. By giving each device its own dirty limit is will
no longer starve another device, and the cyclic dependancy on the dirty limit
is broken.

In order to efficiently distribute the dirty limit across the independant
devices a floating proportion is used, this will allocate a share of the total
limit proportional to the device's recent activity.

3 is done by also scaling the dirty limit proportional to the current task's
recent dirty rate.

Changes since -v7:
- perpcu_counter renames (partially suggested by Linus)
- percpu_counter error handling
- bdi_init error handling
- fwd port to .23-rc1-mm


---
#
# cleanups
#
nfs_congestion_fixup.patch
#
# percpu_counter rework
#
percpu_counter_add.patch
percpu_counter_batch.patch
percpu_counter_add64.patch
percpu_counter_set.patch
percpu_counter_sum_positive.patch
percpu_counter_sum.patch
percpu_counter_init.patch
percpu_counter_init_irq.patch
#
# per BDI dirty pages
#
bdi_init.patch
bdi_init_container.patch
bdi_init_mtd.patch
mtd-bdi-fixups.patch
bdi_mtdconcat.patch
bdi_stat.patch
bdi_stat_reclaimable.patch
bdi_stat_writeback.patch
bdi_stat_sysfs.patch
#
# floating proportions
#
proportions.patch
proportions_single.patch
#
# per BDI dirty
#
writeback-balance-per-backing_dev.patch
dirty_pages2.patch
#
# debug foo
#
bdi_stat_debug.patch


-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

Relevant Pages

  • Re: [PATCH] mm: tracking shared dirty pages -v10
    ... the dirty limit is thus _effectively_ different (never mind even the ... page dirtying throttling itself - just the fact that we count the dirty ... My main worry has always been the effects of this on some strange load, ... the same that hasn't shown any huge flags per se (although the dirty limit ...
    (Linux-Kernel)
  • [PATCH 00/23] per device dirty throttling -v10
    ... Per device dirty throttling patches ... By giving each device its own dirty limit is will ...
    (Linux-Kernel)
  • [PATCH 00/23] per device dirty throttling -v9
    ... Per device dirty throttling patches ... By giving each device its own dirty limit is will ...
    (Linux-Kernel)
  • Re: [PATCH 10/10] mm: per device dirty threshold
    ... By decoupling the BDI dirty thresholds a number of problems we currently have ... deadlocks with stacked BDIs ... By giving each BDI a 'fair' share of the dirty limit, ... A global threshold also creates a deadlock for stacked BDIs; ...
    (Linux-Kernel)