Bug#908216: btrfs blocked for more than 120 seconds

From	"Russell Mosemann" <rmosemann@futurefoam.com>
Newsgroups	linux.debian.bugs.dist, linux.debian.kernel
Subject	Bug#908216: btrfs blocked for more than 120 seconds
Date	2019-02-25 01:20 +0100
Message-ID	<xvc9X-3eU-1@gated-at.bofh.it> (permalink)
References	<wvon0-eY-13@gated-at.bofh.it>
Organization	linux.* mail to news gateway

Cross-posted to 2 groups.

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

Package: src:linux
Version: 4.19.16-1~bpo9+1
Severity: important
 
Feb 24 17:19:32 vhost002 kernel: INFO: task btrfs-transacti:643 blocked for more than 120 seconds.
Feb 24 17:19:32 vhost002 kernel:       Not tainted 4.19.0-0.bpo.2-amd64 #1 Debian 4.19.16-1~bpo9+1
Feb 24 17:19:32 vhost002 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 24 17:19:32 vhost002 kernel: btrfs-transacti D    0   643      2 0x80000000
Feb 24 17:19:32 vhost002 kernel: Call Trace:
Feb 24 17:19:32 vhost002 kernel:  ? __schedule+0x3f5/0x880
Feb 24 17:19:32 vhost002 kernel:  schedule+0x32/0x80
Feb 24 17:19:32 vhost002 kernel:  btrfs_start_ordered_extent+0xed/0x120 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? remove_wait_queue+0x60/0x60
Feb 24 17:19:32 vhost002 kernel:  btrfs_wait_ordered_range+0xa0/0x100 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  __btrfs_wait_cache_io+0x46/0x1c0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  btrfs_write_dirty_block_groups+0x109/0x3d0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? btrfs_run_delayed_refs+0x88/0x1b0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  commit_cowonly_roots+0x245/0x2f0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  btrfs_commit_transaction+0x36f/0x8a0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? start_transaction+0x8f/0x3e0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  transaction_kthread+0x157/0x180 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  kthread+0xf8/0x130
Feb 24 17:19:32 vhost002 kernel:  ? btrfs_cleanup_transaction+0x500/0x500 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? kthread_create_worker_on_cpu+0x70/0x70
Feb 24 17:19:32 vhost002 kernel:  ret_from_fork+0x35/0x40
Feb 24 17:19:32 vhost002 kernel: INFO: task kworker/u24:0:27234 blocked for more than 120 seconds.
Feb 24 17:19:32 vhost002 kernel:       Not tainted 4.19.0-0.bpo.2-amd64 #1 Debian 4.19.16-1~bpo9+1
Feb 24 17:19:32 vhost002 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 24 17:19:32 vhost002 kernel: kworker/u24:0   D    0 27234      2 0x80000000
Feb 24 17:19:32 vhost002 kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Feb 24 17:19:32 vhost002 kernel: Call Trace:
Feb 24 17:19:32 vhost002 kernel:  ? __schedule+0x3f5/0x880
Feb 24 17:19:32 vhost002 kernel:  schedule+0x32/0x80
Feb 24 17:19:32 vhost002 kernel:  wait_current_trans+0xb9/0xf0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? remove_wait_queue+0x60/0x60
Feb 24 17:19:32 vhost002 kernel:  start_transaction+0x201/0x3e0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  btrfs_finish_ordered_io+0x48d/0x7e0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  normal_work_helper+0xd0/0x320 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? move_linked_works+0x6e/0xa0
Feb 24 17:19:32 vhost002 kernel:  process_one_work+0x191/0x370
Feb 24 17:19:32 vhost002 kernel:  worker_thread+0x4f/0x3b0
Feb 24 17:19:32 vhost002 kernel:  kthread+0xf8/0x130
Feb 24 17:19:32 vhost002 kernel:  ? rescuer_thread+0x340/0x340
Feb 24 17:19:32 vhost002 kernel:  ? kthread_create_worker_on_cpu+0x70/0x70
Feb 24 17:19:32 vhost002 kernel:  ret_from_fork+0x35/0x40

Feb 24 17:19:32 vhost002 kernel: INFO: task kworker/u24:7:14641 blocked for more than 120 seconds.
Feb 24 17:19:32 vhost002 kernel:       Not tainted 4.19.0-0.bpo.2-amd64 #1 Debian 4.19.16-1~bpo9+1
Feb 24 17:19:32 vhost002 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 24 17:19:32 vhost002 kernel: kworker/u24:7   D    0 14641      2 0x80000000
Feb 24 17:19:32 vhost002 kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Feb 24 17:19:32 vhost002 kernel: Call Trace:
Feb 24 17:19:32 vhost002 kernel:  ? __schedule+0x3f5/0x880
Feb 24 17:19:32 vhost002 kernel:  schedule+0x32/0x80
Feb 24 17:19:32 vhost002 kernel:  wait_current_trans+0xb9/0xf0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? remove_wait_queue+0x60/0x60
Feb 24 17:19:32 vhost002 kernel:  start_transaction+0x201/0x3e0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  btrfs_finish_ordered_io+0x48d/0x7e0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  normal_work_helper+0xd0/0x320 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? move_linked_works+0x6e/0xa0
Feb 24 17:19:32 vhost002 kernel:  process_one_work+0x191/0x370
Feb 24 17:19:32 vhost002 kernel:  worker_thread+0x4f/0x3b0
Feb 24 17:19:32 vhost002 kernel:  kthread+0xf8/0x130
Feb 24 17:19:32 vhost002 kernel:  ? rescuer_thread+0x340/0x340
Feb 24 17:19:32 vhost002 kernel:  ? kthread_create_worker_on_cpu+0x70/0x70
Feb 24 17:19:32 vhost002 kernel:  ret_from_fork+0x35/0x40
Feb 24 17:19:32 vhost002 kernel: INFO: task kworker/u24:8:14642 blocked for more than 120 seconds.
Feb 24 17:19:32 vhost002 kernel:       Not tainted 4.19.0-0.bpo.2-amd64 #1 Debian 4.19.16-1~bpo9+1
Feb 24 17:19:32 vhost002 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 24 17:19:32 vhost002 kernel: kworker/u24:8   D    0 14642      2 0x80000000
Feb 24 17:19:32 vhost002 kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Feb 24 17:19:32 vhost002 kernel: Call Trace:
Feb 24 17:19:32 vhost002 kernel:  ? __schedule+0x3f5/0x880
Feb 24 17:19:32 vhost002 kernel:  ? _raw_spin_lock_irqsave+0x32/0x40
Feb 24 17:19:32 vhost002 kernel:  schedule+0x32/0x80
Feb 24 17:19:32 vhost002 kernel:  wait_current_trans+0xb9/0xf0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? remove_wait_queue+0x60/0x60
Feb 24 17:19:32 vhost002 kernel:  start_transaction+0x201/0x3e0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  btrfs_finish_ordered_io+0x48d/0x7e0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  normal_work_helper+0xd0/0x320 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? move_linked_works+0x6e/0xa0
Feb 24 17:19:32 vhost002 kernel:  process_one_work+0x191/0x370
Feb 24 17:19:32 vhost002 kernel:  worker_thread+0x4f/0x3b0
Feb 24 17:19:32 vhost002 kernel:  kthread+0xf8/0x130
Feb 24 17:19:32 vhost002 kernel:  ? rescuer_thread+0x340/0x340
Feb 24 17:19:32 vhost002 kernel:  ? kthread_create_worker_on_cpu+0x70/0x70
Feb 24 17:19:32 vhost002 kernel:  ret_from_fork+0x35/0x40

Feb 24 17:19:32 vhost002 kernel: INFO: task kworker/u24:10:14644 blocked for more than 120 seconds.
Feb 24 17:19:32 vhost002 kernel:       Not tainted 4.19.0-0.bpo.2-amd64 #1 Debian 4.19.16-1~bpo9+1
Feb 24 17:19:32 vhost002 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 24 17:19:32 vhost002 kernel: kworker/u24:10  D    0 14644      2 0x80000000
Feb 24 17:19:32 vhost002 kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Feb 24 17:19:32 vhost002 kernel: Call Trace:
Feb 24 17:19:32 vhost002 kernel:  ? __schedule+0x3f5/0x880
Feb 24 17:19:32 vhost002 kernel:  schedule+0x32/0x80
Feb 24 17:19:32 vhost002 kernel:  wait_current_trans+0xb9/0xf0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? remove_wait_queue+0x60/0x60
Feb 24 17:19:32 vhost002 kernel:  start_transaction+0x201/0x3e0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  btrfs_finish_ordered_io+0x48d/0x7e0 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  normal_work_helper+0xd0/0x320 [btrfs]
Feb 24 17:19:32 vhost002 kernel:  ? move_linked_works+0x6e/0xa0
Feb 24 17:19:32 vhost002 kernel:  process_one_work+0x191/0x370
Feb 24 17:19:32 vhost002 kernel:  worker_thread+0x4f/0x3b0
Feb 24 17:19:32 vhost002 kernel:  kthread+0xf8/0x130
Feb 24 17:19:32 vhost002 kernel:  ? rescuer_thread+0x340/0x340
Feb 24 17:19:32 vhost002 kernel:  ? kthread_create_worker_on_cpu+0x70/0x70
Feb 24 17:19:32 vhost002 kernel:  ret_from_fork+0x35/0x40
Feb 24 17:19:32 vhost002 kernel: INFO: task kworker/u24:13:14647 blocked for more than 120 seconds.
Feb 24 17:19:32 vhost002 kernel:       Not tainted 4.19.0-0.bpo.2-amd64 #1 Debian 4.19.16-1~bpo9+1
Feb 24 17:19:32 vhost002 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 24 17:19:32 vhost002 kernel: kworker/u24:13  D    0 14647      2 0x80000000
Feb 24 17:19:32 vhost002 kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Feb 24 17:19:32 vhost002 kernel: Call Trace:
Feb 24 17:19:32 vhost002 kernel:  ? __schedule+0x3f5/0x880
Feb 24 17:19:32 vhost002 kernel:  schedule+0x32/0x80
Feb 24 17:19:32 vhost002 kernel:  wait_current_trans+0xb9/0xf0 [btrfs]
Feb 24 17:19:33 vhost002 kernel:  ? remove_wait_queue+0x60/0x60
Feb 24 17:19:33 vhost002 kernel:  start_transaction+0x201/0x3e0 [btrfs]
Feb 24 17:19:33 vhost002 kernel:  btrfs_finish_ordered_io+0x48d/0x7e0 [btrfs]
Feb 24 17:19:33 vhost002 kernel:  normal_work_helper+0xd0/0x320 [btrfs]
Feb 24 17:19:33 vhost002 kernel:  ? move_linked_works+0x6e/0xa0
Feb 24 17:19:33 vhost002 kernel:  process_one_work+0x191/0x370
Feb 24 17:19:33 vhost002 kernel:  worker_thread+0x4f/0x3b0
Feb 24 17:19:33 vhost002 kernel:  kthread+0xf8/0x130
Feb 24 17:19:33 vhost002 kernel:  ? rescuer_thread+0x340/0x340
Feb 24 17:19:33 vhost002 kernel:  ? kthread_create_worker_on_cpu+0x70/0x70
Feb 24 17:19:33 vhost002 kernel:  ret_from_fork+0x35/0x40

Feb 24 17:19:33 vhost002 kernel: INFO: task kworker/u24:14:14648 blocked for more than 120 seconds.
Feb 24 17:19:33 vhost002 kernel:       Not tainted 4.19.0-0.bpo.2-amd64 #1 Debian 4.19.16-1~bpo9+1
Feb 24 17:19:33 vhost002 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 24 17:19:33 vhost002 kernel: kworker/u24:14  D    0 14648      2 0x80000000
Feb 24 17:19:33 vhost002 kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Feb 24 17:19:33 vhost002 kernel: Call Trace:
Feb 24 17:19:33 vhost002 kernel:  ? __schedule+0x3f5/0x880
Feb 24 17:19:33 vhost002 kernel:  schedule+0x32/0x80
Feb 24 17:19:33 vhost002 kernel:  wait_current_trans+0xb9/0xf0 [btrfs]
Feb 24 17:19:33 vhost002 kernel:  ? remove_wait_queue+0x60/0x60
Feb 24 17:19:33 vhost002 kernel:  start_transaction+0x201/0x3e0 [btrfs]
Feb 24 17:19:33 vhost002 kernel:  btrfs_finish_ordered_io+0x48d/0x7e0 [btrfs]
Feb 24 17:19:33 vhost002 kernel:  normal_work_helper+0xd0/0x320 [btrfs]
Feb 24 17:19:33 vhost002 kernel:  ? move_linked_works+0x6e/0xa0
Feb 24 17:19:33 vhost002 kernel:  process_one_work+0x191/0x370
Feb 24 17:19:33 vhost002 kernel:  worker_thread+0x4f/0x3b0
Feb 24 17:19:33 vhost002 kernel:  kthread+0xf8/0x130
Feb 24 17:19:33 vhost002 kernel:  ? rescuer_thread+0x340/0x340
Feb 24 17:19:33 vhost002 kernel:  ? kthread_create_worker_on_cpu+0x70/0x70
Feb 24 17:19:33 vhost002 kernel:  ret_from_fork+0x35/0x40
Feb 24 17:19:33 vhost002 kernel: INFO: task kworker/u24:18:14652 blocked for more than 120 seconds.
Feb 24 17:19:33 vhost002 kernel:       Not tainted 4.19.0-0.bpo.2-amd64 #1 Debian 4.19.16-1~bpo9+1
Feb 24 17:19:33 vhost002 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 24 17:19:33 vhost002 kernel: kworker/u24:18  D    0 14652      2 0x80000000
Feb 24 17:19:33 vhost002 kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Feb 24 17:19:33 vhost002 kernel: Call Trace:
Feb 24 17:19:33 vhost002 kernel:  ? __schedule+0x3f5/0x880
Feb 24 17:19:33 vhost002 kernel:  schedule+0x32/0x80
Feb 24 17:19:33 vhost002 kernel:  wait_current_trans+0xb9/0xf0 [btrfs]
Feb 24 17:19:33 vhost002 kernel:  ? remove_wait_queue+0x60/0x60
Feb 24 17:19:33 vhost002 kernel:  start_transaction+0x201/0x3e0 [btrfs]
Feb 24 17:19:33 vhost002 kernel:  btrfs_finish_ordered_io+0x48d/0x7e0 [btrfs]
Feb 24 17:19:33 vhost002 kernel:  normal_work_helper+0xd0/0x320 [btrfs]
Feb 24 17:19:34 vhost002 kernel:  ? move_linked_works+0x6e/0xa0
Feb 24 17:19:34 vhost002 kernel:  process_one_work+0x191/0x370
Feb 24 17:19:34 vhost002 kernel:  worker_thread+0x4f/0x3b0
Feb 24 17:19:34 vhost002 kernel:  kthread+0xf8/0x130
Feb 24 17:19:34 vhost002 kernel:  ? rescuer_thread+0x340/0x340
Feb 24 17:19:34 vhost002 kernel:  ? kthread_create_worker_on_cpu+0x70/0x70
Feb 24 17:19:34 vhost002 kernel:  ret_from_fork+0x35/0x40

Feb 24 17:19:34 vhost002 kernel: INFO: task kworker/u24:19:14653 blocked for more than 120 seconds.
Feb 24 17:19:34 vhost002 kernel:       Not tainted 4.19.0-0.bpo.2-amd64 #1 Debian 4.19.16-1~bpo9+1
Feb 24 17:19:34 vhost002 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 24 17:19:34 vhost002 kernel: kworker/u24:19  D    0 14653      2 0x80000000
Feb 24 17:19:34 vhost002 kernel: Workqueue: btrfs-endio-write btrfs_endio_write_helper [btrfs]
Feb 24 17:19:34 vhost002 kernel: Call Trace:
Feb 24 17:19:34 vhost002 kernel:  ? __schedule+0x3f5/0x880
Feb 24 17:19:34 vhost002 kernel:  schedule+0x32/0x80
Feb 24 17:19:34 vhost002 kernel:  wait_current_trans+0xb9/0xf0 [btrfs]
Feb 24 17:19:34 vhost002 kernel:  ? remove_wait_queue+0x60/0x60
Feb 24 17:19:34 vhost002 kernel:  start_transaction+0x201/0x3e0 [btrfs]
Feb 24 17:19:34 vhost002 kernel:  btrfs_finish_ordered_io+0x48d/0x7e0 [btrfs]
Feb 24 17:19:34 vhost002 kernel:  normal_work_helper+0xd0/0x320 [btrfs]
Feb 24 17:19:34 vhost002 kernel:  ? move_linked_works+0x6e/0xa0
Feb 24 17:19:34 vhost002 kernel:  process_one_work+0x191/0x370
Feb 24 17:19:34 vhost002 kernel:  worker_thread+0x4f/0x3b0
Feb 24 17:19:34 vhost002 kernel:  kthread+0xf8/0x130
Feb 24 17:19:34 vhost002 kernel:  ? rescuer_thread+0x340/0x340
Feb 24 17:19:34 vhost002 kernel:  ? kthread_create_worker_on_cpu+0x70/0x70
Feb 24 17:19:34 vhost002 kernel:  ret_from_fork+0x35/0x40

Feb 24 17:21:32 vhost002 kernel: INFO: task btrfs-transacti:643 blocked for more than 120 seconds.
Feb 24 17:21:33 vhost002 kernel:       Not tainted 4.19.0-0.bpo.2-amd64 #1 Debian 4.19.16-1~bpo9+1
Feb 24 17:21:33 vhost002 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 24 17:21:33 vhost002 kernel: btrfs-transacti D    0   643      2 0x80000000
Feb 24 17:21:33 vhost002 kernel: Call Trace:
Feb 24 17:21:33 vhost002 kernel:  ? __schedule+0x3f5/0x880
Feb 24 17:21:33 vhost002 kernel:  schedule+0x32/0x80
Feb 24 17:21:33 vhost002 kernel:  btrfs_start_ordered_extent+0xed/0x120 [btrfs]
Feb 24 17:21:33 vhost002 kernel:  ? remove_wait_queue+0x60/0x60
Feb 24 17:21:33 vhost002 kernel:  btrfs_wait_ordered_range+0xa0/0x100 [btrfs]
Feb 24 17:21:33 vhost002 kernel:  __btrfs_wait_cache_io+0x46/0x1c0 [btrfs]
Feb 24 17:21:33 vhost002 kernel:  btrfs_write_dirty_block_groups+0x109/0x3d0 [btrfs]
Feb 24 17:21:33 vhost002 kernel:  ? btrfs_run_delayed_refs+0x88/0x1b0 [btrfs]
Feb 24 17:21:33 vhost002 kernel:  commit_cowonly_roots+0x245/0x2f0 [btrfs]
Feb 24 17:21:33 vhost002 kernel:  btrfs_commit_transaction+0x36f/0x8a0 [btrfs]
Feb 24 17:21:33 vhost002 kernel:  ? start_transaction+0x8f/0x3e0 [btrfs]
Feb 24 17:21:33 vhost002 kernel:  transaction_kthread+0x157/0x180 [btrfs]
Feb 24 17:21:33 vhost002 kernel:  kthread+0xf8/0x130
Feb 24 17:21:33 vhost002 kernel:  ? btrfs_cleanup_transaction+0x500/0x500 [btrfs]
Feb 24 17:21:33 vhost002 kernel:  ? kthread_create_worker_on_cpu+0x70/0x70
Feb 24 17:21:33 vhost002 kernel:  ret_from_fork+0x35/0x40

Back to linux.debian.kernel | Previous | Next | Find similar | Unroll thread

Thread

Bug#908216: btrfs blocked for more than 120 seconds "Russell Mosemann" <rmosemann@futurefoam.com> - 2019-02-25 01:20 +0100

csiph-web