High Pulsing I / O with dtrace errors

We experience a "pulsating" write to the disk (from 1 writes / sec pulse to 142+ writes / sec) every 10 seconds.

See an example image: https://discussions.apple.com/servlet/JiveServlet/showImage/2-22394173-269851/Screen+Shot+2013-07-03+at+13.22.28.png

We dug into these “impulse” recordings and found that they occur in exactly the same way as these IOTOP errors:

dtrace: error on enabled probe ID 5 (ID 992: io:mach_kernel:buf_strategy:start): illegal operation in action #3 at DIF offset 0 

"ripple" occurs only when the above error is displayed in IOTOP.

Note. We use Apple RAID software mirroring for two drives.

Any suggestions, help and advice are welcome. Thanks in advance.

+4
source share
1 answer

The pulsing I / O patterns that you see are typical for applications where many / most of the records in the file system are asynchronous - this is because the file system will load records so that it can do a lot at the same time, in order to avoid one disk searching for a record . The most common example I can think of is writing database data — with the exception of the database write log, everything is usually written asynchronously; Other transactional access patterns are generally similar because they have write-to-write logs to recover if some asynchronous writes are lost on failure. This is a common access pattern and is not necessarily a problem, but it can become a problem when your disk is very fragmented and the file system cannot write everything in batches (causing a lot of requests, as you tried to avoid).

The DTrace / iotop error that you see means either an error in the DTrace implementation itself or in the iotop DTrace script. After iotop at the iotop source code (in /usr/bin/iotop on OS X), there are three io:::start callbacks that may be the culprits. There may be some kind of null access pointer in the script for some types of I / O, but it does not look likely based on the script probes and the io:::start arguments. Perhaps this is best solved with an Apple error message.

+3
source

Source: https://habr.com/ru/post/1489494/


All Articles