3 `��g�B�@sjddlZddlmZddlTddlZddljZddlm Z ddl Z ddlZejj �ZGdd�dej�ZdS)�N�)�hotplug)�*)�commandscs�eZdZdZ�fdd�Z�fdd�Zdd�Zdd �Zed d��Z dd �Z dd�Z�fdd�Z�fdd�Z �fdd�Zedd��Zedd��Zdd�Zdd�Zdd�Zd d!�Zd"d#�Zd$d%�Zd&d'�Zd(d)�Zd*d+�Z�fd,d-�Zd.d/�ZdZd1d2�Zd3d4�Zed5d6d7�d8d9��Ze d5�d[d;d<��Z!ed=d6d7�d>d?��Z"e d=�d\d@dA��Z#edBd6d7�dCdD��Z$e dB�d]dEdF��Z%dGdH�Z&dIdJ�Z'edKd6d7�dLdM��Z(e dK�d^dNdO��Z)e*dPd6d7�dQdR��Z+dSdT�Z,edUd6d7�dVdW��Z-e dU�d_dXdY��Z.�Z/S)`� DiskPlugina� `disk`:: Plug-in for tuning various block device options. This plug-in can also dynamically change the advanced power management and spindown timeout setting for a drive according to the current drive utilization. The dynamic tuning is controlled by the [option]`dynamic` and the global [option]`dynamic_tuning` option in `tuned-main.conf`. + The disk plug-in operates on all supported block devices unless a comma separated list of [option]`devices` is passed to it. + .Operate only on the sda block device ==== ---- [disk] # Comma separated list of devices, all devices if commented out. devices=sda ---- ==== + The [option]`elevator` option sets the Linux I/O scheduler. + .Use the bfq I/O scheduler on xvda block device ==== ---- [disk] device=xvda elevator=bfq ---- ==== + The [option]`scheduler_quantum` option only applies to the CFQ I/O scheduler. It defines the number of I/O requests that CFQ sends to one device at one time, essentially limiting queue depth. The default value is 8 requests. The device being used may support greater queue depth, but increasing the value of quantum will also increase latency, especially for large sequential write work loads. + The [option]`apm` option sets the Advanced Power Management feature on drives that support it. It corresponds to using the `-B` option of the `hdparm` utility. The [option]`spindown` option puts the drive into idle (low-power) mode, and also sets the standby (spindown) timeout for the drive. It corresponds to using `-S` option of the `hdparm` utility. + .Use a medium-agressive power management with spindown ==== ---- [disk] apm=128 spindown=6 ---- ==== + The [option]`readahead` option controls how much extra data the operating system reads from disk when performing sequential I/O operations. Increasing the `readahead` value might improve performance in application environments where sequential reading of large files takes place. The default unit for readahead is KiB. This can be adjusted to sectors by specifying the suffix 's'. If the suffix is specified, there must be at least one space between the number and suffix (for example, `readahead=8192 s`). + .Set the `readahead` to 4MB unless already set to a higher value ==== ---- [disk] readahead=>4096 ---- ==== The disk readahead value can be multiplied by the constant specified by the [option]`readahead_multiply` option. csrtt|�j||�ddddddddd d ddg|_d dddddddddd dg|_t|j�|_d|_d|_t �|_ dS)N��}�i�U�F�7��r��n�Z�<�g{�G�z�?)�superr�__init__� _power_levels�_spindown_levels�len�_levels�_level_steps�_load_smallestr�_cmd)�self�args�kwargs)� __class__��!/usr/lib/python3.6/plugin_disk.pyrXszDiskPlugin.__init__csdtt|�j�d|_d|_t�|_t�|_x,|j j d�D]}|j|�r8|jj|j �q8Wt�|_dS)NT�block)rr� _init_devicesZ_devices_supported�_use_hdparm�setZ _free_devices�dict�_hdparm_apm_device_support�_hardware_inventoryZget_devices�_device_is_supported�addZsys_nameZ_assigned_devices)r'�device)r*r+r,r.bs zDiskPlugin._init_devicescs�fdd�|D�S)Ncsg|]}�jjd|��qS)r-)r3Z get_device)�.0�x)r'r+r,� nsz2DiskPlugin._get_device_objects..r+)r'Zdevicesr+)r'r,�_get_device_objectsmszDiskPlugin._get_device_objectscCs�|js dS||jkr|j|S|jjddd|gtjgdd�\}}}|tjkrdtjd�d|_dS|r�tjd|�tj d ||f�d|j|<dSd |kr�tjd|�d|j|<dSd|j|<dS)NF�hdparmz-Cz/dev/%sT)� no_errorsZ return_errz4hdparm command not found, ignoring for other devicesz#Device '%s' not supported by hdparmz(rc: %s, msg: '%s')�unknownz3Driver for device '%s' does not support apm command) r/r2r&�execute�errno�ENOENT�log�warn�info�debug)r'r6�rc�outZerr_msgr+r+r,�_is_hdparm_apm_supportedps* z#DiskPlugin._is_hdparm_apm_supportedcCs2|jdko0|jjdd�dko0|jdkp0|jjdkS) N�diskZ removable�0�scsi�virtio�xen�nvme)rJrKrLrM)Zdevice_typeZ attributes�get�parentZ subsystem)�clsr6r+r+r,r4�s zDiskPlugin._device_is_supportedcCs|jj|d|j�dS)Nr-)r3Z subscribe�_hardware_events_callback)r'r+r+r,�_hardware_events_init�sz DiskPlugin._hardware_events_initcCs|jj|�dS)N)r3Zunsubscribe)r'r+r+r,�_hardware_events_cleanup�sz#DiskPlugin._hardware_events_cleanupcs(|j|�s|dkr$tt|�j||�dS)N�remove)r4rrrQ)r'Zeventr6)r*r+r,rQ�sz$DiskPlugin._hardware_events_callbackcs,|jdk r|jj|�tt|�j||�dS)N)� _load_monitorZ add_devicerr�_added_device_apply_tuning)r'�instance�device_name)r*r+r,rV�s z%DiskPlugin._added_device_apply_tuningcs,|jdk r|jj|�tt|�j||�dS)N)rUZ remove_devicerr�_removed_device_unapply_tuning)r'rWrX)r*r+r,rY�s z)DiskPlugin._removed_device_unapply_tuningcCsdddddddd�S)NT)�dynamic�elevator�apm�spindown� readahead�readahead_multiply�scheduler_quantumr+)rPr+r+r,�_get_config_options�szDiskPlugin._get_config_optionscCsddgS)Nr\r]r+)rPr+r+r,�#_get_config_options_used_by_dynamic�sz.DiskPlugin._get_config_options_used_by_dynamiccCsdd|_d|_d|_|j|jd�rTd|_|jjd|j�|_ i|_ i|_i|_i|_ nd|_d|_ dS)NTrrZrHF)Z_has_static_tuning�_apm_errcnt�_spindown_errcntZ_option_boolZoptionsZ_has_dynamic_tuning�_monitors_repositoryZcreateZassigned_devicesrUZ_device_idle�_stats�_idle�_spindown_change_delayed)r'rWr+r+r,�_instance_init�szDiskPlugin._instance_initcCs"|jdk r|jj|j�d|_dS)N)rUre�delete)r'rWr+r+r,�_instance_cleanup�s zDiskPlugin._instance_cleanupcCs�|rd}|j}n d}|j}|tjkr(dS|dkr6d}nL|tjkrbtjd|_|_tjd�dS|d7}|tjkr�tjd|�|r�||_n||_dS)Nr]r\rrzIhdparm command not found, ignoring future set_apm / set_spindown commandsz5disabling set_%s command: too many consecutive errors) rdrc�consts�ERROR_THRESHOLDr?r@rArBrC)r'rEr]�sZcntr+r+r,�_update_errcnt�s& zDiskPlugin._update_errcntcCsNtjd|�|jjdd|d|gtjgd�\}}|j|d�d|j|<dS)Nzchanging spindown to %dr;z-S%dz/dev/%s)r<TF)rArDr&r>r?r@rorh)r'rWr6�new_spindown_levelrErFr+r+r,�_change_spindown�s&zDiskPlugin._change_spindowncCs2|jjddd|gtjgd�\}}d|ko0d|kS)Nr;z-Cz/dev/%s)r<ZstandbyZsleeping)r&r>r?r@)r'r6rErFr+r+r,�_drive_spinning�s"zDiskPlugin._drive_spinningcCs(|j|�sdS|jj|�}|dkr&dS||jkr<|j||�|j|||�|j||�|j|}|j|}|dd|jkr�|d|j kr�|d|j kr�d}n.|ddkr�|ddks�|ddkr�d}nd}|dk�r�|d|7<|j |d}|j|d}tj d|d�|jtjk�rb|j|��rT|dk�rTtj d|�d|j|<n|j|||�|jtjk�r�tj d |�|jjd d|d|gtjgd �\} } |j| d�n4|j|�r�|j|��r�|j|d}|j|||�tj d||d|df�tj d||d|d|df�dS)N�levelr�read�writerztuning level changed to %dz;delaying spindown change to %d, drive has already spun downTzchanging APM_level to %dr;z-B%dz/dev/%s)r<Fz %s load: read %0.2f, write %0.2fz$%s idle: read %d, write %d, level %d��)rGrUZget_device_loadrf�_init_stats_and_idle� _update_stats�_update_idlergr#r$r r!rArDrdrlrmrrrhrqrcr&r>r?r@ro)r'rWr6�loadZstatsZidleZlevel_changeZnew_power_levelrprErFr+r+r,�_instance_update_dynamic�sF .$ &z#DiskPlugin._instance_update_dynamiccCsDddgddgddgd�|j|<dddd�|j|<d|j|<dS)N�rr)�new�old�max)rsrtruF)rfrgrh)r'rWr6r+r+r,rw!s$zDiskPlugin._init_stats_and_idlecCs�|j|d|j|d<}||j|d<dd�t||�D�}||j|d<|j|d}dd�t||�D�}||j|d<t|d�t|d�|j|d <t|d �t|d �|j|d<dS)Nr}r~cSsg|]}|d|d�qS)rrr+)r7Znew_oldr+r+r,r9+sz,DiskPlugin._update_stats..�diffrcSsg|]}t|��qSr+)r)r7Zpairr+r+r,r90srrt�ru)rf�zip�float)r'rWr6Znew_loadZold_loadr�Zold_max_loadZmax_loadr+r+r,rx&s"zDiskPlugin._update_statscCsLxFdD]>}|j|||jkr6|j||d7<qd|j||<qWdS)Nrtrurr)rtru)rfr%rg)r'rWr6Z operationr+r+r,ry7s zDiskPlugin._update_idlecs0|j|�stjd|�ntt|�j||�dS)Nzr?r@ro)r'r�r6r�rTrErFr+r+r,�_set_apmds (zDiskPlugin._set_apmcCs�|j|�s |stjd|�dSd}d}|jjddd|gtjgd�\}}|tjkrZdS|dkrhd}n@tjd |tj �}|r�yt |jd ��}Wntk r�d}YnX|r�tj d|�|S)Nz+apm option is not supported for device '%s'Fr;z-Bz/dev/)r<rTz .*=\s*(\d+).*rz2could not get current APM settings for device '%s')rGrArCr&r>r?r@�re�match�S�int�group� ValueError�error)r'r6r�r��errrErF�mr+r+r,�_get_apmts( " zDiskPlugin._get_apmr]cCs||j|�s(|s tjd|�dSt|�S|jtjkrt|sl|jjddt|�d|gt j gd�\}}|j|d�t|�SdSdS)Nz0spindown option is not supported for device '%s'r;z-Sz/dev/)r<T)rGrArCr�rdrlrmr&r>r?r@ro)r'r�r6r�rTrErFr+r+r,� _set_spindown�s (zDiskPlugin._set_spindowncCs$|j|�s |stjd|�dSdS)Nz0spindown option is not supported for device '%s'��)rGrArC)r'r6r�r+r+r,� _get_spindown�s zDiskPlugin._get_spindowncCs|j|d�S)Nzqueue/read_ahead_kb)r�)r'r6r+r+r,�_readahead_file�szDiskPlugin._readahead_filecCs^t|�jdd�}yt|d�}Wntk r4dSXt|�dkrZ|dddkrZ|d}|S)Nrrrn�)r��splitr�r�r")r'r��val�vr+r+r,� _parse_ra�szDiskPlugin._parse_rar^cCsZ|j|�}|j|�}|dkr0tjd||f�n&|sV|jj|d||rNtjgndd�|S)Nz,Invalid readahead value '%s' for device '%s'z%dF)r�)r�r�rAr�r&r�r?r@)r'r�r6r�rTr�r�r+r+r,�_set_readahead�s zDiskPlugin._set_readaheadcCs6|j|�}|jj||d�j�}t|�dkr.dSt|�S)N)r�r)r�r&r��stripr"r�)r'r6r�r�r�r+r+r,�_get_readahead�s zDiskPlugin._get_readaheadr_c Cs�|rdS|jd|d�}|r^|j|�}|dkr0dStt|�|�}|jj||�|j||d�n2|jj|�}|dkrvdS|j||d�|jj|�dS)Nr_)Zcommand_namerXF) Z_storage_keyr�r�r�Z_storager0r�rNZunset) r'ZenablingZ multiplierr6Zverifyr�Zstorage_keyZ old_readaheadZ new_readaheadr+r+r,�_multiply_readahead�s" zDiskPlugin._multiply_readaheadcCs|j|d�S)Nzqueue/iosched/quantum)r�)r'r6r+r+r,�_scheduler_quantum_file�sz"DiskPlugin._scheduler_quantum_filer`cCs8|j|�}|s4|jj|dt|�|r,tjgndd�|S)Nz%dF)r�)r�r&r�r�r?r@)r'r�r6r�rTr�r+r+r,�_set_scheduler_quantum�s z!DiskPlugin._set_scheduler_quantumcCsH|j|�}|jj||d�j�}t|�dkr@|sdisk_scheduler_quantum option is not supported for device '%s')r�r&r�r�r"rArCr�)r'r6r�r�r�r+r+r,�_get_scheduler_quantum�s z!DiskPlugin._get_scheduler_quantum)r�)F)F)F)F)F)0�__name__� __module__�__qualname__�__doc__rr.r:rG�classmethodr4rRrSrQrVrYrarbrirkrorqrrr{rwrxryr�r�r�r�Zcommand_setr�Zcommand_getr�r�r�r�r�r�r�r�r�Zcommand_customr�r�r�r�� __classcell__r+r+)r*r,rsZJ 2 r)r?�rZ decoratorsZ tuned.logsZtunedZtuned.constsrlZtuned.utils.commandsrr�r�ZlogsrNrAZPluginrr+r+r+r,�s