| Current File : //usr/lib64/python3.6/site-packages/borg/__pycache__/locking.cpython-36.pyc |
3
y��b�9 � @ s� d dl Z d dlZd dlZd dlZddlmZ ddlmZmZ ddl m
Z
d \Z Z d \Z
Ze
e�Z G d
d � d �ZG d d
� d
e�ZG dd� de�ZG dd� de�ZG dd� de�ZG dd� de�ZG dd� de�ZG dd� d�ZG dd� d�ZG d d � d �ZdS ) � N� )�platform)�Error�ErrorWithTraceback)�
create_logger�add�remove�shared� exclusivec @ sB e Zd ZdZddd�Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dS )� TimeoutTimerz�
A timer for timeout checks (can also deal with "never timeout").
It can also compute and optionally execute a reasonable sleep time (e.g. to avoid
polling too often or to support thread/process rescheduling).
Nc C sX |dk r|dk rt d��|| _|dkrB|dkr4d}ntd|d �}|| _d| _d| _dS )ag
Initialize a timer.
:param timeout: time out interval [s] or None (never timeout, wait forever) [default]
:param sleep: sleep interval [s] (>= 0: do sleep call, <0: don't call sleep)
or None (autocompute: use 10% of timeout [but not more than 60s],
or 1s for "never timeout" mode)
Nr ztimeout must be >= 0g �?g N@g $@)�
ValueError�timeout_interval�min�sleep_interval�
start_time�end_time)�self�timeout�sleep� r � /usr/lib64/python3.6/locking.py�__init__ s zTimeoutTimer.__init__c C s d| j j| j| j| j| jf S )Nz)<%s: start=%r end=%r timeout=%r sleep=%r>)� __class__�__name__r r r
r )r r r r �__repr__+ s zTimeoutTimer.__repr__c C s& t j � | _| jd k r"| j| j | _| S )N)�timer r
r )r r r r �start0 s
zTimeoutTimer.startc C s | j dkrtj| j � d S )Nr )r r r )r r r r r 6 s
zTimeoutTimer.sleepc C s | j d k otj� | j kS )N)r r )r r r r � timed_out: s zTimeoutTimer.timed_outc C s | j � r dS | j� dS d S )NTF)r r )r r r r �timed_out_or_sleep= s z TimeoutTimer.timed_out_or_sleep)NN)
r �
__module__� __qualname__�__doc__r r r r r r r r r r r s
r c @ s e Zd ZdZdS )� LockErrorz Failed to acquire the lock {}.N)r r r r! r r r r r" E s r" c @ s e Zd ZdZdS )�
LockErrorTz Failed to acquire the lock {}.N)r r r r! r r r r r# I s r# c @ s e Zd ZdZdS )� LockTimeoutz/Failed to create/acquire the lock {} (timeout).N)r r r r! r r r r r$ M s r$ c @ s e Zd ZdZdS )�
LockFailedz*Failed to create/acquire the lock {} ({}).N)r r r r! r r r r r% Q s r% c @ s e Zd ZdZdS )� NotLockedz/Failed to release the lock {} (was not locked).N)r r r r! r r r r r& U s r& c @ s e Zd ZdZdS )� NotMyLockz=Failed to release the lock {} (was/is locked, but not by me).N)r r r r! r r r r r' Y s r' c @ sl e Zd ZdZddd�Zdd� Zdd � Zd
d � Zdd d
�Zdd� Z dd� Z
dd� Z dd� Z dd� Z
dd� ZdS ) �
ExclusiveLocka/ An exclusive Lock based on mkdir fs operation being atomic.
If possible, try to use the contextmanager here like::
with ExclusiveLock(...) as lock:
...
This makes sure the lock is released again if the block is left, no
matter how (e.g. if an exception occurred).
NFc C sP || _ || _tjj|�| _|p$tj� | _tjj| jd| j �| _ || _
d| _ d S )Nz%s.%d-%xF) r r �os�path�abspathr �get_process_id�id�join� unique_name�kill_stale_locks�stale_warning_printed)r r* r r r- r0 r r r r h s zExclusiveLock.__init__c C s | j � S )N)�acquire)r r r r � __enter__q s zExclusiveLock.__enter__c G s | j � d S )N)�release)r �excr r r �__exit__t s zExclusiveLock.__exit__c C s d| j j| jf S )Nz<%s: %r>)r r r/ )r r r r r w s zExclusiveLock.__repr__c C s� |d kr| j }|d kr | j}t||�j� }x�ytj| j� W nl tk
rv | j� rX| S | j � |j
� rrt | j��Y q, t k
r� } zt
| jt|��d �W Y d d }~X q,X t| jd�� W d Q R X | S q,W d S )N�wb)r r r r r) �mkdirr* �FileExistsError�by_me�kill_stale_lockr r$ �OSErrorr% �str�openr/ )r r r �timer�errr r r r2 z s& $
zExclusiveLock.acquirec C s@ | j � st| j��| j� s$t| j��tj| j� tj| j� d S )N) � is_lockedr& r* r: r' r) �unlinkr/ �rmdir)r r r r r4 � s
zExclusiveLock.releasec C s t jj| j�S )N)r) r* �exists)r r r r rA � s zExclusiveLock.is_lockedc C s t jj| j�S )N)r) r* rD r/ )r r r r r: � s zExclusiveLock.by_mec
" C s� yt j| j�}W n tk
r$ dS X �x|D � ]�}y4|jdd�\}}|jdd�\}}t|�}t|�}W n$ tk
r� tjd|| j� dS X t j
|||�r�dS | j s�| j s�tj
d|� d| _ dS y&t jt jj| j|�� tj
d|� W q. tk
�r* } z$| j �s tjd |t| �� d| _ dS d } ~ X q.X q.W yt j| j� W nD tk
�r� } z&| jtjk�rfdS tjd
t| �� dS d } ~ X nX dS ) NF�-r �.z9Found malformed lock %s in %s. Please check/fix manually.zOFound stale lock %s, but not deleting because BORG_HOSTNAME_IS_UNIQUE is False.TzKilled stale lock %s.z0Found stale lock %s, but cannot delete due to %sz Failed to remove lock dir: %s)r) �listdirr* �FileNotFoundError�rsplit�intr �logger�errorr �
process_aliver0 r1 �warningrB r. r< r= rC �errnoZ ENOTEMPTY)
r �names�nameZhost_pidZ
thread_str�hostZpid_str�pid�threadr@ r r r r; � sH z ExclusiveLock.kill_stale_lockc C sD | j � r@x*tj| j�D ]}tjtjj| j|�� qW tj| j� d S )N)rA r) rG r* rB r. rC )r rQ r r r �
break_lock� s zExclusiveLock.break_lockc
C sf | j |kst�tjj| jd| �}| j� rT| j� rTt|d�� W dQ R X tj| j � || | _ | _ dS )z0migrate the lock ownership from old_id to new_idz%s.%d-%xr7 N)
r- �AssertionErrorr) r* r. rA r: r> rB r/ )r �old_id�new_idZnew_unique_namer r r � migrate_lock� s
zExclusiveLock.migrate_lock)NNNF)NN)r r r r! r r3 r6 r r2 r4 rA r: r; rU rY r r r r r( ] s
2r( c @ sR e Zd ZdZddd�Zdd� Zdd � Zd
d � Zd d
� Zdd� Z dd� Z
dd� Z dS )�
LockRosterz�
A Lock Roster to track shared/exclusive lockers.
Note: you usually should call the methods with an exclusive lock held,
to avoid conflicting access by multiple threads/processes/machines.
NFc C s || _ |ptj� | _|| _d S )N)r* r r, r- r0 )r r* r- r0 r r r r � s zLockRoster.__init__c C s� y�t | j��}tj|�}W d Q R X | jr�x�ttfD ]�}y || }W n tk
rX w2Y nX t� }xD|D ]<\}}}t j
|||�r�|j |||f� qft j
d||||� qfW t|�||< q2W W n ttfk
r� i }Y nX |S )Nz:Removed stale %s roster lock for host %s pid %d thread %d.)r> r* �json�loadr0 �SHARED� EXCLUSIVE�KeyError�setr rM r rK rN �listrH r ) r �f�data�keyZentries�elementsrR rS rT r r r r\ � s&
zLockRoster.loadc
C s( t | jd��}tj||� W d Q R X d S )N�w)r> r* r[ �dump)r rc rb r r r �save s zLockRoster.savec C s* yt j| j� W n tk
r$ Y nX d S )N)r) rB r* rH )r r r r r
s zLockRoster.removec C s" | j � }tdd� |j|g �D ��S )Nc s s | ]}t |�V qd S )N)�tuple)�.0�er r r � <genexpr> s z!LockRoster.get.<locals>.<genexpr>)r\ r` �get)r rd �rosterr r r rm s zLockRoster.getc s t � fdd�|D ��S )Nc 3 s | ]}� j |� V qd S )N)rm )rj rd )r r r rl s z#LockRoster.empty.<locals>.<genexpr>)�all)r �keysr )r r �empty s zLockRoster.emptyc C s� | j � }ytdd� || D ��}W n tk
r< t� }Y nX |tkrT|j| j� n"|tkrj|j| j� n td| ��t dd� |D ��||< | j
|� d S )Nc s s | ]}t |�V qd S )N)ri )rj rk r r r rl s z$LockRoster.modify.<locals>.<genexpr>zUnknown LockRoster op %rc s s | ]}t |�V qd S )N)ra )rj rk r r r rl # s ) r\ r` r_ �ADDr r- �REMOVEr r ra rh )r rd �oprn re r r r �modify s zLockRoster.modifyc C sl | j |kst�| jd }| _zBy| j|t� W n tk
rH || _ Y nX || _ | j|t� W d|| _X dS )z0migrate the lock ownership from old_id to new_idFN)r- rV r0 ru rs r_ rr )r rd rW rX Zkillingr r r rY & s zLockRoster.migrate_lock)NF) r r r r! r r\ rh r rm rq ru rY r r r r rZ � s
rZ c @ st e Zd ZdZd dd�Zdd� Zdd � Zd
d � Zd d d
�Zdd� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� ZdS ) �Locka�
A Lock for a resource that can be accessed in a shared or exclusive way.
Typically, write access to a resource needs an exclusive lock (1 writer,
no one is allowed reading) and read access to a resource needs a shared
lock (multiple readers are allowed).
If possible, try to use the contextmanager here like::
with Lock(...) as lock:
...
This makes sure the lock is released again if the block is left, no
matter how (e.g. if an exception occurred).
FNc C sT || _ || _|| _|| _|p"tj� | _t|d ||d�| _t |d |||d�| _
d S )Nz.roster)r- r0 z
.exclusive)r- r r0 ) r* � is_exclusiver r r r, r- rZ �_rosterr( �_lock)r r* r
r r r- r0 r r r r I s z
Lock.__init__c C s | j � S )N)r2 )r r r r r3 V s zLock.__enter__c G s | j � d S )N)r4 )r r5 r r r r6 Y s z
Lock.__exit__c C s d| j j| jf S )Nz<%s: %r>)r r r- )r r r r r \ s z
Lock.__repr__c
C s| |d kr| j }|p| jpd}|r<| j||� | jjtt� n6| j�* |d k rZ| jj|t� | jjt t� W d Q R X || _ | S )Ng�������?)
rw r �_wait_for_readers_finishingrx ru r^ rr ry rs r] )r r
r r r r r r2 _ s z Lock.acquirec C s� t | j|�j� }x�| jj� yH|d k r4| jj|t� t| jj t
��dkrLd S |d k rb| jj|t � W n | jj � � Y n X | jj � |j
� rt| j��qW d S )Nr )r r r ry r2 rx ru rs �lenrm r] rr r4 r r$ r* )r r r r? r r r rz n s
z Lock._wait_for_readers_finishingc
C st | j r8| jjtt� | jjtt�r,| jj� | jj � n8| j�, | jjtt� | jjtt�rf| jj� W d Q R X d S )N)
rw rx ru r^ rs rq r] r ry r4 )r r r r r4 � s
z Lock.releasec C s | j s| jdtd� d S )NT)r
r )rw r2 r] )r r r r �upgrade� s z Lock.upgradec C s | j r| jdtd� d S )NF)r
r )rw r2 r^ )r r r r � downgrade� s zLock.downgradec C s | j o| jj� o| jj� S )N)rw ry rA r: )r r r r �got_exclusive_lock� s zLock.got_exclusive_lockc C s | j j� | jj� d S )N)rx r ry rU )r r r r rU � s
zLock.break_lockc C sn | j |kst�|| _ | jr:| jj||� | jjt||� n0| j�$ | jj||� | jjt||� W d Q R X d S )N)r- rV rw ry rY rx r^ r] )r rW rX r r r rY � s zLock.migrate_lock)FNNNF)NNN)r r r r! r r3 r6 r r2 rz r4 r| r} r~ rU rY r r r r rv : s
rv )r r )r r
)rO r[ r) r � r Zhelpersr r rK r rr rs r] r^ r r r" r# r$ r% r& r' r( rZ rv r r r r �<module> s( 5 Y