| Current File : //usr/lib64/python3.6/site-packages/borg/__pycache__/upgrader.cpython-36.pyc |
3
y��b5 � @ s� d dl Z d dlZd dlZd dlZddlmZmZ ddlmZ ddl m
Z
ddl m Z m Z m
Z
ddlmZ ddlmZ dd lmZmZ ee�Zd
ZG d d � d e�ZG d
d� de�ZG dd� de�ZG dd� de�ZdS )� N� )�
KeyfileKey�KeyfileNotFoundError)�REPOSITORY_README)�ProgressIndicatorPercent)� get_base_dir� get_keys_dir�
get_cache_dir)�Lock)�
create_logger)�
Repository�MAGICs ATTICSEGc sn e Zd Z� fdd�Zddd�Zdd� Zedd d
��Zedd d ��Zd
d� Z edd� �Z
dd� Z dd� Z � Z
S )�AtticRepositoryUpgraderc s" d|d< d|d< t � j||� d S )NF�lockZcheck_segment_magic)�super�__init__)�self�args�kw)� __class__� � /usr/lib64/python3.6/upgrader.pyr s z AtticRepositoryUpgrader.__init__TFc C s2 | �� d}|sFdj | jtjj� �}tjd|� |sFtj| j|tj d� tjd� t
tjj | jd�ddd �j � | _
d
d � | jj� D �}y | j� }W n tk
r� tjd � Y nX | j||� W dQ R X t
tjj | jd�dd
�j � | _
z6| j|� | j||d� | j||||d� | j� W d| j
j� d| _
X |S )a� convert an attic repository to a borg repository
those are the files that need to be upgraded here, from most
important to least important: segments, key files, and various
caches, the latter being optional, as they will be rebuilt if
missing.
we nevertheless do the order in reverse, as we prefer to do
the fast stuff first, to improve interactivity.
Nz&{}.before-upgrade-{:%Y-%m-%d-%H:%M:%S}z making a hardlink copy in %s)Z
copy_functionz1opening attic repository with borg and convertingr Tg �?)� exclusiveZtimeoutc S s g | ] \}}|�qS r r )�.0�i�filenamer r r �
<listcomp>. s z3AtticRepositoryUpgrader.upgrade.<locals>.<listcomp>z no key file found for repository)r )�dryrun�inplace)r r �progress)�format�path�datetimeZnow�logger�info�shutilZcopytree�os�linkr
�join�acquirer �ioZsegment_iterator�find_attic_keyfiler �warning�convert_keyfiles�
convert_cache�convert_repo_index�convert_segments� borg_readme�release)r r r r Zbackup�segments�keyfiler r r �upgrade s0
z AtticRepositoryUpgrader.upgradec C s> t jj| jd�}t j|� t|d��}|jt� W d Q R X d S )NZREADME�w)r& r! r( �remove�open�writer )r Zreadme�fdr r r r1 A s
z#AtticRepositoryUpgrader.borg_readmec C s~ t jdt| � � t| �}t|ddd�}xDt| �D ]8\}}|rH|j|� |rXtjd� q2tj |t
t |d� q2W |rz|j � dS )a convert repository segments from attic to borg
replacement pattern is `s/ATTICSEG/BORG_SEG/` in files in
`$ATTIC_REPO/data/**`.
luckily the magic string length didn't change so we can just
replace the 8 first bytes of all regular files in there.zconverting %d segments...zConverting segments %3.0f%%zupgrade.convert_segments)Ztotal�msgZmsgidg����MbP?)r N)
r# r$ �lenr � enumerateZshow�timeZsleepr �header_replace� ATTIC_MAGICr
Zfinish)r3 r r r Z
segment_countZpir r r r r r0 G s
z(AtticRepositoryUpgrader.convert_segmentsc C s� t | d���}|jd� |jt|��|kr�|rB|jd� |j|� nLtj| | d � t | d�� }|j|� |j|j� � W d Q R X tj| d � W d Q R X d S )Nzr+br z.tmp�wb)r8 �seek�readr< r9 r& �rename�unlink)r Z old_magicZ new_magicr ZsegmentZ new_segmentr r r r? ] s
z&AtticRepositoryUpgrader.header_replacec C s
t j| �S )ae find the attic keyfiles
the keyfiles are loaded by `KeyfileKey.find_key_file()`. that
finds the keys with the right identifier for the repo.
this is expected to look into $HOME/.attic/keys or
$ATTIC_KEYS_DIR for key files matching the given Borg
repository.
it is expected to raise an exception (KeyfileNotFoundError) if
no key is found. whether that exception is from Borg or Attic
is unclear.
this is split in a separate function in case we want to use
the attic code here directly, instead of our local
implementation.)�AtticKeyfileKey�
find_key_file)r r r r r+ r s z*AtticRepositoryUpgrader.find_attic_keyfilec C s� t jd| � t| d��}|j� }W dQ R X |jtjtjd�}tj j
t � tj j | ��} t jd| � |s�t| d��}|j
|� W dQ R X dS )a� convert key files from attic to borg
replacement pattern is `s/ATTIC KEY/BORG_KEY/` in
`get_keys_dir()`, that is `$ATTIC_KEYS_DIR` or
`$HOME/.attic/keys`, and moved to `$BORG_KEYS_DIR` or
`$HOME/.config/borg/keys`.
no need to decrypt to convert. we need to rewrite the whole
key file because magic string length changed, but that's not a
problem because the keyfiles are small (compared to, say,
all the segments).zconverting keyfile %s�rNr zwriting borg keyfile to %sr6 )r# r$ r8 rC �replacerF �FILE_IDr r& r! r( r �basenamer9 )r4 r �f�datar r r r- � s
z(AtticRepositoryUpgrader.convert_keyfilesc C s^ | j � }|dkr"tjd| j � n8tjj| jd| �}tjd| � |sZtj|dd|d� dS )a� convert some repo files
those are all hash indexes, so we need to
`s/ATTICIDX/BORG_IDX/` in a few locations:
* the repository index (in `$ATTIC_REPO/index.%d`, where `%d`
is the `Repository.get_index_transaction_id()`), which we
should probably update, with a lock, see
`Repository.open()`, which i'm not sure we should use
because it may write data on `Repository.close()`...
Nz%no index file found for repository %szindex.%dzconverting repo index %ss ATTICIDXs BORG_IDX)r ) Zget_index_transaction_idr# r, r! r& r( r$ r r? )r r r Ztransaction_id�indexr r r r/ � s z*AtticRepositoryUpgrader.convert_repo_indexc s� t jjdt jjt� dd��� t jj� | j�� t jjt� | j��� ��fdd�}t jj� �r�t jj��spt j �� xd
D ] }||� qvW x4dD ],}||�}t
j d | � �s�t j
|d
d � q�W d S )a� convert caches from attic to borg
those are all hash indexes, so we need to
`s/ATTICIDX/BORG_IDX/` in a few locations:
* the `files` and `chunks` cache (in `$ATTIC_CACHE_DIR` or
`$HOME/.cache/attic/<repoid>/`), which we could just drop,
but if we'd want to convert, we could open it with the
`Cache.open()`, edit in place and then `Cache.close()` to
make sure we have locking right
ZATTIC_CACHE_DIRz.cacheZatticc s� t jj� | �}t jj|�rht jj�| �}t jj|�rBtjd|� n"tjd||f � �sdtj||� |S tjd| |f � dS dS )a copy the given attic cache path into the borg directory
does nothing if dryrun is True. also expects
attic_cache_dir and borg_cache_dir to be set in the parent
scope, to the directories path including the repository
identifier.
:params path: the basename of the cache file to copy
(example: "files" or "chunks") as a string
:returns: the borg file that was created or None if no
Attic cache file was found.
z<borg cache file already exists in %s, not copying from Atticz©ing attic cache file from %s to %sz no %s cache file found in %sN) r& r! r( �existsr# r, r$ r% Zcopyfile)r! Z
attic_fileZ borg_file)�attic_cache_dir�borg_cache_dirr r r �copy_cache_file� s z>AtticRepositoryUpgrader.convert_cache.<locals>.copy_cache_file�config�files�chunkszconverting cache %ss ATTICIDXs BORG_IDXN)rS rT )rU )r& �environ�getr! r( r �id_strr rO �makedirsr# r$ r r? )r r rR �cacher )rP rQ r r r. � s
z%AtticRepositoryUpgrader.convert_cache)TFF)TFF)T)�__name__�
__module__� __qualname__r r5 r1 � staticmethodr0 r? r+ r- r/ r. �
__classcell__r r )r r r s
( r c @ s, e Zd ZdZdZedd� �Zedd� �ZdS )rF z*backwards compatible Attic key file parserz ATTIC KEYc C s t jjdt jjt� dd��S )z,Determine where to repository keys and cacheZATTIC_KEYS_DIRz.attic�keys)r& rV rW r! r( r r r r r r � s z AtticKeyfileKey.get_keys_dirc C s� | j }|� }tjj|�s$t|j|��xhtj|�D ]Z}tjj||�}t|d��8}|j� j � }|r�|j
| j �r�|dd� |j kr�|S W dQ R X q0W t|j|��dS )aw copy of attic's `find_key_file`_
this has two small modifications:
1. it uses the above `get_keys_dir`_ instead of the global one,
assumed to be borg's
2. it uses `repository.path`_ instead of
`repository._location.canonical_path`_ because we can't
assume the repository has been opened by the archiver yet
rH �
N)
r r& r! rO r �listdirr( r8 �readline�strip�
startswithrJ rX )�cls�
repositoryr �keys_dir�namer r: �liner r r rG � s
"z AtticKeyfileKey.find_key_fileN) r[ r\ r] �__doc__rJ r^ r � classmethodrG r r r r rF � s rF c @ s& e Zd Zd
dd�Zdd� Zdd� Zd S ) �BorgRepositoryUpgraderTFc C sV t jd� | �> y | j� }W n tk
r: t jd� Y nX | j||� W dQ R X dS )zDconvert an old borg repository to a current borg repository
z$converting borg 0.xx to borg currentz no key file found for repositoryN)r# r$ �find_borg0xx_keyfiler r, �
move_keyfiles)r r r r r4 r r r r5 s
z BorgRepositoryUpgrader.upgradec C s
t j| �S )N)�Borg0xxKeyfileKeyrG )r r r r rn % s z+BorgRepositoryUpgrader.find_borg0xx_keyfilec C sF t jj|�}t jjt� |�}yt j||� W n tk
r@ Y nX d S )N)r& r! rK r( r rD �FileExistsError)r r4 r r Z new_keyfiler r r ro ( s z$BorgRepositoryUpgrader.move_keyfilesN)TFF)r[ r\ r] r5 rn ro r r r r rm s
rm c @ s( e Zd ZdZedd� �Zedd� �ZdS )rp z.backwards compatible borg 0.xx key file parserc C s t jjdt jjt� dd��S )NZ
BORG_KEYS_DIRz.borgr` )r& rV rW r! r( r r r r r r 5 s z Borg0xxKeyfileKey.get_keys_dirc C s� | j }|� }tjj|�s$t|j|��xrtj|�D ]d}tjj||�}t|d��B}|j� j � }|r�|j
| j �r�|t | j �d d � |j
kr�|S W d Q R X q0W t|j|��d S )NrH r )r r& r! rO r rb r( r8 rc rd re rJ r< rX )rf rg r rh ri r r: rj r r r rG : s ,z Borg0xxKeyfileKey.find_key_fileN)r[ r\ r] rk r^ r rl rG r r r r rp 2 s rp )r" r& r% r> Z
crypto.keyr r Z constantsr Zhelpersr r r r Zlockingr
r# r rg r r
r[ r@ r rF rm rp r r r r �<module> s" a%