Current Dir: /snap/core22/2955/usr/lib/python3/dist-packages/cloudinit/sources/__pycache__/
[FILE] DataSourceAkamai.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceAliYun.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceAltCloud.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceAzure.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceBigstep.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceCloudCIX.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceCloudSigma.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceCloudStack.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceConfigDrive.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceDigitalOcean.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceEc2.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceExoscale.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceGCE.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceHetzner.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceIBMCloud.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceLXD.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceMAAS.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceNoCloud.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceNone.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceNWCS.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceOpenNebula.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceOpenStack.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceOracle.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceOVF.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceRbxCloud.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceScaleway.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceSmartOS.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceUpCloud.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceVMware.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceVultr.cpython-310.pyc [ edit | delete | rename ]
[FILE] DataSourceWSL.cpython-310.pyc [ edit | delete | rename ]
[FILE] __init__.cpython-310.pyc [ edit | delete | rename ]
Viewing: /snap/core22/2955/usr/lib/python3/dist-packages/cloudinit/sources/__pycache__/__init__.cpython-310.pyc
o
� �i� � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlmZm Z d dl
m Z m Z m
Z
mZmZmZmZmZ d dlmZmZmZmZmZmZmZmZm Z d dl m Z d dl m Z d dl!m"Z"m#Z# d dl$m%Z% d d l&m'Z' d d
l(m)Z) d d l*m+Z+ d Z,d
Z-dZ.dZ/e,e-e.gZ0dZ1dZ2dZ3dZ4dZ5dZ6dZ7dZ8e�9e:�Z;ddd� fdd d� fd d d� fd �Z<e G d d!� d!e��Z=G d"d#� d#e�Z>G d$d%� d%e?�Z@G d&d'� d'e?�ZAG d(d)� d)e?�ZBdWd,d-�ZCe5fd.d/�ZDG d0d1� d1e�ZEG d2d3� d3e�ZFG d4d5� d5e�ZGG d6d� de)e jHd7�ZId8d9� ZJd:eeIeKf fd;d<�ZLd=d>� ZM ?dXd@eKd:eNfdAdB�ZOdCdD� ZPdYdFdG�ZQG dHdI� dIeR�ZSdJdK� ZTdLeIdMeKd:eNfdNdO�ZUdMeKd:eeI fdPdQ�ZVd:eKfdRdS�ZWdTeKd:eKfdUdV�ZXdS )Z� N)�Enum�unique)�Any�Dict�List�
NamedTuple�Optional�Tuple�Union�cast) �
atomic_helper�dmi�importer� lifecycle�net� performance�
type_utils� user_data�util)�
write_json)�Distro)�
EventScope� EventType)� launch_index)�Paths)�CloudInitPickleMixin)�events�disabled�localr �pass�
FILESYSTEM�NETWORK�
DataSourcez|EXPERIMENTAL: The structure and format of content scoped under the 'ds' key may change in subsequent releases of cloud-init.zredacted for non-root user�
cloud-name�_unset�unknownz aws-chinac C � | dkS �N�aws� ��cr) r) �</usr/lib/python3/dist-packages/cloudinit/sources/__init__.py�<lambda>F � r- zaws-govc C r& r' r) r* r) r) r, r- G r. z azure-chinac C r& )N�azurer) r* r) r) r, r- H r. )zcn-zus-gov-�chinac @ s2 e Zd ZdZdZdZdZdZdZde fdd �Z
d
S ) �NetworkConfigSourcezb
Represents the canonical list of network config sources that cloud-init
knows about.
�cmdline�ds�
system_cfg�fallback� initramfs�returnc C � | j S �N��value��selfr) r) r, �__str__Y � zNetworkConfigSource.__str__N) �__name__�
__module__� __qualname__�__doc__�CMD_LINE�DS�
SYSTEM_CFG�FALLBACK� INITRAMFS�strr> r) r) r) r, r1 L s r1 c @ s& e Zd ZdZdZdZdefdd�ZdS )�NicOrderz Represents ways to sort NICs�mac�nic_namer7 c C r8 r9 r: r< r) r) r, r> c r? zNicOrder.__str__N)r@ rA rB rC �MAC�NIC_NAMErI r> r) r) r) r, rJ ] s
rJ c @ � e Zd ZdZdS )� DatasourceUnpickleUserDataErrorzERaised when userdata is unable to be unpickled due to python upgradesN�r@ rA rB rC r) r) r) r, rP g � rP c @ � e Zd ZdS )�DataSourceNotFoundExceptionN�r@ rA rB r) r) r) r, rT k � rT c @ rO )�InvalidMetaDataExceptionz8Raised when metadata is broken, unavailable or disabled.NrQ r) r) r) r, rW o rR rW � r) c
C s� t �| �}g }g }| �� D ]V\}}|r|d | }n|}|�� |v s(|�� |v r-|�|� t|t�rD|�d�rD|�|� |�dd�||< t|t �rct
|||�} |� | � d�� |� | � d�� | ||< q
t
|�|d< t
|�|d< |S )z�Process all instance metadata cleaning it up for persisting as json.
Strip ci-b64 prefix and catalog any 'base64_encoded_keys' as a list
@return Dict copy of processed metadata.
�/zci-b64:rX �base64_encoded_keys�sensitive_keys)�copy�deepcopy�items�lower�append�
isinstancerI �
startswith�replace�dict�process_instance_metadata�extend�pop�sorted)
�metadata�key_pathr[ �md_copyrZ � sens_keys�key�val� sub_key_path�
return_valr) r) r, re s s0
�� re c C s� | � dg �s| S t�| �}| � d�D ]+}|�d�}|}|D ]}||v r4t|| t�r4||d kr4|| }q ||v r=|||< q|S )z�Redact any sensitive keys from to provided metadata dictionary.
Replace any keys values listed in 'sensitive_keys' with redact_value.
r[ rY ���)�getr\ r] �splitra rd )ri � redact_valuerk rj �
path_parts�obj�pathr) r) r, �redact_sensitive_keys� s"
� ��rx c @ s. e Zd ZU eed< eed< eed< eed< dS )� URLParams�max_wait_seconds�timeout_seconds� num_retries�sec_between_retriesN)r@ rA rB �int�__annotations__r) r) r) r, ry � s
ry c @ s" e Zd ZU ee ed< eed< dS )�DataSourceHostname�hostname�
is_defaultN)r@ rA rB r rI r �boolr) r) r) r, r� � s
r� c @ s* e Zd ZU dZeed< eed< eed< dS )�HotplugRetrySettingsz
in seconds� force_retry� sleep_period� sleep_totalN)r@ rA rB rC r� r r~ r) r) r) r, r� � s
r� c @ s e Zd ZU eZdZdZdZee e
d< dZ dZ dZ
eeee f e
d< ejejejejfZeedf e
d< dZd Zd
Zd Zej e j e j e j e j!hiZ"ej e j hiZ#d e$fd
e$fdi fddddddf Z%eee e&f df e
d< dZ'dZ(ee df e
d< dZ)e*ddd�Z+dZ,ee e
d< d Z-dde.d e/fd d �Z0d e1d dfd!d"�Z2d#d$� Z3d e4fd%d&�Z5d e4fd'd(�Z6d)d*� Z7d+d,� Z8d�d.d/�Z9e:j;d0d1d2�d e4fd3d4��Z<d�d6d7�Z=d e4fd8d9�Z>d:d;� Z?d�d<d=�Z@d>d?� ZAd@dA� ZBeCdBdC� �ZDeCdDdE� �ZEdFdG� ZFeCdHdI� �ZGdJdK� ZHeCdLdM� �ZIdNdO� ZJdPdQ� ZKdRdS� ZLdTdU� ZMdVdW� ZNdXdY� ZOdZd[� ZPd\d]� ZQd^d_� ZRd`da� ZSeCdbdc� �ZTeCddde� �ZUdfdg� ZVd�dhdi�ZWdjdk� ZXdleYe fdmdn�ZZdleYe d e4fdodp�Z[dqdr� Z\dsdt� Z]e^d�dudv��Z_eCdwdx� �Z`dydz� Zad{d|� Zbd}d~� ZcdS )�r" z en_US.UTF-8�_undefN� _cloud_name�_crawled_metadata.�network_config_sourcesrq �
� � � ec2_metadata� network_jsonri )�userdataN)� userdata_rawN)�
vendordataN)�vendordata_rawN)� vendordata2N)�vendordata2_rawN�cached_attr_defaultsF)
�combined_cloud_config�
merged_cfg�merged_system_cfgzsecurity-credentialsr� � user-datar r� � vendor-datazds/vendor_data�sensitive_metadata_keysr �extra_hotplug_udev_rules�distro�pathsc C s� || _ || _|| _d | _i | _d | _d | _d | _d | _d | _ d | _
t | _ t | _
t�| j d| jfi �| _| js9i | _|sDt�| j�| _d S || _d S )N�
datasource)�sys_cfgr� r� r� ri r� r� r� r� r� �metadata_address�UNSETr� r� r �get_cfg_by_path�dsname�ds_cfgr �UserDataProcessor�ud_proc)r= r� r� r� r� r) r) r, �__init__O s* �
zDataSource.__init__�ci_pkl_versionr7 c C s� dddt ddt dddtddd�d� }|�� D ]\}}t| |�s%t| ||� qt| d�s3t| ddd� � t| d�r\| jdur^zt| j� W dS ty[ } z
t� d |� t
� |�d}~ww dS dS )
z(Perform deserialization fixes for Paths.NFr ) r� �_platform_type� _subplatformr� r� r� r� �skip_hotplug_detectr� r� �hotplug_retry_settings� check_if_fallback_is_allowedc S � dS �NFr) r) r) r) r, r- } � z&DataSource._unpickle.<locals>.<lambda>r� z:Unable to unpickle datasource: %s. Ignoring current cache.) r� r� r^ �hasattr�setattrr� rI �AttributeError�LOG�debugrP )r= r� �expected_attrsrm r; �er) r) r, � _unpicklei s<
�
�
����zDataSource._unpicklec C s
t �| �S r9 �r �obj_namer< r) r) r, r> � s
zDataSource.__str__c C r� )z#Check if running on this datasourceTr) r< r) r) r, � ds_detect� � zDataSource.ds_detectc C sN | j �� t� �� krt�d| � dS | j�dg �| j gkr%t�d| � dS dS )aJ Override if either:
- only a single datasource defined (nothing to fall back to)
- command line argument is used (ci.ds=OpenStack)
Note: get_cmdline() is required for the general case - when ds-identify
does not run, _something_ needs to detect the kernel command line
definition.
z6Kernel command line set to use a single datasource %s.T�datasource_listz2Datasource list set to use a single datasource %s.F)r� r_ �
parse_cmdliner� r� r� rr r< r) r) r, �override_ds_detect� s ��z DataSource.override_ds_detectc C s< | � � r| �� S | �� rt�d| � | �� S t�d| � dS )z&Overrides runtime datasource detectionz Detected %szDid not detect %sF)r� � _get_datar� r� r� r< r) r) r, �_check_and_get_data� s � z DataSource._check_and_get_datac C s� | � � j}| �� }| j}|d }di ddg�d|�d|�dt| j| j| j��d| j�d | j�d
|d d �d
|d d �d|d d �d| j�d| �� �d|d �d|�d|�d|d d �d|�d|�|d d | j| j |d |d d ��iS ) z2Return a dictionary of standardized metadata keys.�sys_info�v1�
_beta_keys� subplatform�availability-zone�availability_zone�cloud_idr# �
cloud_namer� �distr �distro_versionr� �distro_release� �platform�public_ssh_keys�python_version�python� instance-id� instance_id�kernel_release�uname�local-hostname�local_hostname� �variant)�machine�regionr� �system_platformr� )
� get_hostnamer� �get_instance_idr� �canonical_cloud_idr� r� �
platform_type�get_public_ssh_keysr� )r= �
instance_datar� r� r� �sysinfor) r) r, �_get_standardized_metadata� s`
��� ���� �
� � �
���� ���
��z%DataSource._get_standardized_metadatar) c C sP | j sdS |r
|}n| j}|D ]\}}t| |�r t| ||� q|s&d| _ dS dS )z�Reset any cached metadata attributes to datasource defaults.
@param attr_defaults: Optional tuple of (attr, value) pairs to
set instead of cached_attr_defaults.
NF)� _dirty_cacher� r� r� )r= �
attr_defaults� attr_values� attributer; r) r) r, �clear_cached_attrs� s
�
�z DataSource.clear_cached_attrszGetting metadata�always)�log_modec C s" d| _ | �� }|s |S | �� |S )z�Datasources implement _get_data to setup metadata and userdata_raw.
Minimally, the datasource should return a boolean True on success.
T)r� r� �persist_instance_data)r= � return_valuer) r) r, �get_data� s zDataSource.get_dataTc
C s^ |rt j�| jj�rt| | j�d�� | jdur2tt t
� | j��}|� dd� |� dd� d|i}n dd| j
ii}| jtkrE| j|d d< | jtkrQ| j|d d< t|d d < t
� | j�|d
< d |d
d < t
� |d
�|d < d
|d d < t�� |d< |�| �|�� zt�|�}tt�|�| j d�}W n5 t y� } zt � dt |�� W Y d}~dS d}~w t!y� } zt � dt |�� W Y d}~dS d}~ww | j�"d�}|d �#dd�}t j�$| jj%d�} t�&| � d|� �|� d�� d}
| � d|� �} t j�'| ��rt j�(| �}
tj)| | dd� |
�r|
| k�rt�*|
� t+||dd � | j�"d �} t+| t,|�� dS ) aP Process and write INSTANCE_JSON_FILE with all instance metadata.
Replace any hyphens with underscores in key names for use in template
processing.
:param write_cache: boolean set True to persist obj.pkl when
instance_link exists.
@return True on successful write, False otherwise.
�obj_pklNr� r� r3 � meta_datar� r� �_docr� z<DEPRECATED: Use merged_system_cfg. Will be dropped from 24.1r� zUMerged cloud-init system config from /etc/cloud/cloud.cfg and /etc/cloud/cloud.cfg.d/r� )r[ z'Error persisting instance-data.json: %sF�instance_data_sensitiver� r� �nonezcloud-id�-�
T)�forcei� )�moder� )-�osrw �lexistsr� �
instance_link� pkl_store�
get_ipath_curr� r rd r\ r] rg ri r� r� r� �EXPERIMENTAL_TEXTr� r � system_info�updater� r �
json_dumpsre �json�loadsr� � TypeErrorr� �warningrI �UnicodeDecodeError� get_runpathrr �join�run_dir�
write_file�exists�realpath�sym_link�del_filer rx )
r= � write_cache�crawled_metadatar� �content�processed_datar� �json_sensitive_filer� �
cloud_id_file�prev_cloud_id_file�new_cloud_id_file� json_filer) r) r, r� sr
�
���
�
����
z DataSource.persist_instance_datac C s t d��)z@Walk metadata sources, process crawled data and save attributes.zlSubclasses of DataSource must implement _get_data which sets self.metadata, vendordata_raw and userdata_raw.)�NotImplementedErrorr< r) r) r, r� [ s �zDataSource._get_datac
C sB | j }z t| j�d| j ��}W n ty$ t�td| j�d�|� Y nw | j}zt dt| j�d| j���}W n tyO | j}t�td| j�d�|� Y nw | j
}z t| j�d| j
��}W n t yt t�td| j�d�|� Y nw | j }z t| j�d| j ��}W n t y� t�td | j�d�|� Y nw t
||||�S )
z�Return the Datasource's preferred url_read parameters.
Subclasses may override url_max_wait, url_timeout, url_retries.
@return: A URLParams object with max_wait_seconds, timeout_seconds,
num_retries.
�max_waitz6Config max_wait '%s' is not an int, using default '%s'r �timeoutz5Config timeout '%s' is not an int, using default '%s'�retriesz5Config retries '%s' is not an int, using default '%s'r} zAConfig sec_between_retries '%s' is not an int, using default '%s')� url_max_waitr~ r� rr �
ValueErrorr �logexcr� � url_timeout�max� url_retries� Exception�url_sec_between_retriesry )r= r r r r} r) r) r, �get_url_paramsb sd
��
��
����
�� zDataSource.get_url_paramsc C s2 | j d u r| j�| �� �| _ |r| �| j �S | j S r9 )r� r� �process�get_userdata_raw�
_filter_xdata)r= � apply_filterr) r) r, � get_userdata� s
zDataSource.get_userdatac C �" | j d u r| j�| �� �| _ | j S r9 )r� r� r' �get_vendordata_rawr< r) r) r, �get_vendordata� �
zDataSource.get_vendordatac C r, r9 )r� r� r' �get_vendordata2_rawr< r) r) r, �get_vendordata2� r/ zDataSource.get_vendordata2c C s | j s | j�� | _ | j S r9 )r� r� r_ r< r) r) r, r� � s zDataSource.platform_typec C s | j s| �� | _ | j S )a� Return a string representing subplatform details for the datasource.
This should be guidance for where the metadata is sourced.
Examples of this on different clouds:
ec2: metadata (http://169.254.169.254)
openstack: configdrive (/dev/path)
openstack: metadata (http://169.254.169.254)
nocloud: seed-dir (/seed/dir/path)
lxd: nocloud (/seed/dir/path)
)r� �_get_subplatformr< r) r) r, r� � s
zDataSource.subplatformc C s | j r
d| j � d�S tS )z?Subclasses should implement to return a "slug (detail)" string.z
metadata (�))r� �METADATA_UNKNOWNr< r) r) r, r2 � s zDataSource._get_subplatformc C s~ | j r| j S | jr5| j�t�r5| j�t�}t|t�r"|�� | _ | j S | �� �� | _ t� dtt
|�� | j S | �� �� | _ | j S )z�Return lowercase cloud name as determined by the datasource.
Datasource can determine or define its own cloud product name in
metadata.
z5Ignoring metadata provided key %s: non-string type %s) r� ri rr �METADATA_CLOUD_NAME_KEYra rI r_ �_get_cloud_namer� r� �type)r= r� r) r) r, r� � s
���zDataSource.cloud_namec C r8 )z�Return the datasource name as it frequently matches cloud name.
Should be overridden in subclasses which can run on multiple
cloud names, such as DatasourceEc2.
)r� r< r) r) r, r6 � s zDataSource._get_cloud_namec C s" | j sd S d| j v r| j d S d S )Nz launch-index)ri r< r) r) r, r � s
zDataSource.launch_indexc C s0 t �t�| j ��g}|}|D ]}|�|�}q|S r9 )r �Filterr �safe_int�apply)r= � processed_ud�filters�new_ud�fr) r) r, r) � s � zDataSource._filter_xdatac C r8 r9 )r� r< r) r) r, r( � r? zDataSource.get_userdata_rawc C r8 r9 )r� r< r) r) r, r- � r? z DataSource.get_vendordata_rawc C r8 r9 )r� r< r) r) r, r0 r? z DataSource.get_vendordata2_rawc C s i S r9 r) r< r) r) r, �get_config_obj s zDataSource.get_config_objc C s t | j�d��S )Nz public-keys)�normalize_pubkey_datari rr r< r) r) r, r� s z DataSource.get_public_ssh_keysc C r� )a5 Publish the public SSH host keys (found in /etc/ssh/*.pub).
@param hostkeys: List of host key tuples (key_type, key_value),
where key_type is the first field in the public key file
(e.g. 'ssh-rsa') and key_value is the key itself
(e.g. 'AAAAB3NzaC1y...').
Nr) )r= �hostkeysr) r) r, �publish_host_keys r� z DataSource.publish_host_keysc C sd ddi}|� � D ]'\}}|�|�sq|D ]}d||t|�d � f }tj�|�r.| S qqd S )N�sd)�vd�xvd�vtbz /dev/%s%s)r^ rb �lenr� rw r
)r= �
short_name�mappings�nfrom�tlist�nto�candr) r) r, �
_remap_device s
��zDataSource._remap_devicec C � d S r9 r) )r= �_namer) r) r, �device_name_to_device' � z DataSource.device_name_to_devicec C s, | j }z| j�� }W |S ty Y |S w )z<Default locale is en_US.UTF-8, but allow distros to override)�default_localer� �
get_localer )r= �localer) r) r, rT / s ��zDataSource.get_localec C s2 | j �d| j �d��}|r|S | j �di ��d�S )Nr� r� � placement�ri rr )r= � top_level_azr) r) r, r� 8 s �z DataSource.availability_zonec C s | j �d�S )Nr� rW r< r) r) r, r� A s zDataSource.regionc C s" | j rd| j vr
dS t| j d �S )Nr� ziid-datasource)ri rI r< r) r) r, r� E s zDataSource.get_instance_idc C sX d}d}|}d}| j r| j �d�sW|rtd|�S g }t�� } | dkr$d}t�| �}
|
r:|
�d�dkr:t|
��d�}nI| rK| �d�dkrKt| ��d�}n8| rR| |g}n1||g}n,| j d } t �
| �r~g }|rjt� | �}|rtt|��d�}nd | � dd
� g}n| �d�}t
|�d kr�|d } d�|d d� �}n|d } |r�||kr�d | |f } t| |�S )
a� Get hostname or fqdn from the datasource. Look it up if desired.
@param fqdn: Boolean, set True to return hostname with domain.
@param resolve_ip: Boolean, set True to attempt to resolve an ipv4
address provided in local-hostname meta-data.
@param metadata_only: Boolean, set True to avoid looking up hostname
if meta-data doesn't have local-hostname present.
@return: a DataSourceHostname NamedTuple
<hostname or qualified hostname>, <is_default> (str, bool).
is_default is a bool and
it's true only if hostname is localhost and was
returned by util.get_hostname() as a default.
This is used to differentiate with a user-defined
localhost hostname.
Optionally return (None, False) when
metadata_only is True and local-hostname data is not available.
� localdomain� localhostFr� NT�.r zip-%sr� r� z%s.%s)ri rr r� r r� �get_fqdn_from_hosts�findrI rs r �is_ipv4_address�
gethostbyaddrrc rG r
) r= �fqdn�
resolve_ip�
metadata_only� defdomain�defhost�domainr� �toksr� �
hosts_fqdn�lhostr) r) r, r� K sF
zDataSource.get_hostnamec C s | j j| d�S )N)� data_source)r� �get_package_mirror_infor< r) r) r, rj � s z"DataSource.get_package_mirror_info�source_event_typesc C sP i }|D ]!}| j �� D ]\}}||v r$|�|�s t� ||< || �|� q q|S r9 )�supported_update_eventsr^ rr �set�add)r= rk �supported_events�event� update_scope�
update_eventsr) r) r, �get_supported_events� s �
��z DataSource.get_supported_eventsc C s� | � |�}|�� D ] \}}t�d|jd�dd� |D ��� | �d| tff� q |r6| �� | �� }|r6dS t�d| d�dd� |D ��� d S )
a� Refresh cached metadata if the datasource supports this event.
The datasource has a list of supported_update_events which
trigger refreshing all cached metadata as well as refreshing the
network configuration.
@param source_event_types: List of EventTypes which may trigger a
metadata update.
@return True if the datasource did successfully update cached metadata
due to source_event_type.
z:Update datasource metadata and %s config due to events: %s�, c S � g | ]}|j �qS r) r: ��.0rp r) r) r, �
<listcomp>� � z;DataSource.update_metadata_if_supported.<locals>.<listcomp>z
_%s_configTz(Datasource %s not updated for events: %sc S ru r) r: rv r) r) r, rx � ry F) rs r^ r� r� r; r
r� r� r� )r= rk ro �scope�matched_events�resultr) r) r, � update_metadata_if_supported� s&
��z'DataSource.update_metadata_if_supportedc C r� r� r) )r= r� r) r) r, �check_instance_id� r� z DataSource.check_instance_idc C r� )a check_if_fallback_is_allowed()
Checks if a cached ds is allowed to be restored when no valid ds is
found in local mode by checking instance-id and searching valid data
through ds list.
@return True if a ds allows fallback, False otherwise.
Fr) r< r) r) r, r� � s z'DataSource.check_if_fallback_is_allowedc C sT |d u rt }|d u r t}| D ]}|d u rq||v r | S t�d||� | S |S )Nz%invalid dsmode '%s', using default=%s)�DSMODE_NETWORK�
VALID_DSMODESr� r )�
candidates�default�valid� candidater) r) r, �_determine_dsmode� s �z DataSource._determine_dsmodec C rO r9 r) r< r) r) r, �network_config� r� zDataSource.network_configc C r� )a( setup(is_new_instance)
This is called before user-data and vendor-data have been processed.
Unless the datasource has set mode to 'local', then networking
per 'fallback' or per 'network_config' will have been written and
brought up the OS at this point.
Nr) )r= �is_new_instancer) r) r, �setup� s zDataSource.setupc C r� )a� activate(cfg, is_new_instance)
This is called before the init_modules will be called but after
the user-data and vendor-data have been fully processed.
The cfg is fully up to date config, it contains a merged view of
system config, datasource config, user config, vendor config.
It should be used rather than the sys_cfg passed to __init__.
is_new_instance is a boolean indicating if this is a new instance.
Nr) )r= �cfgr� r) r) r, �activate� s zDataSource.activatec C r� )z�
Called when the user issues 'cloud-init clean -c datasource'
command.
Individual data sources should implement their own cleanup handler.
Nr) r< r) r) r, �clean
rR zDataSource.cleanr9 )r) �T)F)FFF)NN)dr@ rA rB r �dsmoderS r� r� r rI r r� r� r� r
r r1 rD rH rF rE r� r r r! r# r% r r! r �BOOT_NEW_INSTANCE�BOOT� BOOT_LEGACY�HOTPLUGrl �default_update_eventsr� r� r r� r� r� r� r� r� �_ci_pkl_versionr r r� r~ r� r> r� r� r� r� r� r� r �timedr� r� r� r& r+ r. r1 �propertyr� r� r2 r� r6 r r) r( r- r0 r? r� rB rN rQ rT r� r� r� r� rj r rs r} r~ r� � staticmethodr� r� r� r� r� r) r) r) r, r" � s�
� �� ��
� %
&
V
<
H
�
�&
)� metaclassc C s� | sg S t | t�r
| �� S t | ttf�rt| �S t | t�rEg }| �� D ] \}}t |t�r/|g}t |ttf�rB|D ] }|rA|�|� q8q#|S g S r9 )ra rI �
splitlines�listrm rd r^ r` )� pubkey_data�keys�_keyname�klist�pkeyr) r) r, r@ s$
�r@ r7 c C s. t |||�}dd� |D �}t|v rdnd} t�d| |� t||�D ]j\}
} tjd|
�dd� d | |
f d
| |
f |d �} z?| �3 t�d | � | | ||�}
|
�t j
g�rkd
| |
f | _ |
t �
| �fW d � W S W d � n1 suw Y W q! ty� t�td| � Y q!w dd�|� }t|��)Nc S s g | ]}t �|��qS r) r� )rw r> r) r) r, rx 4 s z find_source.<locals>.<listcomp>�networkr z#Searching for %s data source in: %sz search-%sr" rX z searching for %s data from %szno %s data found from %s)�name� description�message�parentz%Seeing if we can get any data from %szfound %s data from %szGetting data from %s failedz4Did not find any data source, searched classes: (%s)rt )� list_sources� DEP_NETWORKr� r� �zipr �ReportEventStackrc r} r r� r� r r� r$ r r r
rT )r� r� r� �ds_deps�cfg_list�pkg_list�reporter�ds_list�ds_namesr� r� �cls�myrep�s�msgr) r) r, � find_source0 s>
� � � �� ��r� c C s� g }t �d| ||� | D ]5}t�|�}t�||dg�\}}|s%t �d|� |D ]}t�|�} t| d�}
|
|�} | r@|�| � nq'q |S )z�Return a list of classes that have the same depends as 'depends'
iterate through cfg_list, loading "DataSource*" modules
and calling their "get_datasource_list".
Return an ordered list of classes that match (if any)
zLLooking for data source in: %s, via packages %s that matches dependencies %s�get_datasource_listzDCould not import %s. Does the DataSource exist and is it importable?) r� r� r �"match_case_insensitive_module_name� find_module�error�
import_module�getattrrf ) r� �dependsr� �src_listr3 �ds_name�m_locs� _looked_locs�m_loc�mod�lister�matchesr) r) r, r� Q s6 �
��
��r� � system-uuid�fieldc C s* | sdS t �|�}|s
dS | �� |�� kS r� )r
�
read_dmi_datar_ )r� r� � dmi_valuer) r) r, � instance_id_matches_system_uuidu s
r� c C sl | st } |st }|t kr| t kr| S |S t�� D ]\}}|\}}|�|�r-|| �r-| S q| t kr4| S |S )z@Lookup the canonical cloud-id for a given cloud_name and region.)r4 �CLOUD_ID_REGION_PREFIX_MAPr^ rb )r� r� r� �prefix�
cloud_id_testr� � valid_cloudr) r) r, r� � s �r� Tc C sf | sdS t | t�r | S t | t�rt�| �S t | t�r+|du r't| �d�dd�S td��tdt | � ��)aL data: a loaded object (strings, arrays, dicts).
return something suitable for cloudinit vendordata_raw.
if data is:
None: return None
string: return string
list: return data
the list is then processed in UserDataProcessor
dict: return convert_vendordata(data.get('cloud-init'))
NTz
cloud-initF)�recursez'vendordata['cloud-init'] cannot be dictz$Unknown data type for vendordata: %s)
ra rI r� r\ r] rd �convert_vendordatarr r r7 )�datar� r) r) r, r� � s
r� c @ rS )�BrokenMetadataNrU r) r) r) r, r� � rV r� c C s4 g }t | �}|D ]\}}|t |�kr|�|� q|S r9 )rm r` )r� r� �ret_list�depsetr� �depsr) r) r, �list_from_depends� s
�r� rv �fnamec C sn zt �| �}W n ty t�td| � Y dS w z tj||ddd� W dS ty6 t�td|� Y dS w )z[Use pickle to serialize Datasource to a file as a cache.
:return: True on success
z Failed pickling datasource %sF�wb� )�omoder� z Failed pickling datasource to %sT)�pickle�dumpsr$ r r r� r )rv r� � pk_contentsr) r) r, r� � s � ��r� c
C s� d}zt �| �}W n ty( } ztj�| �r t�d| |� W Y d}~nd}~ww |s-dS zt� |�W S t
y= Y dS tyM t � td| � Y dS w )zBUse pickle to deserialize a instance Datasource from a cache file.Nz failed loading pickle in %s: %sz#Failed loading pickled blob from %s) r �load_binary_filer$ r� rw �isfiler� r r� r rP r )r� �pickle_contentsr� r) r) r, �pkl_load� s$ �� �r� c C s t t�� �S )z�Check if command line argument for this datasource was passed
Passing by command line overrides runtime datasource detection
)�parse_cmdline_or_dmir � get_cmdliner) r) r) r, r� � s r� �inputc C s� t �d| �}t �d| �}t �d| �}|p|p|}|p|}|r7|�d��� }tjd|� d|� �dd|� d �d
� |rC|�d�rC|�d�S d S ) Nz(?:^|\s)ds=([^\s;]+)z(?:^|\s)ci\.ds=([^\s;]+)z (?:^|\s)ci\.datasource=([^\s;]+)r� z8Defining the datasource on the command line using ci.ds=z or ci.datasource=z23.2zUse ds=z instead)�
deprecated�deprecated_version�
extra_messagerX )�re�search�group�stripr � deprecate)r� �
ds_parse_0�
ds_parse_1�
ds_parse_2r3 r� r� r) r) r, r� � s& ��
�
r� )rX r) )r� r� )Y�abcr\ r �loggingr� r� r� �enumr r �typingr r r r r r r
r � cloudinitr r
r r r r r r r �cloudinit.atomic_helperr �cloudinit.distrosr �cloudinit.eventr r �cloudinit.filtersr �cloudinit.helpersr �cloudinit.persistencer �cloudinit.reportingr �DSMODE_DISABLED� DSMODE_LOCALr � DSMODE_PASSr� �DEP_FILESYSTEMr� � DS_PREFIXr �REDACT_SENSITIVE_VALUEr5 r� r4 � getLoggerr@ r� r� r1 rJ r$ rP rT rW re rx ry r� r� �ABCMetar" r@ rI r� r� r� r� r� r� �IOErrorr� r� r� r� r� r� r) r) r) r, �<module> s�
(,
�
�
# R
�!%��
�