VhHIdZddlmZmZmZeZdZdZdZ ddl Z ddl m Z m Z dZ ddlZddlmZddlZd Zd ZGd d ZdZedk(reyy#e$rZd Ze j,ZYdZ[;dZ[wwxYw)z=short_description: Check or wait for migrations between nodes)absolute_importdivisionprint_functiona( module: aerospike_migrations short_description: Check or wait for migrations between nodes description: - This can be used to check for migrations in a cluster. This makes it easy to do a rolling upgrade/update on Aerospike nodes. - If waiting for migrations is not desired, simply just poll until port 3000 if available or C(asinfo -v status) returns ok. author: "Albert Autin (@Alb0t)" extends_documentation_fragment: - community.general.attributes attributes: check_mode: support: full diff_mode: support: none options: host: description: - Which host do we use as seed for info connection. required: false type: str default: localhost port: description: - Which port to connect to Aerospike on (service port). required: false type: int default: 3000 connect_timeout: description: - How long to try to connect before giving up (milliseconds). required: false type: int default: 1000 consecutive_good_checks: description: - How many times should the cluster report "no migrations" consecutively before returning OK back to ansible? required: false type: int default: 3 sleep_between_checks: description: - How long to sleep between each check (seconds). required: false type: int default: 60 tries_limit: description: - How many times do we poll before giving up and failing? default: 300 required: false type: int local_only: description: - Do you wish to only check for migrations on the local node before returning, or do you want all nodes in the cluster to finish before returning? required: true type: bool min_cluster_size: description: - Check will return bad until cluster size is met or until tries is exhausted. required: false type: int default: 1 fail_on_cluster_change: description: - Fail if the cluster key changes if something else is changing the cluster, we may want to fail. required: false type: bool default: true migrate_tx_key: description: - The metric key used to determine if we have tx migrations remaining. Changeable due to backwards compatibility. required: false type: str default: migrate_tx_partitions_remaining migrate_rx_key: description: - The metric key used to determine if we have rx migrations remaining. Changeable due to backwards compatibility. required: false type: str default: migrate_rx_partitions_remaining target_cluster_size: description: - When all aerospike builds in the cluster are greater than version 4.3, then the C(cluster-stable) info command will be used. Inside this command, you can optionally specify what the target cluster size is - but it is not necessary. You can still rely on O(min_cluster_size) if you do not want to use this option. - If this option is specified on a cluster that has at least one host <4.3 then it will be ignored until the min version reaches 4.3. required: false type: int a # check for migrations on local node - name: Wait for migrations on local node before proceeding community.general.aerospike_migrations: host: "localhost" connect_timeout: 2000 consecutive_good_checks: 5 sleep_between_checks: 15 tries_limit: 600 local_only: false # example playbook: - name: Upgrade aerospike hosts: all become: true serial: 1 tasks: - name: Install dependencies ansible.builtin.apt: name: - python - python-pip - python-setuptools state: latest - name: Setup aerospike ansible.builtin.pip: name: aerospike # check for migrations every (sleep_between_checks) # If at least (consecutive_good_checks) checks come back OK in a row, then return OK. # Will exit if any exception, which can be caused by bad nodes, # nodes not returning data, or other reasons. # Maximum runtime before giving up in this case will be: # Tries Limit * Sleep Between Checks * delay * retries - name: Wait for aerospike migrations community.general.aerospike_migrations: local_only: true sleep_between_checks: 1 tries_limit: 5 consecutive_good_checks: 3 fail_on_cluster_change: true min_cluster_size: 3 target_cluster_size: 4 register: migrations_check until: migrations_check is succeeded changed_when: false delay: 60 retries: 120 - name: Another thing ansible.builtin.shell: | echo foo - name: Reboot ansible.builtin.reboot: zC # Returns only a success/failure result. Changed is always false. N) AnsibleModulemissing_required_lib)sleepTFc ttdddtdddtdddtdddtddd tddd td d tdddtdddtd dd tddddtdddd }td}t|d }ts |jt dt  |j rd\}}n,t|}|j|jd\}}|r|jd||jdi|y#t$r+}|jdj|Yd}~Bd}~wwxYw)zrun ansible modulestrF localhost)typerequireddefaultinti i<i,boolT)r r Nmigrate_tx_partitions_remaining)r r no_logrmigrate_rx_partitions_remaining) hostportconnect_timeoutconsecutive_good_checkssleep_between_checks tries_limit local_onlymin_cluster_sizetarget_cluster_sizefail_on_cluster_changemigrate_tx_keymigrate_rx_key)changed) argument_specsupports_check_mode aerospike)msg exceptionFNrzFailed.)r' skip_reasonz Error: {0}r') dictr LIB_FOUND fail_jsonr LIB_FOUND_ERR check_mode Migrationshas_migsparams Exceptionformat exit_json) module_argsresultmodulehas_migrationsr* migrationses z/home/dcms/DCMS/lib/python3.12/site-packages/ansible_collections/community/general/plugins/modules/aerospike_migrations.py run_moduler?s uuk B uud ;%%F $%% K!uubIeeSAVd355!D eeTJ#%Nu$EGu$EGK"F! F 1+>#0  2 5   *5 'NK#F+J*4*=*= l++ 'NK      DFv 5\003445s)AE F!E>>FceZdZdZdZdZddZdZdZdZ d Z d Z dd Z dd Z d ZdZdZdZdZdZdZdZddZy)r2z, Check or wait for migrations between nodes cx||_|jj|_i|_|j i|_|jt|_ |jt|_ |j|j |jdd|_ y)Nr cluster_key)r:_create_clientconnect_client_nodes_update_nodes_list_cluster_statistics_update_cluster_statisticsset _namespaces_update_cluster_namespace_list _build_list_update_build_list_start_cluster_key)selfr:s r>__init__zMigrations.__init__s **,446   !#%  '')5 ++-5 !  $ $T[[^ 4] C c|jjd|jjdfgd|jjdid}tj|S)z TODO: add support for auth, tls, and other special features I won't use those features, so I'll wait until somebody complains or does it for me (Cross fingers) create the client objectrrtimeoutr)hostspolicies)r:r4r&client)rPconfigs r>rCzMigrations._create_clientse##F+T[[-?-?-GH4;;--.?@  ''rRNc||jd}|jj||}|jd}t |dk7r?t |dk7r1|j j dtt |z|d}|jd}|j|}d |vrtd |D}|St |dk(r|d}|S|}|S) zXdelimiter is for separate stats that come back, NOT for kv separation which is =r rz6Unexpected number of values returned in info command: r+z =c3@K|]}|jddyw)r]rN)split).0metrics r> z.Migrations._info_cmd_helper..s )/ S!$s) rFrE info_noder_lenr:r/r rstripr-)rPcmdnode delimiterdatadata_arrretvals r>_info_cmd_helperzMigrations._info_cmd_helpers <;;q>D||%%c40zz$ t9>c$i1n KK ! !LCI "  Bx{{6"::i( $;3;F 8}!!! " rRct|_|jD]/}|jd|}|jj |1y)zJcreates self._build_list which is a unique list of build versions.buildN)rJrMrFrladd)rPrgrns r>rNzMigrations._update_build_list#sG5KK (D))'48E     ' (rRcXtjdt|jryy)Nz^([0-3]\.|4\.[0-2])FT)researchminrMrPs r>_can_use_cluster_stablez"Migrations._can_use_cluster_stable,s$ 99+S1A1A-B CrRct|_|jD]6}|jd|}|D]}|jj |8y)z make a unique list of namespaces TODO: does this work on a rolling namespace add/deletion? thankfully if it doesn't, we dont need this on builds >=4.3 namespacesN)rJrKrFrlro)rPrgrw namespaces r>rLz)Migrations._update_cluster_namespace_list4sV5KK 0D..|TBJ' 0   $$Y/ 0 0rRcri|_|jD]!}|jd||j|<#y)z0create a dict of nodes with their related stats statisticsN)rHrFrl)rPrgs r>rIz%Migrations._update_cluster_statistics>s=#% KK :D%%lD9  $ $T * :rRc|jj|_|js|jj dyy)z!get a fresh list of all the nodesz#Failed to retrieve at least 1 node.N)rE get_nodesrFr:r/rts r>rGzMigrations._update_nodes_listEs5ll,,. {{ KK ! !"G HrRc|jd|z|} t||jjd}t||jjd}d k7xsd k7S#t$r_|jj d|jjdzdz|jjdzdz|zdzYst $r|jj d YwxYw) zreturns a True or False. Does the namespace have migrations for the node passed? If no node passed, uses the local node or the first one in the listz namespace/r!r"z%Did not find partition remaining key:z or key:z in 'namespace/z ' output.r+z)namespace stat returned was not numericalr)rlrr:r4KeyErrorr/ TypeError)rPrxrgnamespace_stats namespace_tx namespace_rxs r>_namespace_has_migszMigrations._namespace_has_migsKs$// y0H$O ODKK$6$67G$HIJ ODKK$6$67G$HIJ  q 5LA$55  KK ! !; ""#345 ""#345" "     "   KK ! !? "  sA A--A%C;$C;:C;cd}|j|jD]}|j||s|dz }|dk7S)zPjust calls namespace_has_migs and if any namespace has migs returns truerr)rLrKr)rPrgmigsrxs r>_node_has_migszMigrations._node_has_migsesO ++-)) I'' 48  qyrRci}|jD]+}|j|d}||vrd||<||xxdz cc<-t|jdk(r|j|vryy)zcreate a dictionary to store what each node returns the cluster key as. we should end up with only 1 dict key, with the key being the cluster key.rBrTF)rFrHrdkeysrO)rP cluster_keysrgrBs r>_cluster_key_consistentz"Migrations._cluster_key_consistentos KK /D2248K,.,- [)[)Q.)  / |  " #q (''<7rRcb|jD] }|jd|}|d}|dk(s yy)z=ensure all nodes have 'migrate_allowed' in their stats outputrzmigrate_allowedfalseFT)rFrl)rPrg node_statsalloweds r>_cluster_migrates_allowedz$Migrations._cluster_migrates_allowedsBKK D..|TBJ !23G'!   rRcdd}|jD]}|j|s|dz }|dk(ryy)z!calls node_has_migs for each noderrFT)rFr)rPrrgs r>_cluster_has_migszMigrations._cluster_has_migss@KK D""4(   19rRcF|r|jS|jSN)_local_node_has_migsr)rPlocals r> _has_migszMigrations._has_migss# ,,. .%%''rRc$|jdSr)rrts r>rzMigrations._local_node_has_migss""4((rRct}|jD],}|jt|j|d.t |dkDryt ||j jdk\ryy)zxchecks that all nodes in the cluster are returning the minimum cluster size specified in their statistics output cluster_sizerFrT)rJrHrorrdrsr:r4)rPsizesrgs r>_is_min_cluster_sizezMigrations._is_min_cluster_sizesv,, KD IIc$2248HI J K J!  J4;;--.@A ArRct}|j|jddd}|jjd}||dzt |zdz}|j D]$} |j|j||&t|d k(ry y #tjj$r}d|jvrYd}~y |d}~wwxYw) aAdded 4.3: cluster-stable:size=;ignore-migrations=;namespace= Returns the current 'cluster_key' when the following are satisfied: If 'size' is specified then the target node's 'cluster-size' must match size. If 'ignore-migrations' is either unspecified or 'false' then the target node's migrations counts must be zero for the provided 'namespace' or all namespaces if 'namespace' is not provided.rzrBzcluster-stable:rNzsize=;zunstable-clusterFrT) rJrorlr:r4r rFr&r( ServerErrorr'rd)rPrBrfrrgr=s r>_cluster_stablezMigrations._cluster_stablese --l;MJK"kk001FG  *-#&9"::S@CKK D  5 5c4 @A  { q  &&22 %.  s/!B""C?CCCcv|jdury|jdury|jduryy)zchecks a few things to make sure we're OK to say the cluster has no migs. It could be in a unhealthy condition that does not allow migs, or a split brainT)FzCluster key inconsistent.)FzCluster min size not reached.)Fz#migrate_allowed is false somewhere.)TzOK.)rrrrts r>_cluster_good_statezMigrations._cluster_good_statesC  ' ' ) 55  $ $ &d 29  ) ) +4 7?rRcd}d}t}|t|jjdkr|t|jjdkrs|j |j |j \}}|dur$|jdt|zdz|zn|jr<|jr|dz }nd}|jdt|zdzdznY|j|r&|jdt|zdzd zd}n"|dz }||jjdk(rns|dz }t|jjd |t|jjdkr'|t|jjdkrs||jjdk(ry d|fS) z8returns a boolean, False if no migrations otherwise TruerrrTzSkipping on try#z for reason:rz cluster_stablez migrationsrr)) listrr:r4rGrIrappendr rurrr)rPrconsecutive_goodtry_numr*stablereasons r>r3zMigrations.has_migssf c$++,,];< < DKK&&'@ABC  # # %  + + -"557NFFT!""&W5"#%+, //1++-(A-(+,(#**.W=*+->?^^E*&&*S\9&')67()$$)$'4;;+=+=5,77 qLG $++$$%;< =M c$++,,];< < DKK&&'@ABCN t{{112KL L[  rR)Nrr)T)__name__ __module__ __qualname____doc__rQrCrlrNrurLrIrGrrrrrrrrrrr3r,rRr>r2r2sf6 D (>(0:I 64"( ) 6 0!rRr2cty)zmain method for ansible moduleN)r?r,rRr>mainrsLrR__main__)r __future__rrrr __metaclass__ DOCUMENTATIONEXAMPLESRETURN tracebackansible.module_utils.basicrrr0r&timerrqr. ImportErrorie format_excr?r2rrr,rRr>rsD CB \ |4 l J  I-`[![!|  zFu +I(I((*M+sAA4A//A4