Support Consul for distributed consensus #238

vitabaks · 2023-01-03T16:42:08Z

Add a new type of scheme: "[Type C] PostgreSQL High-Availability with Consul Service Discovery (DNS)" based on "Patroni" and "Consul".

Based on role: https://github.com/ansible-community/ansible-consul

issue #85

To test, follow these steps:

# 1. clone this repository from branch "consul"
git clone --branch consul --single-branch https://github.com/vitabaks/postgresql_cluster.git

# 2. Go to the playbook directory
cd postgresql_cluster/

# 3. Edit the inventory file
vim inventory
## Specify (non-public) IP addresses and connection settings (`ansible_user`, `ansible_ssh_pass` or `ansible_ssh_private_key_file` for your environment

# 4. Edit the variable file vars/main.yml
vim vars/main.yml
## Specify the variable: "dcs_type: consul"

# 5. install consul role requirements on the control node
ansible-galaxy install -r roles/consul/requirements.yml

# 6. Run playbook:
ansible-playbook deploy_pgcluster.yml

Client access point:

master.postgres-cluster.service.consul
replica.postgres-cluster.service.consul

fixed: FAILED! => {"changed": false, "msg": "Unable to find any of pip3 to use. pip needs to be installed."}

fixed: TASK [consul : Remove resolv.conf association with systemd-resolved] ******************************************************************************************************************************************** fatal: [3.223.140.234]: FAILED! => {"changed": false, "gid": 0, "group": "root", "mode": "0777", "msg": "src file does not exist, use \"force=yes\" if you really want to create the link: /run/resolvconf/resolv.conf", "owner": "root", "path": "/etc/resolv.conf", "size": 39, "src": "/run/resolvconf/resolv.conf", "state": "link", "uid": 0} fatal: [172.31.15.62]: FAILED! => {"changed": false, "gid": 0, "group": "root", "mode": "0777", "msg": "src file does not exist, use \"force=yes\" if you really want to create the link: /run/resolvconf/resolv.conf", "owner": "root", "path": "/etc/resolv.conf", "size": 39, "src": "/run/resolvconf/resolv.conf", "state": "link", "uid": 0} fatal: [172.31.5.27]: FAILED! => {"changed": false, "gid": 0, "group": "root", "mode": "0777", "msg": "src file does not exist, use \"force=yes\" if you really want to create the link: /run/resolvconf/resolv.conf", "owner": "root", "path": "/etc/resolv.conf", "size": 39, "src": "/run/resolvconf/resolv.conf", "state": "link", "uid": 0}

Added to prevent test failures in CI.

Add become: true

…topping service Compatibility with RedHat family version 9. Fixed: FAILED! => {"changed": false, "msg": "Could not find the requested service systemd-resolved: host"}

add role "consul"

9019c7e

vitabaks added the enhancement Improvement of the current functionality label Jan 3, 2023

vitabaks self-assigned this Jan 3, 2023

delete unused

b35c3e3

Repository owner deleted a comment from github-actions bot Jan 3, 2023

vitabaks added 2 commits January 3, 2023 19:58

consul: yamllint disable rule:braces

204a84d

consul: fix yamllint warnings

e9d4b90

Repository owner deleted a comment from github-actions bot Jan 3, 2023

consul: exclude from ansible-lint

21b8416

Repository owner deleted a comment from github-actions bot Jan 3, 2023

vitabaks and others added 15 commits January 3, 2023 21:55

consul: specify the proxy_env variable at the playbook level

1e7d4b1

add consul to tags.md

01b8fad

add the pre-downloaded consul archive for installation

dec44e7

consul: update vars

16421ea

add dig command

17ef486

Install consul role requirements (ansible.utils)

740cb17

Update consul.yml

f9bfa93

Update system.yml

cab162c

consul: add pre-check

930b85b

README: consul role requirements

c7802e4

Update inventory

a207a2d

add a nameserver entry poining to localhost for dnsmasq

8f622af

Update vars/main for consul

e1af272

add consul_services

d9d02b6

consul: fix a typo

1bb35db

vitabaks mentioned this pull request Jan 4, 2023

Support Consul for distributed consensus #85

Closed

vitabaks added 4 commits January 4, 2023 21:37

update consul pre-check

3164e24

consul: make sure the python3-pip package are present

f70a894

fixed: FAILED! => {"changed": false, "msg": "Unable to find any of pip3 to use. pip needs to be installed."}

Update deploy_pgcluster.yml

bc9b7aa

vitabaks added 6 commits January 9, 2023 00:46

Set dcs_type: "consul" for tests

7462220

molecule: exposed_ports: 8500 (consul client) for pgnode

6c3b042

molecule: add consul_node_role: client for pgnode

c4af678

molecule: install consul client on pgnode

fe5f3f4

update molecule vars for dcs_type: "consul"

cdf5877

consul: add AlmaLinux to supported *nix distributions

922b766

Repository owner deleted a comment from github-actions bot Jan 11, 2023

consul: fix yamllint warning

a19e409

Repository owner deleted a comment from github-actions bot Jan 11, 2023

vitabaks and others added 18 commits January 11, 2023 14:41

Update .ansible-lint

f8566f8

Update asserts.yml

acf555a

Update asserts.yml

468b301

Update asserts.yml

54a6078

consul: add AlmaLinux support

53650a8

molecule: consul_iface_check: false

cb9d2e4

Added to prevent test failures in CI.

molecule: consul_gather_server_facts: true

240c8a5

Update converge.yml

72737b2

deploy_pgcluster: prepare the system

3b6160c

Update deploy_pgcluster.yml

04ce592

Add become: true

deploy-finish: update Cluster connection info

27ccd72

consul: Check if resolv.conf is pointing to systemd-resolved before s…

17f5628

…topping service Compatibility with RedHat family version 9. Fixed: FAILED! => {"changed": false, "msg": "Could not find the requested service systemd-resolved: host"}

Update README.md

158bdd9

Update dnsmasq.yml

c9bb3bc

Check if systemd-resolved service exists

f57b6f7

Add TypeC image

ca34b3e

return dcs_type: "etcd" by default

65d1139

README: add Consul scheme

7c52df2

vitabaks merged commit b277e05 into master Jan 17, 2023

vitabaks mentioned this pull request Jan 17, 2023

[Question] Is there a fork or similar project that uses Hashicorp Consul instead of etcd? #150

Closed

vitabaks deleted the consul branch February 18, 2023 21:24

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Support Consul for distributed consensus #238

Support Consul for distributed consensus #238

vitabaks commented Jan 3, 2023 •

edited

Loading

Support Consul for distributed consensus #238

Support Consul for distributed consensus #238

Conversation

vitabaks commented Jan 3, 2023 • edited Loading

vitabaks commented Jan 3, 2023 •

edited

Loading