Default

Pigsty 4-node local sandbox demo config

``` 1. --- 2. ###################################################################### 3. # File : pigsty.yml 4. # Desc : Pigsty 4-node local sandbox demo config 5. # Link : https://pigsty.cc/#/v-config 6. # Ctime : 2020-05-22 7. # Mtime : 2022-05-22 8. # Copyright (C) 2018-2022 Ruohang Feng (rh@vonng.com) 9. ######################################################################

2. Sandbox (4-node)

3. ====================================================================

4. admin user : vagrant (nopass ssh & sudo already set)

5. 1. meta : 10.10.10.10 (2 Core | 4GB) pg-meta

6. 2. node-1 : 10.10.10.11 (1 Core | 1GB) pg-test-1

7. 3. node-2 : 10.10.10.12 (1 Core | 1GB) pg-test-2

8. 4. node-3 : 10.10.10.13 (1 Core | 1GB) pg-test-3

9. (replace these ip if your 4-node env have different ip addr)

10. VIP 2: (l2 vip is available inside same LAN )

11. pg-meta ---> 10.10.10.2 ---> 10.10.10.10

12. pg-test ---> 10.10.10.3 ---> 10.10.10.1{1,2,3}

14. all:

16. CLUSTERS

18. meta nodes, nodes, pgsql, redis, pgsql clusters are defined as

19. k:v pair inside all.children. Where the key is cluster name

20. and value is cluster definition consist of two parts:

21. hosts: cluster members ip and instance level variables

22. vars : cluster level variables

24. children: # groups definition

25. ================================================================

26. Meta Nodes: Admin Controller

27. ================================================================

28. meta: # meta nodes are defined in this special group "meta"
29. vars:
30. meta_node: true # mark this group as meta nodes

31. ansible_group_priority: 99 # overwrite with the highest priority

32. nginx_enabled: true # setup repo & underlying nginx

33. nameserver_enabled: false # setup dnsmasq
34. prometheus_enabled: true # setup prometheus
35. grafana_enabled: true # setup grafana
36. loki_enabled: true # setup loki
37. docker_enabled: true # setup docker

38. dcs_safeguard: false # protect dcs server from fat fingers

39. hosts: # add nodes to group 'meta'

40. 10.10.10.10: { }

41. 10.10.10.11: { nginx_enabled: false }

42. 10.10.10.12: { nginx_enabled: false }

43. ================================================================

44. ================================================================

45. PGSQL Clusters

46. ================================================================

47. ----------------------------------

48. pgsql cluster: pg-meta (CMDB)

49. ----------------------------------

50. EXAMPLE pg-meta is the default SINGLE-NODE pgsql cluster deployed on meta node (10.10.10.10)

51. pg-meta: # [REQUIRED], ansible group name , pgsql cluster name. should be unique among environment
52. hosts: # <cluster>.hosts holds instances definition of this cluster
53. 10.10.10.10: # [REQUIRED]: ip address is the key. values are instance level config entries (dict)
54. pg_seq: 1 # [REQUIRED], unique identity parameter (+integer) among pg_cluster
55. pg_role: primary # [REQUIRED], pg_role is mandatory identity parameter, primary|replica|offline
56. pg_offline_query: true # instance with pg_offline_query: true will take offline traffic (saga, etl,...)

57. pg_upstream: x.x.x.x # some other variables can be overwritten on instance level. e.g: pg_upstream, pg_weight, etc...

58. pg_weight: 100 # load balance weight for this instance

59. vars: # <cluster>.vars holds CLUSTER LEVEL CONFIG of this pgsql cluster

60. pg_cluster: pg-meta # [REQUIRED], pgsql cluster name, unique among cluster, used as namespace of cluster resources

61. all vars below are [OPTIONAL] (overwrite global default)

62. pg_version: 14 # pgsql version to be installed (use global version if missing)
63. node_tune: tiny # node optimization profile: {oltp|olap|crit|tiny}, use tiny for vm sandbox
64. pg_conf: tiny.yml # pgsql template: {oltp|olap|crit|tiny}, use tiny for sandbox
65. patroni_watchdog_mode: off # disable patroni watchdog on meta node {off|require|automatic}

66. pg_lc_ctype: en_US.UTF8 # use en_US.UTF8 locale for i18n char support (required by pg_trgm)

67. define business database meta , used as CMDB & default database for single-node setup

68. pg_databases: # define business databases on this cluster, array of database definition
69. • name: meta # required, name is the only mandatory field of a database definition
70. baseline: cmdb.sql # optional, database sql baseline path, (relative path among ansible search path, e.g files/)

71. owner: postgres # optional, database owner, postgres by default

72. template: template1 # optional, which template to use, template1 by default

73. encoding: UTF8 # optional, database encoding, UTF8 by default. (MUST same as template database)

74. locale: C # optional, database locale, C by default. (MUST same as template database)

75. lc_collate: C # optional, database collate, C by default. (MUST same as template database)

76. lc_ctype: C # optional, database ctype, C by default. (MUST same as template database)

77. tablespace: pg_default # optional, default tablespace, 'pg_default' by default.

78. allowconn: true # optional, allow connection, true by default. false will disable connect at all

79. revokeconn: false # optional, revoke public connection privilege. false by default. (leave connect with grant option to owner)

80. pgbouncer: true # optional, add this database to pgbouncer database list? true by default

81. comment: pigsty meta database # optional, comment string for this database
82. connlimit: -1 # optional, database connection limit, default -1 disable limit
83. schemas: [pigsty] # optional, additional schemas to be created, array of schema names
84. extensions: # optional, additional extensions to be installed: array of schema definition {name,schema}
85. • { name: adminpack, schema: pg_catalog } # install adminpack to pg_catalog
86. • { name: postgis, schema: public } # if schema is omitted, extension will be installed according to search_path.
87. • { name: timescaledb } # some extensions are not relocatable, you can just omit the schema part
88. • { name: grafana, owner: dbuser_grafana , revokeconn: true , comment: grafana primary database }
89. • { name: bytebase, owner: dbuser_bytebase , revokeconn: true , comment: bytebase primary database }
90. • { name: kong, owner: dbuser_kong , revokeconn: true , comment: kong the api gateway database }

91. define business users for this cluster

92. pg_users: # define business users/roles on this cluster, array of user definition

93. define admin user for meta database (This user are used for pigsty app deployment by default)

94. • name: dbuser_meta # required, name is the only mandatory field of a user definition
95. password: md5d3d10d8cad606308bdb180148bf663e1 # md5 salted password of 'DBUser.Meta'

96. optional, plain text and md5 password are both acceptable (prefixed with md5)

97. login: true # optional, can login, true by default (new biz ROLE should be false)
98. superuser: false # optional, is superuser? false by default
99. createdb: false # optional, can create database? false by default
100. createrole: false # optional, can create role? false by default
101. inherit: true # optional, can this role use inherited privileges? true by default
102. replication: false # optional, can this role do replication? false by default
103. bypassrls: false # optional, can this role bypass row level security? false by default
104. pgbouncer: true # optional, add this user to pgbouncer user-list? false by default (production user should be true explicitly)
105. connlimit: -1 # optional, user connection limit, default -1 disable limit
106. expire_in: 3650 # optional, now + n days when this role is expired (OVERWRITE expire_at)
107. expire_at: '2030-12-31' # optional, YYYY-MM-DD 'timestamp' when this role is expired (OVERWRITTEN by expire_in)
108. comment: pigsty admin user # optional, comment string for this user/role
109. roles: [dbrole_admin] # optional, belonged roles. default roles are: dbrole_{admin,readonly,readwrite,offline}
110. parameters: {} # optional, role level parameters with ALTER ROLE SET

111. search_path: public # key value config parameters according to postgresql documentation (e.g: use pigsty as default search_path)

112. • {name: dbuser_view ,password: DBUser.Viewer ,pgbouncer: true ,roles: [dbrole_readonly], comment: read-only viewer for meta database}
113. • {name: dbuser_grafana ,password: DBUser.Grafana ,pgbouncer: true ,roles: [dbrole_admin] ,comment: admin user for grafana database }
114. • {name: dbuser_bytebase ,password: DBUser.Bytebase ,pgbouncer: true ,roles: [dbrole_admin] ,comment: admin user for bytebase database }
115. • {name: dbuser_kong ,password: DBUser.Kong ,pgbouncer: true ,roles: [dbrole_admin] ,comment: admin user for kong api gateway }

116. pg_hba_rules_extra:

117. • title: allow grafana bytebase kong intranet access
118. role: common
119. rules:
120. • host kong dbuser_kong 10.0.0.0/8 md5
121. • host bytebase dbuser_bytebase 10.0.0.0/8 md5
122. • host grafana dbuser_grafana 10.0.0.0/8 md5

123. vip_mode: l2

124. vip_address: 10.10.10.2
125. vip_cidrmask: 8
126. vip_interface: eth1
127. node_crontab:
128. • '00 01 * * * postgres /pg/bin/pg-backup 2>>/pg/log/backup.log'

129. ----------------------------------

130. pgsql cluster: pg-test (3 nodes)

131. ----------------------------------

132. pg-test ---> 10.10.10.3 ---> 10.10.10.1{1,2,3}

133. pg-test: # define the new 3-node cluster pg-test
134. hosts:
135. 10.10.10.11: { pg_seq: 1, pg_role: primary } # primary instance, leader of cluster
136. 10.10.10.12: { pg_seq: 2, pg_role: replica } # replica instance, follower of leader
137. 10.10.10.13: { pg_seq: 3, pg_role: replica, pg_offline_query: true } # replica with offline access
138. vars:
139. pg_cluster: pg-test # define pgsql cluster name
140. pg_version: 14 # test postgresql 13 with pg-test cluster
141. pg_users:
142. • name: test
143. password: test
144. pgbouncer: true
145. roles: [ dbrole_admin ]
146. pg_databases: # create a database and user named 'test'
147. • name: test

148. vip_mode: l2 # enable/disable vip (require members in same LAN)

149. vip_address: 10.10.10.3 # virtual ip address for this cluster
150. vip_cidrmask: 8 # cidr network mask length

151. vip_interface: eth1 # interface to add virtual ip

152. pg_services_extra: # extra services in addition to pg_services_default, array of service definition

153. standby service will route {ip|name}:5435 to sync replica's pgbouncer (5435->6432 standby)

154. • name: standby # required, service name, the actual svc name will be prefixed with pg_cluster, e.g: pg-meta-standby
155. src_ip: "*" # required, service bind ip address, * for all ip, vip for cluster vip_address
156. src_port: 5435 # required, service exposed port (work as kubernetes service node port mode)
157. dst_port: pgbouncer # optional, destination port, postgres|pgbouncer|<port_number> , pgbouncer(6432) by default
158. check_method: http # optional, health check method: http is the only available method for now
159. check_port: patroni # optional, health check port: patroni|pg_exporter|<port_number> , patroni(8008) by default
160. check_url: /sync # optional, health check url path, /read-only?lag=0 by default
161. check_code: 200 # optional, health check expected http code, 200 by default
162. selector: "[]" # required, JMESPath to filter inventory ()
163. selector_backup: "[? pg_role == primary]" # primary used as backup server for standby service (will not work because /sync for )
164. haproxy: # optional, adhoc parameters for haproxy service provider (vip_l4 is another service provider)
165. maxconn: 3000 # optional, max allowed front-end connection
166. balance: roundrobin # optional, haproxy load balance algorithm (roundrobin by default, other: leastconn)

167. default_server_options: 'inter 3s fastinter 1s downinter 5s rise 3 fall 3 on-marked-down shutdown-sessions slowstart 30s maxconn 3000 maxqueue 128 weight 100'

168. ================================================================

169. REDIS Clusters

170. ================================================================

171. ----------------------------------

172. redis sentinel example

173. ----------------------------------

174. redis-meta:
175. hosts:
176. 10.10.10.10:
177. redis_node: 1
178. redis_instances: { 6001 : {} ,6002 : {} , 6003 : {} }
179. vars:
180. redis_cluster: redis-meta
181. redis_mode: sentinel

182. redis_max_memory: 64MB

183. ----------------------------------

184. redis cluster example

185. ----------------------------------

186. redis-test:
187. hosts:
188. 10.10.10.11:
189. redis_node: 1
190. redis_instances: { 6501 : {} ,6502 : {} ,6503 : {} ,6504 : {} ,6505 : {} ,6506 : {} }
191. 10.10.10.12:
192. redis_node: 2
193. redis_instances: { 6501 : {} ,6502 : {} ,6503 : {} ,6504 : {} ,6505 : {} ,6506 : {} }
194. vars:
195. redis_cluster: redis-test # name of this redis 'cluster'
196. redis_mode: cluster # standalone,cluster,sentinel
197. redis_max_memory: 32MB # max memory used by each redis instance

198. redis_mem_policy: allkeys-lru # memory eviction policy

199. ----------------------------------

200. redis standalone example

201. ----------------------------------

202. redis-common:
203. hosts:
204. 10.10.10.13:
205. redis_node: 1
206. redis_instances:
207. 6501: {}
208. 6502: { replica_of: '10.10.10.13 6501' }
209. 6503: { replica_of: '10.10.10.13 6501' }
210. vars:
211. redis_cluster: redis-common # name of this redis 'cluster'
212. redis_mode: standalone # standalone,cluster,sentinel

213. redis_max_memory: 64MB # max memory used by each redis instance

215. VARS

217. vars: # global variables

218. version: v1.5.1 # pigsty version string

219. ================================================================

220. VARS: INFRA

221. ================================================================

222. -----------------------------------------------------------------

223. CONNECT

224. -----------------------------------------------------------------

225. INSTANCE level ansible connect parameters

226. ansible_user: vagrant # which user to be used (when connecting to remote nodes)

227. ansible_port: 22 # which port to be used (when connecting to remote nodes)

228. ansible_host: meta # ssh alias host name (when connecting to remote nodes)

229. ansible_ssh_private_key_file: ~/.ssh/id_rsa # ssh private key file

230. ansible_ssh_common_args: '-o StrictHostKeyChecking=no' # ssh common args

231. proxy_env: # global proxy env when downloading packages

232. no_proxy: "localhost,127.0.0.1,10.0.0.0/8,192.168.0.0/16,.pigsty,.aliyun.com,mirrors.,.myqcloud.com,*.tsinghua.edu.cn"

233. http_proxy: # set your proxy here: e.g http://user:pass@proxy.xxx.com

234. https_proxy: # set your proxy here: e.g http://user:pass@proxy.xxx.com

235. all_proxy: # set your proxy here: e.g http://user:pass@proxy.xxx.com

236. -----------------------------------------------------------------

237. CA

238. -----------------------------------------------------------------

239. ca_method: create # create|copy|recreate
240. ca_subject: "/CN=root-ca" # self-signed CA subject
241. ca_homedir: /ca # ca cert directory
242. ca_cert: ca.crt # ca public key/cert

243. ca_key: ca.key # ca private key

244. -----------------------------------------------------------------

245. NGINX

246. -----------------------------------------------------------------

247. nginx_enabled: true # build local repo on this node
248. nginx_port: 80 # repo listen address, must same as repo_address

249. nginx_home: /www # default repo home dir

250. nginx_upstream: # domain names and upstream servers

251. • { name: home , domain: pigsty , endpoint: "10.10.10.10:80" }
252. • { name: grafana , domain: g.pigsty , endpoint: "10.10.10.10:3000" }
253. • { name: loki , domain: l.pigsty , endpoint: "10.10.10.10:3100" }
254. • { name: prometheus , domain: p.pigsty , endpoint: "10.10.10.10:9090" }
255. • { name: alertmanager , domain: a.pigsty , endpoint: "10.10.10.10:9093" }
256. • { name: consul , domain: c.pigsty , endpoint: "127.0.0.1:8500" } #== ^ required ==#
257. • { name: postgrest , domain: api.pigsty , endpoint: "127.0.0.1:8884" } #== v optional ==#
258. • { name: pgadmin , domain: adm.pigsty , endpoint: "127.0.0.1:8885" }
259. • { name: pgweb , domain: cli.pigsty , endpoint: "127.0.0.1:8886" }
260. • { name: bytebase , domain: ddl.pigsty , endpoint: "127.0.0.1:8887" }
261. • { name: jupyter , domain: lab.pigsty , endpoint: "127.0.0.1:8888" }
262. • { name: gitea , domain: git.pigsty , endpoint: "127.0.0.1:8889" }
263. • { name: minio , domain: sss.pigsty , endpoint: "127.0.0.1:9000" }

264. nginx_indexes: # application nav links on home page

265. • { name: PgAdmin4 , url : 'http://adm.pigsty' , comment: 'PgAdmin4 for PostgreSQL' }
266. • { name: PGWeb , url : 'http://cli.pigsty' , comment: 'PGWEB Browser Client' }
267. • { name: ByteBase , url : 'http://ddl.pigsty' , comment: 'ByteBase Schema Migrator' }
268. • { name: PostgREST , url : 'http://api.pigsty' , comment: 'Kong API Gateway' }
269. • { name: Gitea , url : 'http://git.pigsty' , comment: 'Minio Object Storage' }
270. • { name: Minio , url : 'http://sss.pigsty' , comment: 'Minio Object Storage' }
271. • { name: Explain , url : '/pev2' , comment: 'postgres explain visualizer' }
272. • { name: Package , url : '/pigsty' , comment: 'local yum repo packages' }
273. • { name: PG Logs , url : '/logs' , comment: 'postgres raw csv logs' }
274. • { name: Schemas , url : '/schema' , comment: 'schemaspy summary report' }
275. • { name: Reports , url : '/report' , comment: 'pgbadger summary report' }
276. • { name: ISD , url : '${grafana}/d/isd-overview' , comment: 'noaa isd data visualization' }
277. • { name: Covid , url : '${grafana}/d/covid-overview' , comment: 'covid data visualization' }
278. • { name: Worktime , url : '${grafana}/d/worktime-overview' , comment: 'worktime query' }
279. • { name: DBTrend , url : '${grafana}/d/dbeng-trending' , comment: 'DB Engine Trending Graph' }

280. -----------------------------------------------------------------

281. REPO

282. -----------------------------------------------------------------

283. repo_name: pigsty # repo name, pigsty by default
284. repo_address: pigsty # external address to this repo (ip:port or url)
285. repo_rebuild: false # force re-download packages
286. repo_remove: true # remove existing upstream repo
287. repo_upstreams: # where to download packages?
288. • name: base
289. description: CentOS-$releasever - Base
290. gpgcheck: no
291. baseurl:
292. • https://mirrors.tuna.tsinghua.edu.cn/centos/$releasever/os/$basearch/
293. • http://mirrors.aliyun.com/centos/$releasever/os/$basearch/
294. • http://mirror.centos.org/centos/$releasever/os/$basearch/
295. • name: updates
296. description: CentOS-$releasever - Updates
297. gpgcheck: no
298. baseurl:
299. • https://mirrors.tuna.tsinghua.edu.cn/centos/$releasever/updates/$basearch/
300. • http://mirrors.aliyun.com/centos/$releasever/updates/$basearch/
301. • http://mirror.centos.org/centos/$releasever/updates/$basearch/
302. • name: extras
303. description: CentOS-$releasever - Extras
304. baseurl:
305. • https://mirrors.tuna.tsinghua.edu.cn/centos/$releasever/extras/$basearch/
306. • http://mirrors.aliyun.com/centos/$releasever/extras/$basearch/
307. • http://mirror.centos.org/centos/$releasever/extras/$basearch/
308. gpgcheck: no
309. • name: epel
310. description: CentOS $releasever - epel
311. gpgcheck: no
312. baseurl:
313. • https://mirrors.tuna.tsinghua.edu.cn/epel/$releasever/$basearch
314. • http://mirrors.aliyun.com/epel/$releasever/$basearch
315. • http://download.fedoraproject.org/pub/epel/$releasever/$basearch
316. • name: grafana
317. description: Grafana Official Yum Repo
318. enabled: yes
319. gpgcheck: no
320. baseurl:
321. • https://mirrors.tuna.tsinghua.edu.cn/grafana/yum/rpm
322. • https://packages.grafana.com/oss/rpm
323. • name: prometheus
324. description: Prometheus and exporters
325. gpgcheck: no
326. baseurl: https://packagecloud.io/prometheus-rpm/release/el/$releasever/$basearch
327. • name: pgdg-common
328. description: PostgreSQL common RPMs for RHEL/CentOS $releasever - $basearch
329. gpgcheck: no
330. baseurl:
331. • http://mirrors.tuna.tsinghua.edu.cn/postgresql/repos/yum/common/redhat/rhel-$releasever-$basearch
332. • https://download.postgresql.org/pub/repos/yum/common/redhat/rhel-$releasever-$basearch
333. • name: pgdg14
334. description: PostgreSQL 14 for RHEL/CentOS $releasever - $basearch
335. gpgcheck: no
336. baseurl:
337. • https://mirrors.tuna.tsinghua.edu.cn/postgresql/repos/yum/14/redhat/rhel-$releasever-$basearch
338. • https://download.postgresql.org/pub/repos/yum/14/redhat/rhel-$releasever-$basearch
339. • name: timescaledb
340. description: TimescaleDB for RHEL/CentOS $releasever - $basearch
341. gpgcheck: no
342. baseurl:
343. • https://packagecloud.io/timescale/timescaledb/el/7/$basearch
344. • name: centos-sclo
345. description: CentOS-$releasever - SCLo
346. gpgcheck: no

347. mirrorlist: http://mirrorlist.centos.org?arch=$basearch&release=$releasever&repo=sclo-sclo

348. baseurl: http://mirrors.aliyun.com/centos/$releasever/sclo/$basearch/sclo/
349. • name: centos-sclo-rh
350. description: CentOS-$releasever - SCLo rh
351. gpgcheck: no

352. mirrorlist: http://mirrorlist.centos.org?arch=$basearch&release=7&repo=sclo-rh

353. baseurl: http://mirrors.aliyun.com/centos/$releasever/sclo/$basearch/rh/
354. • name: nginx
355. description: Nginx Official Yum Repo
356. skip_if_unavailable: true
357. gpgcheck: no
358. baseurl: http://nginx.org/packages/centos/$releasever/$basearch/
359. • name: harbottle # for latest consul & kubernetes
360. description: Copr repo for main owned by harbottle
361. skip_if_unavailable: true
362. gpgcheck: no
363. baseurl: https://download.copr.fedorainfracloud.org/results/harbottle/main/epel-$releasever-$basearch/
364. • name: pg_probackup # for pg_probackup
365. description: PG_PROBACKUP Centos packages for PostgresPro Standard and Enterprise - $basearch
366. skip_if_unavailable: true
367. gpgcheck: no
368. baseurl: https://repo.postgrespro.ru/pg_probackup-forks/rpm/latest/centos-$releasever-$basearch
369. • name: docker-ce # for latest docker
370. description: Docker CE Stable - $basearch
371. skip_if_unavailable: true
372. gpgcheck: no
373. baseurl:
374. • https://mirrors.aliyun.com/docker-ce/linux/centos/$releasever/$basearch/stable
375. • https://download.docker.com/linux/centos/$releasever/$basearch/stable

376. repo_packages: # which packages to be included # what to download #

377. • epel-release nginx wget yum-utils yum createrepo sshpass zip unzip # ---- boot ---- #
378. • ntp chrony uuid lz4 bzip2 nc pv jq vim-enhanced make patch bash lsof wget git tuned perf ftp lrzsz rsync # ---- node ---- #
379. • numactl grubby sysstat dstat iotop bind-utils net-tools tcpdump socat ipvsadm telnet ca-certificates keepalived # ----- utils ----- #
380. • readline zlib openssl openssh-clients libyaml libxml2 libxslt libevent perl perl-devel perl-ExtUtils* # --- deps:pg --- #
381. • readline-devel zlib-devel uuid-devel libuuid-devel libxml2-devel libxslt-devel openssl-devel libicu-devel # --- deps:devel -- #
382. • grafana prometheus2 pushgateway alertmanager mtail consul consul_exporter consul-template etcd dnsmasq # ----- meta ----- #
383. • node_exporter nginx_exporter blackbox_exporter redis_exporter # ---- exporter --- #
384. • ansible python python-pip python-psycopg2 # - ansible & py3 - #
385. • python3 python3-psycopg2 python36-requests python3-etcd python3-consul python36-urllib3 python36-idna python36-pyOpenSSL python36-cryptography
386. • patroni patroni-consul patroni-etcd pgbouncer pg_cli pgbadger pg_activity tail_n_mail # -- pgsql common - #
387. • pgcenter boxinfo check_postgres emaj pgbconsole pg_bloat_check pgquarrel barman barman-cli pgloader pgFormatter pitrery pspg pgxnclient PyGreSQL
388. • postgresql14 postgis32_14 citus_14 pglogical_14 timescaledb-2-postgresql-14 pg_repack_14 wal2json_14 # -- pg14 packages -#
389. • pg_qualstats_14 pg_stat_kcache_14 pg_stat_monitor_14 pg_top_14 pg_track_settings_14 pg_wait_sampling_14 pg_probackup-std-14
390. • pg_statement_rollback_14 system_stats_14 plproxy_14 plsh_14 pldebugger_14 plpgsql_check_14 pgmemcache_14 # plr_14
391. • mysql_fdw_14 ogr_fdw_14 tds_fdw_14 sqlite_fdw_14 firebird_fdw_14 hdfs_fdw_14 mongo_fdw_14 osm_fdw_14 pgbouncer_fdw_14
392. • hypopg_14 geoip_14 rum_14 hll_14 ip4r_14 prefix_14 pguri_14 tdigest_14 topn_14 periods_14
393. • bgw_replstatus_14 count_distinct_14 credcheck_14 ddlx_14 extra_window_functions_14 logerrors_14 mysqlcompat_14 orafce_14
394. • repmgr_14 pg_auth_mon_14 pg_auto_failover_14 pg_background_14 pg_bulkload_14 pg_catcheck_14 pg_comparator_14
395. • pg_cron_14 pg_fkpart_14 pg_jobmon_14 pg_partman_14 pg_permissions_14 pg_prioritize_14 pgagent_14
396. • pgaudit16_14 pgauditlogtofile_14 pgcryptokey_14 pgexportdoc_14 pgfincore_14 pgimportdoc_14 powa_14 pgmp_14 pgq_14
397. • pgquarrel-0.7.0-1 pgsql_tweaks_14 pgtap_14 pgtt_14 postgresql-unit_14 postgresql_anonymizer_14 postgresql_faker_14
398. • safeupdate_14 semver_14 set_user_14 sslutils_14 table_version_14 # pgrouting_14 osm2pgrouting_14
399. • clang coreutils diffutils rpm-build rpm-devel rpmlint rpmdevtools bison flex # gcc gcc-c++ # - build utils - #
400. • docker-ce docker-compose kubelet kubectl kubeadm kubernetes-cni helm # - cloud native- #

401. repo_url_packages: # extra packages from url

402. • https://github.com/Vonng/loki-rpm/releases/download/v2.5.0/loki-2.5.0.x86_64.rpm
403. • https://github.com/Vonng/loki-rpm/releases/download/v2.5.0/promtail-2.5.0.x86_64.rpm
404. • https://github.com/Vonng/pg_exporter/releases/download/v0.5.0/pg_exporter-0.5.0.x86_64.rpm
405. • https://github.com/cybertec-postgresql/vip-manager/releases/download/v1.0.2/vip-manager-1.0.2-1.x86_64.rpm
406. • https://github.com/Vonng/haproxy-rpm/releases/download/v2.5.7/haproxy-2.5.7-1.el7.x86_64.rpm
407. • https://github.com/Vonng/pigsty-pkg/releases/download/misc/redis-6.2.7-1.el7.remi.x86_64.rpm
408. • https://github.com/dalibo/pev2/releases/download/v0.24.0/pev2.tar.gz
409. • https://github.com/Vonng/pigsty-pkg/releases/download/misc/polysh-0.4-1.noarch.rpm

410. -----------------------------------------------------------------

411. NAMESERVER

412. -----------------------------------------------------------------

413. nameserver_enabled: false # setup dnsmasq
414. dns_records: # dynamic dns record resolved by dnsmasq
415. • 10.10.10.2 pg-meta # sandbox vip for pg-meta
416. • 10.10.10.3 pg-test # sandbox vip for pg-test
417. • 10.10.10.10 pg-meta-1 # sandbox instance pg-meta-1
418. • 10.10.10.11 pg-test-1 # sandbox instance node-1
419. • 10.10.10.12 pg-test-2 # sandbox instance node-2
420. • 10.10.10.13 pg-test-3 # sandbox instance node-3

421. -----------------------------------------------------------------

422. PROMETHEUS

423. -----------------------------------------------------------------

424. prometheus_enabled: true # setup prometheus
425. prometheus_data_dir: /data/prometheus/data
426. prometheus_options: '--storage.tsdb.retention=15d'
427. prometheus_reload: false # reload prometheus instead of recreate it?
428. prometheus_sd_method: static # service discovery method: static|consul
429. prometheus_sd_interval: 5s # service discovery refresh interval
430. prometheus_scrape_interval: 10s # global scrape & evaluation interval

431. prometheus_scrape_timeout: 8s # scrape timeout

432. -----------------------------------------------------------------

433. EXPORTER

434. -----------------------------------------------------------------

435. exporter_install: none # none|yum|binary, none by default
436. exporter_repo_url: '' # if set, repo will be added to /etc/yum.repos.d/

437. exporter_metrics_path: /metrics # default metric path for pg related exporter

438. -----------------------------------------------------------------

439. GRAFANA

440. -----------------------------------------------------------------

441. grafana_enabled: true # enable grafana? only works on meta nodes
442. grafana_endpoint: http://10.10.10.10:3000 # grafana endpoint url
443. grafana_admin_username: admin # default grafana admin username
444. grafana_admin_password: pigsty # default grafana admin password
445. grafana_database: sqlite3 # default grafana database type: sqlite3|postgres

446. grafana_pgurl: postgres://dbuser_grafana:DBUser.Grafana@meta:5436/grafana

447. grafana_plugin_method: install # none|install|always, none will skip plugin install

448. grafana_plugin_cache: /www/pigsty/plugins.tgz # path to grafana plugins cache tarball
449. grafana_plugin_list: # plugins that will be downloaded via grafana-cli
450. • marcusolsson-csv-datasource
451. • marcusolsson-json-datasource
452. • marcusolsson-treemap-panel
453. grafana_plugin_git: # plugins that will be downloaded via git
454. • https://github.com/Vonng/vonng-echarts-panel

455. -----------------------------------------------------------------

456. LOKI

457. -----------------------------------------------------------------

458. loki_enabled: true # enable loki? only works on meta nodes
459. loki_clean: false # whether remove existing loki data
460. loki_endpoint: http://10.10.10.10:3100/loki/api/v1/push # where to push data
461. loki_options: '-config.file=/etc/loki.yml -config.expand-env=true'
462. loki_data_dir: /data/loki # default loki data dir

463. loki_retention: 15d # log retention period

464. -----------------------------------------------------------------

465. DCS

466. -----------------------------------------------------------------

467. dcs_name: pigsty # consul dc name
468. dcs_servers: # dcs server dict in name:ip format
469. meta-1: 10.10.10.10 # using existing external dcs cluster is recommended for HA

470. meta-2: 10.10.10.11 # node with ip in dcs_servers will be initialized as dcs servers

471. meta-3: 10.10.10.12 # it's recommend to reuse meta nodes as dcs servers if no ad hoc cluster available

472. dcs_registry: consul # where to register services: none | consul | etcd | both
473. dcs_safeguard: false # if true, running dcs will NOT be removed

474. dcs_clean: true # if true, running dcs will be purged during node init, DANGEROUS

475. -----------------------------------------------------------------

476. CONSUL

477. -----------------------------------------------------------------

478. consul_enabled: true # enable consul server/agent by default?

479. consul_data_dir: /data/consul # consul data dir (/data/consul by default)

480. -----------------------------------------------------------------

481. ETCD

482. -----------------------------------------------------------------

483. etcd_enabled: true # enable etcd server by default?

484. etcd_data_dir: /data/etcd # etcd data dir (/data/etcd by default)

485. ================================================================

486. VARS: NODES

487. ================================================================

488. global variables for nodes (including meta)

489. -----------------------------------------------------------------

490. NODE_IDENTITY

491. -----------------------------------------------------------------

492. meta_node: false # node with meta_node flag will be marked as admin node

493. nodename: # [OPTIONAL] # node instance identity, used as ins, hostname by default

494. node_cluster: nodes # [OPTIONAL] # node cluster identity, used as cls, 'nodes' by default
495. nodename_overwrite: true # overwrite node's hostname with nodename?

496. nodename_exchange: false # exchange nodename among play hosts?

497. -----------------------------------------------------------------

498. NODE_DNS

499. -----------------------------------------------------------------

500. node_etc_hosts_default: # static dns records in /etc/hosts
501. • 10.10.10.10 meta pigsty p.pigsty g.pigsty a.pigsty c.pigsty l.pigsty
502. • 10.10.10.10 api.pigsty adm.pigsty cli.pigsty ddl.pigsty lab.pigsty git.pigsty sss.pigsty

503. node_etc_hosts: [] # extra static dns records in /etc/hosts

504. node_dns_method: add # add (default) | none (skip) | overwrite (remove old settings)

505. node_dns_servers: # dynamic nameserver in /etc/resolv.conf
506. • 10.10.10.10
507. node_dns_options: # dns resolv options
508. • options single-request-reopen timeout:1 rotate
509. • domain service.consul

510. -----------------------------------------------------------------

511. NODE_REPO

512. -----------------------------------------------------------------

513. node_repo_method: local # none|local: ad local repo|public: add upstream directly
514. node_repo_remove: true # remove existing repo on nodes?
515. node_repo_local_urls: # list local repo url, if node_repo_method = local
516. • http://pigsty/pigsty.repo

517. node_packages: [ ] # extra packages for all nodes

518. node_packages_default: # common packages for all nodes
519. • wget,sshpass,ntp,chrony,tuned,uuid,lz4,make,patch,bash,lsof,wget,unzip,git,ftp,vim-minimal,ca-certificates
520. • numactl,grubby,sysstat,dstat,iotop,bind-utils,net-tools,tcpdump,socat,ipvsadm,telnet,tuned,nc,pv,jq,perf
521. • readline,zlib,openssl,openssl-libs,openssh-clients,python3,python36-requests,node_exporter,consul,etcd,promtail
522. node_packages_meta: # extra packages for meta nodes
523. • grafana,prometheus2,alertmanager,loki,nginx_exporter,blackbox_exporter,pushgateway,redis,postgresql14
524. • nginx,ansible,pgbadger,python-psycopg2,dnsmasq,coreutils,diffutils,polysh,docker-ce,docker-compose

525. node_packages_meta_pip: jupyterlab

526. -----------------------------------------------------------------

527. NODE_TUNE

528. -----------------------------------------------------------------

529. node_disable_firewall: true # disable firewall
530. node_disable_selinux: true # disable selinux
531. node_disable_numa: false # disable numa (node reboot required)
532. node_disable_swap: false # disable swap, use with caution
533. node_static_network: true # keep dns resolver settings after reboot
534. node_disk_prefetch: false # setup disk prefetch on HDD to increase performance
535. node_kernel_modules: [ softdog, br_netfilter, ip_vs, ip_vs_rr, ip_vs_rr, ip_vs_wrr, ip_vs_sh ]
536. node_tune: tiny # install and activate tuned profile: none|oltp|olap|crit|tiny

537. node_sysctl_params: { } # set additional sysctl parameters, k:v format

538. -----------------------------------------------------------------

539. NODE_ADMIN

540. -----------------------------------------------------------------

541. node_data_dir: /data # main data directory
542. node_admin_enabled: true # create a default admin user defined by node_admin_* ?
543. node_admin_uid: 88 # uid and gid for this admin user
544. node_admin_username: dba # name of this admin user, dba by default
545. node_admin_ssh_exchange: true # exchange admin ssh key among each pgsql cluster ?
546. node_admin_pk_current: true # add current user's ~/.ssh/id_rsa.pub to admin authorized_keys ?
547. node_admin_pk_list: # ssh public keys to be added to admin user (REPLACE WITH YOURS!)
548. • 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAAgQC7IMAMNavYtWwzAJajKqwdn3ar5BhvcwCnBTxxEkXhGlCO2vfgosSAQMEflfgvkiI5nM1HIFQ8KINlx1XLO7SdL5KdInG5LIJjAFh0pujS4kNCT9a5IGvSq1BrzGqhbEcwWYdju1ZPYBcJm/MG+JD0dYCh8vfrYB/cYMD0SOmNkQ== vagrant@pigsty.com'

549. -----------------------------------------------------------------

550. NODE_TIME

551. -----------------------------------------------------------------

552. node_timezone: Asia/Hong_Kong # default node timezone, empty will not change
553. node_ntp_enabled: true # enable ntp service? false will leave ntp service untouched
554. node_ntp_service: ntp # ntp service provider: ntp|chrony
555. node_ntp_servers: # default NTP servers
556. • pool cn.pool.ntp.org iburst
557. • pool pool.ntp.org iburst
558. • pool time.pool.aliyun.com iburst
559. • server 10.10.10.10 iburst
560. • server ntp.tuna.tsinghua.edu.cn iburst
561. node_crontab_overwrite: true # true will overwrite /etc/crontab, false will append crontab

562. node_crontab: [ ] # crontab entries in /etc/crontab

563. -----------------------------------------------------------------

564. DOCKER

565. -----------------------------------------------------------------

566. docker_enabled: false # enable docker on all nodes? (you can enable them on meta nodes only)
567. docker_cgroups_driver: systemd # docker cgroup fs driver
568. docker_registry_mirrors: [] # docker registry mirror

569. docker_image_cache: /tmp/docker.tgz # docker images tarball to be loaded if exists

570. -----------------------------------------------------------------

571. NODE_EXPORTER

572. -----------------------------------------------------------------

573. node_exporter_enabled: true # setup node_exporter on instance
574. node_exporter_port: 9100 # default port for node exporter

575. node_exporter_options: '--no-collector.softnet --no-collector.nvme --collector.ntp --collector.tcpstat --collector.processes'

576. -----------------------------------------------------------------

577. PROMTAIL

578. -----------------------------------------------------------------

579. promtail_enabled: true # enable promtail logging collector?
580. promtail_clean: false # remove promtail status file? false by default
581. promtail_port: 9080 # default listen address for promtail
582. promtail_options: '-config.file=/etc/promtail.yml -config.expand-env=true'

583. promtail_positions: /var/log/positions.yaml # position status for promtail

584. ================================================================

585. VARS: PGSQL

586. ================================================================

587. -----------------------------------------------------------------

588. PG_IDENTITY

589. -----------------------------------------------------------------

590. pg_cluster: # <CLUSTER> <REQUIRED> : pgsql cluster name

591. pg_role: replica # <INSTANCE> <REQUIRED> : pg role : primary, replica, offline

592. pg_seq: 0 # <INSTANCE> <REQUIRED> : instance seq number

593. pg_instances: {} # <INSTANCE> : define multiple pg instances on node, used by monly & gpsql

594. pg_upstream: # <INSTANCE> : replication upstream ip addr

595. pg_shard: # <CLUSTER> : pgsql shard name

596. pg_sindex: 0 # <CLUSTER> : pgsql shard index

597. gp_role: master # <CLUSTER> : gpsql role, master or segment

598. pg_offline_query: false # <INSTANCE> [FLAG] set to true to enable offline query on this instance (instance level)

599. pg_backup: false # <INSTANCE> [FLAG] store base backup on this node (instance level, reserved)
600. pg_weight: 100 # <INSTANCE> [FLAG] default load balance weight (instance level)
601. pg_hostname: true # [FLAG] reuse postgres identity name as node identity?

602. pg_preflight_skip: false # [FLAG] skip preflight identity check

603. -----------------------------------------------------------------

604. PG_BUSINESS

605. -----------------------------------------------------------------

606. overwrite these variables on <CLUSTER> level

607. pg_users: [] # business users
608. pg_databases: [] # business databases
609. pg_services_extra: [] # extra services
610. pg_hba_rules_extra: [] # extra hba rules

611. pgbouncer_hba_rules_extra: [] # extra pgbouncer hba rules

612. WARNING: change these in production environment!

613. pg_admin_username: dbuser_dba
614. pg_admin_password: DBUser.DBA
615. pg_monitor_username: dbuser_monitor
616. pg_monitor_password: DBUser.Monitor
617. pg_replication_username: replicator

618. pg_replication_password: DBUser.Replicator

619. -----------------------------------------------------------------

620. PG_INSTALL

（本文超出站点单文档体积上限，已截断）