云端虚拟机置备

如何使用Terraform迅速在阿里云创建Pigsty部署所需的虚拟机资源

如果您手头没有 x86_64 架构的PC、笔记本、Mac,使用即用即毁的云虚拟机可能是另一个不错的选择。

Terraform

Terraform 是开源免费的 基础设施即代码 工具。您只需要声明好所需的云虚拟机、网络与安全组配置等,一键即可拉起对应的资源。

在MacOS下安装Terraform,只需要执行brew install terraform即可。然后您需要有云厂商账号,并获取AccessKey与AccessSecret凭证,充点钱,就可以开始云端沙箱部署之旅啦。

TF配置文件

项目根目录 terraform/ 中提供了若干云厂商的 Terraform 资源定义文件,您可以使用这些模板快速在云上申请虚拟机资源用于部署Pigsty。这里以阿里云为例:

1. cd terraform        # 进入terraform目录中
2. vi alicloud.tf      # 编辑配置文件,填入您的阿里云AccessKey与SecretKey

阿里云样例Terraform文件

1. provider "alicloud" {
2. access_key = "xxxxxx"
3. secret_key = "xxxxxx"
4. region = "cn-beijing"
5. }

7. # use 10.10.10.0/24 cidr block as demo network
8. resource "alicloud_vpc" "vpc" {
9. vpc_name   = "pigsty-demo-network"
10. cidr_block = "10.10.10.0/24"
11. }

13. # add virtual switch for pigsty demo network
14. resource "alicloud_vswitch" "vsw" {
15. vpc_id     = "${alicloud_vpc.vpc.id}"
16. cidr_block = "10.10.10.0/24"
17. zone_id    = "cn-beijing-k"
18. }

20. # add default security group and allow all tcp traffic
21. resource "alicloud_security_group" "default" {
22. name   = "default"
23. vpc_id = "${alicloud_vpc.vpc.id}"
24. }
25. resource "alicloud_security_group_rule" "allow_all_tcp" {
26. ip_protocol       = "tcp"
27. type              = "ingress"
28. nic_type          = "intranet"
29. policy            = "accept"
30. port_range        = "1/65535"
31. priority          = 1
32. security_group_id = "${alicloud_security_group.default.id}"
33. cidr_ip           = "0.0.0.0/0"
34. }

36. # https://registry.terraform.io/providers/aliyun/alicloud/latest/docs/resources/instance
37. resource "alicloud_instance" "pg-meta-1" {
38. instance_name              = "pg-meta-1"
39. host_name                  = "pg-meta-1"
40. instance_type              = "ecs.s6-c1m2.small"
41. vswitch_id                 = "${alicloud_vswitch.vsw.id}"
42. security_groups            = ["${alicloud_security_group.default.id}"]
43. image_id                   = "centos_7_8_x64_20G_alibase_20200914.vhd"
44. password                   = "PigstyDemo4"
45. private_ip                 = "10.10.10.10"
46. internet_max_bandwidth_out = 40 # 40Mbps , alloc a public IP
47. }

49. resource "alicloud_instance" "pg-test-1" {
50. instance_name   = "pg-test-1"
51. host_name       = "pg-test-1"
52. instance_type   = "ecs.s6-c1m1.small"
53. vswitch_id      = "${alicloud_vswitch.vsw.id}"
54. security_groups = ["${alicloud_security_group.default.id}"]
55. image_id        = "centos_7_8_x64_20G_alibase_20200914.vhd"
56. password        = "PigstyDemo4"
57. private_ip      = "10.10.10.11"
58. }

60. resource "alicloud_instance" "pg-test-2" {
61. instance_name   = "pg-test-2"
62. host_name       = "pg-test-2"
63. instance_type   = "ecs.s6-c1m1.small"
64. vswitch_id      = "${alicloud_vswitch.vsw.id}"
65. security_groups = ["${alicloud_security_group.default.id}"]
66. image_id        = "centos_7_8_x64_20G_alibase_20200914.vhd"
67. password        = "PigstyDemo4"
68. private_ip      = "10.10.10.12"
69. }

71. resource "alicloud_instance" "pg-test-3" {
72. instance_name   = "pg-test-3"
73. host_name       = "pg-test-3"
74. instance_type   = "ecs.s6-c1m1.small"
75. vswitch_id      = "${alicloud_vswitch.vsw.id}"
76. security_groups = ["${alicloud_security_group.default.id}"]
77. image_id        = "centos_7_8_x64_20G_alibase_20200914.vhd"
78. password        = "PigstyDemo4"
79. private_ip      = "10.10.10.13"
80. }

83. output "meta_ip" {
84. value = "${alicloud_instance.pg-meta-1.public_ip}"
85. }

执行计划

首先,使用terraform命令,创建上面定义的云资源(共享1C1G临时用用很便宜,按需付费)

1. terraform init      # 安装 terraform provider: aliyun (仅第一次需要)
2. terraform apply     # 生成执行计划:创建虚拟机,虚拟网段/交换机/安全组

执行 apply 并输入 yes后,terraform会调用阿里云API创建对应的虚拟机资源。

Terraform Apply执行结果

1. Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols:
2. + create

4. Terraform will perform the following actions:

6. # alicloud_instance.pg-meta-1 will be created
7. + resource "alicloud_instance" "pg-meta-1" {
8. + availability_zone                  = (known after apply)
9. + credit_specification               = (known after apply)
10. + deletion_protection                = false
11. + dry_run                            = false
12. + host_name                          = "pg-meta-1"
13. + id                                 = (known after apply)
14. + image_id                           = "centos_7_8_x64_20G_alibase_20200914.vhd"
15. + instance_charge_type               = "PostPaid"
16. + instance_name                      = "pg-meta-1"
17. + instance_type                      = "ecs.s6-c1m2.small"
18. + internet_charge_type               = "PayByTraffic"
19. + internet_max_bandwidth_in          = (known after apply)
20. + internet_max_bandwidth_out         = 40
21. + key_name                           = (known after apply)
22. + password                           = (sensitive value)
23. + private_ip                         = "10.10.10.10"
24. + public_ip                          = (known after apply)
25. + role_name                          = (known after apply)
26. + secondary_private_ip_address_count = (known after apply)
27. + secondary_private_ips              = (known after apply)
28. + security_groups                    = (known after apply)
29. + spot_strategy                      = "NoSpot"
30. + status                             = "Running"
31. + subnet_id                          = (known after apply)
32. + system_disk_category               = "cloud_efficiency"
33. + system_disk_performance_level      = (known after apply)
34. + system_disk_size                   = 40
35. + volume_tags                        = (known after apply)
36. + vswitch_id                         = (known after apply)
37. }

39. # alicloud_instance.pg-test-1 will be created
40. + resource "alicloud_instance" "pg-test-1" {
41. + availability_zone                  = (known after apply)
42. + credit_specification               = (known after apply)
43. + deletion_protection                = false
44. + dry_run                            = false
45. + host_name                          = "pg-test-1"
46. + id                                 = (known after apply)
47. + image_id                           = "centos_7_8_x64_20G_alibase_20200914.vhd"
48. + instance_charge_type               = "PostPaid"
49. + instance_name                      = "pg-test-1"
50. + instance_type                      = "ecs.s6-c1m1.small"
51. + internet_max_bandwidth_in          = (known after apply)
52. + internet_max_bandwidth_out         = 0
53. + key_name                           = (known after apply)
54. + password                           = (sensitive value)
55. + private_ip                         = "10.10.10.11"
56. + public_ip                          = (known after apply)
57. + role_name                          = (known after apply)
58. + secondary_private_ip_address_count = (known after apply)
59. + secondary_private_ips              = (known after apply)
60. + security_groups                    = (known after apply)
61. + spot_strategy                      = "NoSpot"
62. + status                             = "Running"
63. + subnet_id                          = (known after apply)
64. + system_disk_category               = "cloud_efficiency"
65. + system_disk_performance_level      = (known after apply)
66. + system_disk_size                   = 40
67. + volume_tags                        = (known after apply)
68. + vswitch_id                         = (known after apply)
69. }

71. # alicloud_instance.pg-test-2 will be created
72. + resource "alicloud_instance" "pg-test-2" {
73. + availability_zone                  = (known after apply)
74. + credit_specification               = (known after apply)
75. + deletion_protection                = false
76. + dry_run                            = false
77. + host_name                          = "pg-test-2"
78. + id                                 = (known after apply)
79. + image_id                           = "centos_7_8_x64_20G_alibase_20200914.vhd"
80. + instance_charge_type               = "PostPaid"
81. + instance_name                      = "pg-test-2"
82. + instance_type                      = "ecs.s6-c1m1.small"
83. + internet_max_bandwidth_in          = (known after apply)
84. + internet_max_bandwidth_out         = 0
85. + key_name                           = (known after apply)
86. + password                           = (sensitive value)
87. + private_ip                         = "10.10.10.12"
88. + public_ip                          = (known after apply)
89. + role_name                          = (known after apply)
90. + secondary_private_ip_address_count = (known after apply)
91. + secondary_private_ips              = (known after apply)
92. + security_groups                    = (known after apply)
93. + spot_strategy                      = "NoSpot"
94. + status                             = "Running"
95. + subnet_id                          = (known after apply)
96. + system_disk_category               = "cloud_efficiency"
97. + system_disk_performance_level      = (known after apply)
98. + system_disk_size                   = 40
99. + volume_tags                        = (known after apply)
100. + vswitch_id                         = (known after apply)
101. }

103. # alicloud_instance.pg-test-3 will be created
104. + resource "alicloud_instance" "pg-test-3" {
105. + availability_zone                  = (known after apply)
106. + credit_specification               = (known after apply)
107. + deletion_protection                = false
108. + dry_run                            = false
109. + host_name                          = "pg-test-3"
110. + id                                 = (known after apply)
111. + image_id                           = "centos_7_8_x64_20G_alibase_20200914.vhd"
112. + instance_charge_type               = "PostPaid"
113. + instance_name                      = "pg-test-3"
114. + instance_type                      = "ecs.s6-c1m1.small"
115. + internet_max_bandwidth_in          = (known after apply)
116. + internet_max_bandwidth_out         = 0
117. + key_name                           = (known after apply)
118. + password                           = (sensitive value)
119. + private_ip                         = "10.10.10.13"
120. + public_ip                          = (known after apply)
121. + role_name                          = (known after apply)
122. + secondary_private_ip_address_count = (known after apply)
123. + secondary_private_ips              = (known after apply)
124. + security_groups                    = (known after apply)
125. + spot_strategy                      = "NoSpot"
126. + status                             = "Running"
127. + subnet_id                          = (known after apply)
128. + system_disk_category               = "cloud_efficiency"
129. + system_disk_performance_level      = (known after apply)
130. + system_disk_size                   = 40
131. + volume_tags                        = (known after apply)
132. + vswitch_id                         = (known after apply)
133. }

135. # alicloud_security_group.default will be created
136. + resource "alicloud_security_group" "default" {
137. + id                  = (known after apply)
138. + inner_access        = (known after apply)
139. + inner_access_policy = (known after apply)
140. + name                = "default"
141. + security_group_type = "normal"
142. + vpc_id              = (known after apply)
143. }

145. # alicloud_security_group_rule.allow_all_tcp will be created
146. + resource "alicloud_security_group_rule" "allow_all_tcp" {
147. + cidr_ip           = "0.0.0.0/0"
148. + id                = (known after apply)
149. + ip_protocol       = "tcp"
150. + nic_type          = "intranet"
151. + policy            = "accept"
152. + port_range        = "1/65535"
153. + priority          = 1
154. + security_group_id = (known after apply)
155. + type              = "ingress"
156. }

158. # alicloud_vpc.vpc will be created
159. + resource "alicloud_vpc" "vpc" {
160. + cidr_block        = "10.10.10.0/24"
161. + id                = (known after apply)
162. + ipv6_cidr_block   = (known after apply)
163. + name              = (known after apply)
164. + resource_group_id = (known after apply)
165. + route_table_id    = (known after apply)
166. + router_id         = (known after apply)
167. + router_table_id   = (known after apply)
168. + status            = (known after apply)
169. + vpc_name          = "pigsty-demo-network"
170. }

172. # alicloud_vswitch.vsw will be created
173. + resource "alicloud_vswitch" "vsw" {
174. + availability_zone = (known after apply)
175. + cidr_block        = "10.10.10.0/24"
176. + id                = (known after apply)
177. + name              = (known after apply)
178. + status            = (known after apply)
179. + vpc_id            = (known after apply)
180. + vswitch_name      = (known after apply)
181. + zone_id           = "cn-beijing-k"
182. }

184. Plan: 8 to add, 0 to change, 0 to destroy.

186. Changes to Outputs:
187. + meta_ip = (known after apply)

189. Do you want to perform these actions?
190. Terraform will perform the actions described above.
191. Only 'yes' will be accepted to approve.

193. Enter a value: yes

195. alicloud_vpc.vpc: Creating...
196. alicloud_vpc.vpc: Creation complete after 6s [id=vpc-2zed78z7n5z06o1dmydhj]
197. alicloud_security_group.default: Creating...
198. alicloud_vswitch.vsw: Creating...
199. alicloud_security_group.default: Creation complete after 1s [id=sg-2ze7x7zu8tcdsefroofa]
200. alicloud_security_group_rule.allow_all_tcp: Creating...
201. alicloud_security_group_rule.allow_all_tcp: Creation complete after 0s [id=sg-2ze7x7zu8tcdsefroofa:ingress:tcp:1/65535:intranet:0.0.0.0/0:accept:1]
202. alicloud_vswitch.vsw: Creation complete after 6s [id=vsw-2zejctjdr16ryz194jxz4]
203. alicloud_instance.pg-test-3: Creating...
204. alicloud_instance.pg-test-2: Creating...
205. alicloud_instance.pg-test-1: Creating...
206. alicloud_instance.pg-meta-1: Creating...
207. alicloud_instance.pg-test-3: Still creating... [10s elapsed]
208. alicloud_instance.pg-test-2: Still creating... [10s elapsed]
209. alicloud_instance.pg-test-1: Still creating... [10s elapsed]
210. alicloud_instance.pg-meta-1: Still creating... [10s elapsed]
211. alicloud_instance.pg-meta-1: Creation complete after 16s [id=i-2zef4frw6kezb47339wr]
212. alicloud_instance.pg-test-1: Still creating... [20s elapsed]
213. alicloud_instance.pg-test-2: Still creating... [20s elapsed]
214. alicloud_instance.pg-test-3: Still creating... [20s elapsed]
215. alicloud_instance.pg-test-2: Creation complete after 23s [id=i-2zefzvz0fyl7mloc4v30]
216. alicloud_instance.pg-test-1: Still creating... [30s elapsed]
217. alicloud_instance.pg-test-3: Still creating... [30s elapsed]
218. alicloud_instance.pg-test-3: Creation complete after 33s [id=i-2zeeyodo2pc8b1k2d167]
219. alicloud_instance.pg-test-1: Creation complete after 33s [id=i-2zef4frw6kezb47339ws]

SSH配置与微调

其中,管理机将分配一个按量付费的公网IP,您也可以使用命令terraform output将其打印出来。

1. # 打印公网IP与root密码
2. ssh_pass='PigstyDemo4'
3. public_ip=$(terraform output | grep -Eo '[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}')
4. echo "meta node: root:${ssh_pass}@${public_ip}"

接下来,我们先来配置本地登录云端管理机器的SSH配置(默认用户root,密码PigstyDemo4)

1. # 创建 ~/.ssh/pigsty_terraform 文件,包含云端管理机器的SSH定义(可选,好用一点)
2. cat > ~/.ssh/pigsty_terraform <<-EOF
3. Host demo
4. User root
5. HostName ${public_ip}
6. UserKnownHostsFile /dev/null
7. StrictHostKeyChecking no
8. PasswordAuthentication yes
9. EOF
10. chmod 0600 ~/.ssh/pigsty_terraform

12. # 启用该配置
13. if ! grep --quiet "Include ~/.ssh/pigsty_terraform" ~/.ssh/config ; then
14. (echo 'Include ~/.ssh/pigsty_terraform' && cat ~/.ssh/config) >  ~/.ssh/config.tmp;
15. mv ~/.ssh/config.tmp ~/.ssh/config && chmod 0600 ~/.ssh/config;
16. fi

然后,您可以通过SSH别名demo访问该云端管理机了。

1. # 添加本地到元节点的免密访问
2. sshpass -p ${ssh_pass} ssh-copy-id demo

然后,您就可以免密从本地访问该节点了,如果只需要进行单节点安装,这样就行了。接下来,在该元节点上完成标准安装

特殊注意事项

阿里云虚拟机CentOS 7.8镜像中运行有 nscd ,锁死了 glibc 版本,会导致安装时出现RPM依赖错误。

在所有机器上执行 yum remove -y nscd 即可解决此问题。

完成上述准备工作后,所有机器准备工作已经就绪,可以开始常规的 Pigsty下载配置安装三部曲啦。

最后修改 2022-05-27: init commit (1e3e284)