Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Existing VMs are forced to recreate when adding new VMs #18068

Closed
wjun opened this issue May 16, 2018 · 3 comments
Closed

Existing VMs are forced to recreate when adding new VMs #18068

wjun opened this issue May 16, 2018 · 3 comments

Comments

@wjun
Copy link

wjun commented May 16, 2018

Hello,

Our infrastructure is based on terraform 0.11.2. Recently, one deployment always recreates existing VMs as plan shows(we add 2 new VMs, but the existing 2 VMs of k8s-worker[0]/[1] are also recreated) below:

Terraform will perform the following actions:
-/+ openstack_compute_instance_v2.k8s-worker[0] (new resource required)
id: "acc7f1c7-29a7-4722-9705-060805b538fe" => (forces new resource)
access_ip_v4: "192.168.0.7" =>
access_ip_v6: "" =>
all_metadata.%: "0" =>
availability_zone: "nova" =>
config_drive: "true" => "true"
flavor_id: "6" => "6"
flavor_name: "k8s.large" =>
force_delete: "false" => "false"
image_id: "1396809b-3ef2-49a4-88eb-0790016fc715" => "1396809b-3ef2-49a4-88eb-0790016fc715"
image_name: "ubuntu-cloud-ready" =>
key_pair: "k8s-9f44238f-e4d1-40ca-b44c-29fe1867d911" => "k8s-9f44238f-e4d1-40ca-b44c-29fe1867d911"
name: "k8s-worker-0-9f44238f-e4d1-40ca-b" => "k8s-worker-0-9f44238f-e4d1-40ca-b"
network.#: "3" => "3"
network.0.access_network: "false" => "false"
network.0.fixed_ip_v4: "192.168.0.7" =>
network.0.fixed_ip_v6: "" =>
network.0.floating_ip: "" =>
network.0.mac: "fa:16:3e:f1:58:66" =>
network.0.name: "k8s-net" =>
network.0.port: "" =>
network.0.uuid: "e511bea4-2283-4830-8b35-f92b1f89255c" => "e511bea4-2283-4830-8b35-f92b1f89255c"
network.1.access_network: "false" => "false"
network.1.fixed_ip_v4: "10.236.4.6" =>
network.1.fixed_ip_v6: "" =>
network.1.floating_ip: "" =>
network.1.mac: "fa:16:3e:01:3a:80" =>
network.1.name: "k8s-api-net-9f44238f-e4d1-40ca-b44c-29fe1867d911" =>
network.1.port: "" =>
network.1.uuid: "5bffd126-2316-4a35-af17-e5c1725e4b11" => "5bffd126-2316-4a35-af17-e5c1725e4b11"
network.2.access_network: "false" => "false"
network.2.fixed_ip_v4: "169.254.252.7" =>
network.2.fixed_ip_v6: "" =>
network.2.floating_ip: "" =>
network.2.mac: "fa:16:3e:39:31:96" =>
network.2.name: "k8s-pod-net-9f44238f-e4d1-40ca-b44c-29fe1867d911" =>
network.2.port: "d74df8ab-7bb5-4e65-8278-9e1cf6a85675" => "${element(openstack_networking_port_v2.ncp_worker_port..id, count.index)}" (forces new resource)
network.2.uuid: "89a9cdcb-4561-4e50-ba63-d17e669fb883" =>
region: "nova" =>
security_groups.#: "1" => "1"
security_groups.2739350681: "k8s-group" => "k8s-group"
stop_before_destroy: "false" => "false"
user_data: "cd54ca6f39b02baf6cae2cd8b1300b564d0d433f" => "cd54ca6f39b02baf6cae2cd8b1300b564d0d433f"
-/+ openstack_compute_instance_v2.k8s-worker[1] (new resource required)
id: "96b866a7-f17b-4fef-b316-b6ff523ac153" => (forces new resource)
access_ip_v4: "192.168.0.14" =>
access_ip_v6: "" =>
all_metadata.%: "0" =>
availability_zone: "nova" =>
config_drive: "true" => "true"
flavor_id: "6" => "6"
flavor_name: "k8s.large" =>
force_delete: "false" => "false"
image_id: "1396809b-3ef2-49a4-88eb-0790016fc715" => "1396809b-3ef2-49a4-88eb-0790016fc715"
image_name: "ubuntu-cloud-ready" =>
key_pair: "k8s-9f44238f-e4d1-40ca-b44c-29fe1867d911" => "k8s-9f44238f-e4d1-40ca-b44c-29fe1867d911"
name: "k8s-worker-1-9f44238f-e4d1-40ca-b" => "k8s-worker-1-9f44238f-e4d1-40ca-b"
network.#: "3" => "3"
network.0.access_network: "false" => "false"
network.0.fixed_ip_v4: "192.168.0.14" =>
network.0.fixed_ip_v6: "" =>
network.0.floating_ip: "" =>
network.0.mac: "fa:16:3e:7d:19:5b" =>
network.0.name: "k8s-net" =>
network.0.port: "" =>
network.0.uuid: "e511bea4-2283-4830-8b35-f92b1f89255c" => "e511bea4-2283-4830-8b35-f92b1f89255c"
network.1.access_network: "false" => "false"
network.1.fixed_ip_v4: "10.236.4.3" =>
network.1.fixed_ip_v6: "" =>
network.1.floating_ip: "" =>
network.1.mac: "fa:16:3e:10:49:c8" =>
network.1.name: "k8s-api-net-9f44238f-e4d1-40ca-b44c-29fe1867d911" =>
network.1.port: "" =>
network.1.uuid: "5bffd126-2316-4a35-af17-e5c1725e4b11" => "5bffd126-2316-4a35-af17-e5c1725e4b11"
network.2.access_network: "false" => "false"
network.2.fixed_ip_v4: "169.254.252.4" =>
network.2.fixed_ip_v6: "" =>
network.2.floating_ip: "" =>
network.2.mac: "fa:16:3e:de:a0:4c" =>
network.2.name: "k8s-pod-net-9f44238f-e4d1-40ca-b44c-29fe1867d911" =>
network.2.port: "b97ee652-a267-4338-90fd-cf75fdba7274" => "${element(openstack_networking_port_v2.ncp_worker_port..id, count.index)}" (forces new resource)
network.2.uuid: "89a9cdcb-4561-4e50-ba63-d17e669fb883" =>
region: "nova" =>
security_groups.#: "1" => "1"
security_groups.2739350681: "k8s-group" => "k8s-group"
stop_before_destroy: "false" => "false"
user_data: "cd54ca6f39b02baf6cae2cd8b1300b564d0d433f" => "cd54ca6f39b02baf6cae2cd8b1300b564d0d433f"

  • openstack_compute_instance_v2.k8s-worker[2]
    id:
    access_ip_v4:
    access_ip_v6:
    all_metadata.%:
    availability_zone:
    config_drive: "true"
    flavor_id: "6"
    flavor_name:
    force_delete: "false"
    image_id: "1396809b-3ef2-49a4-88eb-0790016fc715"
    image_name:
    key_pair: "k8s-9f44238f-e4d1-40ca-b44c-29fe1867d911"
    name: "k8s-worker-2-9f44238f-e4d1-40ca-b"
    network.#: "3"
    network.0.access_network: "false"
    network.0.fixed_ip_v4:
    network.0.fixed_ip_v6:
    network.0.floating_ip:
    network.0.mac:
    network.0.name:
    network.0.port:
    network.0.uuid: "e511bea4-2283-4830-8b35-f92b1f89255c"
    network.1.access_network: "false"
    network.1.fixed_ip_v4:
    network.1.fixed_ip_v6:
    network.1.floating_ip:
    network.1.mac:
    network.1.name:
    network.1.port:
    network.1.uuid: "5bffd126-2316-4a35-af17-e5c1725e4b11"
    network.2.access_network: "false"
    network.2.fixed_ip_v4:
    network.2.fixed_ip_v6:
    network.2.floating_ip:
    network.2.mac:
    network.2.name:
    network.2.port: "${element(openstack_networking_port_v2.ncp_worker_port.*.id, count.index)}"
    network.2.uuid:
    region:
    security_groups.#: "1"
    security_groups.2739350681: "k8s-group"
    stop_before_destroy: "false"
    user_data: "cd54ca6f39b02baf6cae2cd8b1300b564d0d433f"
  • openstack_compute_instance_v2.k8s-worker[3]
    id:
    access_ip_v4:
    access_ip_v6:
    all_metadata.%:
    availability_zone:
    config_drive: "true"
    flavor_id: "6"
    flavor_name:
    force_delete: "false"
    image_id: "1396809b-3ef2-49a4-88eb-0790016fc715"
    image_name:
    key_pair: "k8s-9f44238f-e4d1-40ca-b44c-29fe1867d911"
    name: "k8s-worker-3-9f44238f-e4d1-40ca-b"
    network.#: "3"
    network.0.access_network: "false"
    network.0.fixed_ip_v4:
    network.0.fixed_ip_v6:
    network.0.floating_ip:
    network.0.mac:
    network.0.name:
    network.0.port:
    network.0.uuid: "e511bea4-2283-4830-8b35-f92b1f89255c"
    network.1.access_network: "false"
    network.1.fixed_ip_v4:
    network.1.fixed_ip_v6:
    network.1.floating_ip:
    network.1.mac:
    network.1.name:
    network.1.port:
    network.1.uuid: "5bffd126-2316-4a35-af17-e5c1725e4b11"
    network.2.access_network: "false"
    network.2.fixed_ip_v4:
    network.2.fixed_ip_v6:
    network.2.floating_ip:
    network.2.mac:
    network.2.name:
    network.2.port: "${element(openstack_networking_port_v2.ncp_worker_port.*.id, count.index)}"
    network.2.uuid:
    region:
    security_groups.#: "1"
    security_groups.2739350681: "k8s-group"
    stop_before_destroy: "false"
    user_data: "cd54ca6f39b02baf6cae2cd8b1300b564d0d433f"
  • openstack_networking_port_v2.ncp_worker_port[2]
    id:
    admin_state_up: "true"
    all_fixed_ips.#:
    all_security_group_ids.#:
    device_id:
    device_owner:
    mac_address:
    name: "k8s-worker-ncp-port-2-9f44238f-e4d1-40ca-b44c-29fe1867d911"
    network_id: "89a9cdcb-4561-4e50-ba63-d17e669fb883"
    region:
    tenant_id:
    value_specs.%: "1"
    value_specs.port_security_enabled: "false"
  • openstack_networking_port_v2.ncp_worker_port[3]
    id:
    admin_state_up: "true"
    all_fixed_ips.#:
    all_security_group_ids.#:
    device_id:
    device_owner:
    mac_address:
    name: "k8s-worker-ncp-port-3-9f44238f-e4d1-40ca-b44c-29fe1867d911"
    network_id: "89a9cdcb-4561-4e50-ba63-d17e669fb883"
    region:
    tenant_id:
    value_specs.%: "1"
    value_specs.port_security_enabled: "false"
    Plan: 6 to add, 0 to change, 2 to destroy.

Is this a bug? If so, is there any workaround to block recreating VMs here? Thanks.
@wjun
Copy link
Author

wjun commented May 17, 2018

It looks we met the same pitfall of using element() in VM resource creation as #3449, after following the change at jpsecher/ds-gluster@6656ad0
The issue is solved.

@wjun wjun closed this as completed May 17, 2018
@wjun
Copy link
Author

wjun commented May 17, 2018

It looks we met the same pitfall of using element() in VM resource creation as #3449, after following the change at jpsecher/ds-gluster@6656ad0
The issue is solved.

@ghost
Copy link

ghost commented Apr 3, 2020

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@ghost ghost locked and limited conversation to collaborators Apr 3, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@wjun