[ovirt-users] Error Adding host to cluster

Discussion:

David Johnson

2021-05-15 02:02:27 UTC

When I attempt to install a new host to my cluster from the GUI I get this
set of errors/warnings, and the install fails.

- Host has no default route
- The Host CPU does not match the Cluster CPU Tye and is running in a
degraded mode. It is missing the following CPU flags: vmx,
model_Cascadelake-Server-noTSX.

The new host has a brand new bare centos 8 installation on it. It
successfully installed from the internet.

The *new host* hardware is 48x Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz

The *pre-existing host* is 64x Intel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz

If I am reading the ansible logs correctly, ansible is failing to find the
*ovirt-hosted-engine-setup* package, which is confusing since I have a
separate physical machine for the engine (which I am using to install
from), and don't want a self hosted engine.

Any advice would be welcome.

---
Ansible logs from the most recent failed installation attempt:

2021-05-14 20:18:04,949 - runner_service.services.playbook - DEBUG -
cb_event_handler event_data={'uuid':
'fa961926-9a3a-4d9e-a6bf-d53f98645af2', 'counter': 52, 'stdout': 'fatal: [
ovirt-host-04.maxisinc.net]: FAILED! => {"changed": false, "failures": ["No
package ovirt-hosted-engine-setup available."], "msg": "Failed to install
some of the specified packages", "rc": 1, "results": []}', 'start_line':
44, 'end_line': 45, 'runner_ident': '6060ba26-b51b-11eb-ba6e-d8cb8a87894e',
'event': 'runner_on_failed', 'pid': 1742807, 'created':
'2021-05-15T01:18:04.947870', 'parent_uuid':
'd8cb8a87-894e-e341-1e1c-0000000001a1', 'event_data': {'playbook':
'ovirt-host-deploy.yml', 'playbook_uuid':
'e5595457-2c74-4525-8d98-e34bf2e0e342', 'play': 'all', 'play_uuid':
'd8cb8a87-894e-e341-1e1c-000000000007', 'play_pattern': 'all', 'task':
'Install ovirt-hosted-engine-setup package', 'task_uuid':
'd8cb8a87-894e-e341-1e1c-0000000001a1', 'task_action': 'yum', 'task_args':
'', 'task_path':
'/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-host-deploy-vdsm/tasks/packages.yml:6',
'role': 'ovirt-host-deploy-vdsm', 'host': 'ovirt-host-04.maxisinc.net',
'remote_addr': 'ovirt-host-04.maxisinc.net', 'res': {'msg': 'Failed to
install some of the specified packages', 'failures': ['No package
ovirt-hosted-engine-setup available.'], 'results': [], 'rc': 1,
'invocation': {'module_args': {'name': ['ovirt-hosted-engine-setup'],
'state': 'present', 'allow_downgrade': False, 'autoremove': False,
'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [],
'disablerepo': [], 'download_only': False, 'enable_plugin': [],
'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery':
True, 'install_weak_deps': True, 'security': False, 'skip_broken': False,
'update_cache': False, 'update_only': False, 'validate_certs': True,
'lock_timeout': 30, 'conf_file': None, 'disable_excludes': None,
'download_dir': None, 'list': None, 'releasever': None}},
'_ansible_no_log': False, 'changed': False}, 'start':
'2021-05-15T01:18:03.800468', 'end': '2021-05-15T01:18:04.947696',
'duration': 1.147228, 'ignore_errors': None, 'event_loop': None, 'uuid':
'fa961926-9a3a-4d9e-a6bf-d53f98645af2'}}

2021-05-14 20:18:04,951 - runner_service.services.playbook - DEBUG -
cb_event_handler event_data={'uuid':
'1007f755-dee8-407f-999c-b08c8b813ea7', 'counter': 53, 'stdout': '\r\nPLAY
RECAP
*********************************************************************\r\
novirt-host-04.maxisinc.net : ok=14 changed=1 unreachable=0
failed=1 skipped=2 rescued=0 ignored=0 \r\n', 'start_line': 45,
'end_line': 49, 'runner_ident': '6060ba26-b51b-11eb-ba6e-d8cb8a87894e',
'event': 'playbook_on_stats', 'pid': 1742807, 'created':
'2021-05-15T01:18:04.949918', 'parent_uuid':
'e5595457-2c74-4525-8d98-e34bf2e0e342', 'event_data': {'playbook':
'ovirt-host-deploy.yml', 'playbook_uuid':
'e5595457-2c74-4525-8d98-e34bf2e0e342', 'changed': {'
ovirt-host-04.maxisinc.net': 1}, 'dark': {}, 'failures': {'
ovirt-host-04.maxisinc.net': 1}, 'ignored': {}, 'ok': {'
ovirt-host-04.maxisinc.net': 14}, 'processed': {'ovirt-host-04.maxisinc.net':
1}, 'rescued': {}, 'skipped': {'ovirt-host-04.maxisinc.net': 2},
'artifact_data': {}, 'uuid': '1007f755-dee8-407f-999c-b08c8b813ea7'}}
2021-05-14 20:18:05,147 - runner_service.services.playbook - INFO -
Playbook ovirt-host-deploy.yml, UUID=6060ba26-b51b-11eb-ba6e-d8cb8a87894e
ended, status=failed
2021-05-14 20:18:05,154 - runner_service.services.playbook - INFO -
Playbook ovirt-host-deploy.yml Stats: {'skipped': {'
ovirt-host-04.maxisinc.net': 2}, 'ok': {'ovirt-host-04.maxisinc.net': 14},
'dark': {}, 'failures': {'ovirt-host-04.maxisinc.net': 1}, 'processed': {'
ovirt-host-04.maxisinc.net': 1}, 'changed': {'ovirt-host-04.maxisinc.net':
1}}

*David Johnson*

Patrick Lomakin

2021-05-15 05:14:04 UTC

Permalink

have you tried installing ovirt packages on the host manually?
_______________________________________________
Users mailing list -- ***@ovirt.org
To unsubscribe send an email to users-***@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/***@ovirt.org/message/MKBTMPK5Y5OXPBVOTN3FQYEBVBWGXJFR

Thomas Hoberg

2021-05-15 14:51:45 UTC

Permalink

It's better when you post distinct problems in distinct posts.

I'll answer on the CPU aspect, which may not be related to the networking topic at all.

Sounds like you're adding Haswell parts to a farm that was built on Skylakes. In order for VMs to remain mobile across hosts, oVirt needs to establish a baseline of CPU/instruction set features, that VMs will be let to see, so an application/VM launched on a machine with say AVX512 support won't all of a sudden find itself on a host that doesn't support that (please note that all the various Spectre mitigations resulted in distinct CPU subtypes depending on microcode patches being applied to hosts or not).

That's the reason it says in the documentation, that the initial setup should be done on the "oldest" machine, to ensure the proper baseline.

In case you add older hardware later, you can lower the base machine type (within some limits) by changing the CPU type in the appropriate cluster.

I do believe it requires restarting the management engine to pick up the change.

Of course, if you want to actually use those nice new instructions, you'll have to divide your hosts into distinct clusters.

With regards to the 'ovirt-hosted-engine-setup' playboook being use to add hosts, that may just be misleading naming. Rest assured it won't try to add a second management engine: that is too complicated to fit into a single playbook.
_______________________________________________
Users mailing list -- ***@ovirt.org
To unsubscribe send an email to users-***@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/***@ovirt.org

David Johnson

2021-05-16 19:09:08 UTC

Permalink

Next question ... how do I enable the vmx flag?

My google-fu is failing me here. I find a lot about how to see if its set,
but nothing about how to do it.

Thanks,

*David Johnson*

Enable VMX flag or you won't be able to run any VM on it.
Best Regards,
Strahil Nikolov
Ð ÑÑÐ±ÐŸÑÐ°, 15 ÐŒÐ°Ð¹ 2021 Ð³., 05:04:38 Ñ. ÐÑÐžÐœÑÐžÑ+3, David Johnson <
When I attempt to install a new host to my cluster from the GUI I get this
set of errors/warnings, and the install fails.
* Host has no default route
* The Host CPU does not match the Cluster CPU Tye and is running in a
degraded mode. It is missing the following CPU flags: vmx,
model_Cascadelake-Server-noTSX.
The new host has a brand new bare centos 8 installation on it. It
successfully installed from the internet.
If I am reading the ansible logs correctly, ansible is failing to find
the ovirt-hosted-engine-setup package, which is confusing since I have a
separate physical machine for the engine (which I am using to install
from), and don't want a self hosted engine.
Any advice would be welcome.
---
2021-05-14 20:18:04,949 - runner_service.services.playbook - DEBUG -
'fa961926-9a3a-4d9e-a6bf-d53f98645af2', 'counter': 52, 'stdout': 'fatal: [
["No package ovirt-hosted-engine-setup available."], "msg": "Failed to
install some of the specified packages", "rc": 1, "results": []}',
'/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-host-deploy-vdsm/tasks/packages.yml:6',
'role': 'ovirt-host-deploy-vdsm', 'host': 'ovirt-host-04.maxisinc.net',
'remote_addr': 'ovirt-host-04.maxisinc.net', 'res': {'msg': 'Failed to
install some of the specified packages', 'failures': ['No package
ovirt-hosted-engine-setup available.'], 'results': [], 'rc': 1,
'invocation': {'module_args': {'name': ['ovirt-hosted-engine-setup'],
'state': 'present', 'allow_downgrade': False, 'autoremove': False,
'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [],
'disablerepo': [], 'download_only': False, 'enable_plugin': [],
True, 'install_weak_deps': True, 'security': False, 'skip_broken': False,
'update_cache': False, 'update_only': False, 'validate_certs': True,
'lock_timeout': 30, 'conf_file': None, 'disable_excludes': None,
'download_dir': None, 'list': None, 'releasever': None}},
'2021-05-15T01:18:03.800468', 'end': '2021-05-15T01:18:04.947696',
'fa961926-9a3a-4d9e-a6bf-d53f98645af2'}}
2021-05-14 20:18:04,951 - runner_service.services.playbook - DEBUG -
'1007f755-dee8-407f-999c-b08c8b813ea7', 'counter': 53, 'stdout': '\r\nPLAY
RECAP
*********************************************************************\r\
novirt-host-04.maxisinc.net : ok=14 changed=1 unreachable=0
failed=1 skipped=2 rescued=0 ignored=0 \r\n', 'start_line': 45,
'end_line': 49, 'runner_ident': '6060ba26-b51b-11eb-ba6e-d8cb8a87894e',
'e5595457-2c74-4525-8d98-e34bf2e0e342', 'changed': {'
ovirt-host-04.maxisinc.net': 1}, 'dark': {}, 'failures': {'
ovirt-host-04.maxisinc.net': 1}, 'ignored': {}, 'ok': {'
ovirt-host-04.maxisinc.net': 14}, 'processed': {'
ovirt-host-04.maxisinc.net': 1}, 'rescued': {}, 'skipped': {'
'1007f755-dee8-407f-999c-b08c8b813ea7'}}
2021-05-14 20:18:05,147 - runner_service.services.playbook - INFO -
Playbook ovirt-host-deploy.yml, UUID=6060ba26-b51b-11eb-ba6e-d8cb8a87894e
ended, status=failed
2021-05-14 20:18:05,154 - runner_service.services.playbook - INFO -
Playbook ovirt-host-deploy.yml Stats: {'skipped': {'
14}, 'dark': {}, 'failures': {'ovirt-host-04.maxisinc.net': 1},
'processed': {'ovirt-host-04.maxisinc.net': 1}, 'changed': {'
ovirt-host-04.maxisinc.net': 1}}
David Johnson
_______________________________________________
Privacy Statement: https://www.ovirt.org/privacy-policy.html
https://www.ovirt.org/community/about/community-guidelines/

David Johnson

2021-05-16 20:07:34 UTC

Permalink

Thanks!

*David Johnson*

Intel virtualization (VT-x)
Previously codenamed "Vanderpool", VT-x represents Intel's technology for
virtualization on the x86 platform. On November 13, 2005, Intel released
two models of Pentium 4 (Model 662 and 672) as the first Intel processors
to support VT-x. The CPU flag for VT-x capability is "vmx";
So you need to enable the virtualization for your system. For details
check your hardware vendor's documentation.
Best Regards,
Strahil Nikolov
Ð ÐœÐµÐŽÐµÐ»Ñ, 16 ÐŒÐ°Ð¹ 2021 Ð³., 22:09:45 Ñ. ÐÑÐžÐœÑÐžÑ+3, David Johnson <
Next question ... how do I enable the vmx flag?
My google-fu is failing me here. I find a lot about how to see if its set,
but nothing about how to do it.
Thanks,
David Johnson

this set of errors/warnings, and the install fails.

* Host has no default route
* The Host CPU does not match the Cluster CPU Tye and is running in

a degraded mode. It is missing the following CPU flags: vmx,
model_Cascadelake-Server-noTSX.

The new host has a brand new bare centos 8 installation on it. It

successfully installed from the internet.

If I am reading the ansible logs correctly, ansible is failing to find

the ovirt-hosted-engine-setup package, which is confusing since I have a
separate physical machine for the engine (which I am using to install
from), and don't want a self hosted engine.

Any advice would be welcome.
---
2021-05-14 20:18:04,949 - runner_service.services.playbook - DEBUG -

'fa961926-9a3a-4d9e-a6bf-d53f98645af2', 'counter': 52, 'stdout': 'fatal: [
["No package ovirt-hosted-engine-setup available."], "msg": "Failed to
install some of the specified packages", "rc": 1, "results": []}',
'/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-host-deploy-vdsm/tasks/packages.yml:6',
'role': 'ovirt-host-deploy-vdsm', 'host': 'ovirt-host-04.maxisinc.net',
'remote_addr': 'ovirt-host-04.maxisinc.net', 'res': {'msg': 'Failed to
install some of the specified packages', 'failures': ['No package
ovirt-hosted-engine-setup available.'], 'results': [], 'rc': 1,
'invocation': {'module_args': {'name': ['ovirt-hosted-engine-setup'],
'state': 'present', 'allow_downgrade': False, 'autoremove': False,
'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [],
'disablerepo': [], 'download_only': False, 'enable_plugin': [],
True, 'install_weak_deps': True, 'security': False, 'skip_broken': False,
'update_cache': False, 'update_only': False, 'validate_certs': True,
'lock_timeout': 30, 'conf_file': None, 'disable_excludes': None,
'download_dir': None, 'list': None, 'releasever': None}},
'2021-05-15T01:18:03.800468', 'end': '2021-05-15T01:18:04.947696',
'fa961926-9a3a-4d9e-a6bf-d53f98645af2'}}

2021-05-14 20:18:04,951 - runner_service.services.playbook - DEBUG -

'1007f755-dee8-407f-999c-b08c8b813ea7', 'counter': 53, 'stdout': '\r\nPLAY
RECAP
*********************************************************************\r\
novirt-host-04.maxisinc.net : ok=14 changed=1 unreachable=0
failed=1 skipped=2 rescued=0 ignored=0 \r\n', 'start_line': 45,
'end_line': 49, 'runner_ident': '6060ba26-b51b-11eb-ba6e-d8cb8a87894e',
'e5595457-2c74-4525-8d98-e34bf2e0e342', 'changed': {'
ovirt-host-04.maxisinc.net': 1}, 'dark': {}, 'failures': {'
ovirt-host-04.maxisinc.net': 1}, 'ignored': {}, 'ok': {'
ovirt-host-04.maxisinc.net': 14}, 'processed': {'
ovirt-host-04.maxisinc.net': 1}, 'rescued': {}, 'skipped': {'
'1007f755-dee8-407f-999c-b08c8b813ea7'}}

2021-05-14 20:18:05,147 - runner_service.services.playbook - INFO -

Playbook ovirt-host-deploy.yml, UUID=6060ba26-b51b-11eb-ba6e-d8cb8a87894e
ended, status=failed

2021-05-14 20:18:05,154 - runner_service.services.playbook - INFO -

Playbook ovirt-host-deploy.yml Stats: {'skipped': {'
14}, 'dark': {}, 'failures': {'ovirt-host-04.maxisinc.net': 1},
'processed': {'ovirt-host-04.maxisinc.net': 1}, 'changed': {'
ovirt-host-04.maxisinc.net': 1}}

David Johnson
_______________________________________________
Privacy Statement: https://www.ovirt.org/privacy-policy.html

https://www.ovirt.org/community/about/community-guidelines/

David Johnson

2021-05-20 02:22:02 UTC

Permalink

Update:

It's been a few days, but I did (finally) enable the virtualization in the
BIOS.

Unfortunately, I have the exact same symptom.

My Ovirt version is Version 4.4.4.7-1.el8

lscpu shows the vmx, vnmi, and tpr_shadow flags are set.

I did find this tidbit:
https://www.mail-archive.com/***@ovirt.org/msg64312.html

The Xeon E5-2680 v3 appears to be a "Sandy Bridge-EP" based processor, so
I'm not really clear about why ovirt is looking for the
model_Cascadelake-Server-noTSX flag

The <model usable="yes"/> elements displayed by virsh domcapabilities show
SandyBridge-IBRS and SandyBridge, but not SandyBridge-EP.

I did see references to KVM specific bios enablements, but nothing usable
for identifying them in the BIOS settings.

Any ideas would be appreciated

Thanks again in advance

*David Johnson*

Post by David Johnson
Thanks!
*David Johnson*

Intel virtualization (VT-x)
Previously codenamed "Vanderpool", VT-x represents Intel's technology for
virtualization on the x86 platform. On November 13, 2005, Intel released
two models of Pentium 4 (Model 662 and 672) as the first Intel processors
to support VT-x. The CPU flag for VT-x capability is "vmx";
So you need to enable the virtualization for your system. For details
check your hardware vendor's documentation.
Best Regards,
Strahil Nikolov
Ð ÐœÐµÐŽÐµÐ»Ñ, 16 ÐŒÐ°Ð¹ 2021 Ð³., 22:09:45 Ñ. ÐÑÐžÐœÑÐžÑ+3, David Johnson <
Next question ... how do I enable the vmx flag?
My google-fu is failing me here. I find a lot about how to see if its
set, but nothing about how to do it.
Thanks,
David Johnson