|
|
Subscribe / Log in / New account

Virtual data center management with oVirt 3.4

This article brought to you by LWN subscribers

Subscribers to LWN.net made this article — and everything that surrounds it — possible. If you appreciate our content, please buy a subscription and make the next set of articles possible.

May 29, 2014

This article was contributed by Brian Proffitt

In the world of virtualization, there's little doubt that cloud computing gets the lion's share of attention. Made popular by public services offered by Amazon and the OpenStack cloud platform, cloud computing remains an attractive option for many IT managers looking to consolidate their physical hardware and get their applications deployed as efficiently as possible.

But cloud may not always be the best answer. IT departments can tap into the benefits of virtualization without undergoing the sometimes-painful migration to cloud computing. Another answer lies in the realm of technology known as virtual data center management.

The short way of describing virtual data center management is "cloud computing without the elasticity." This may seem overly simplified, until you realize that all cloud computing is—and has ever been—a tool set to manage the deployment and maintenance of virtual machines. What makes cloud "cloud" are the additional features that enable developers and system administrators to spin up additional virtual machines in an automated way, usually based on demands from the applications themselves. This is the baseline description of elasticity, and elasticity is the secret sauce of cloud.

There are lots of instances of IT shops migrating their systems to public or private cloud platforms and proudly reporting that they are "in the cloud." If the applications and services that are running on these cloud systems are indeed taking full advantage of the automation and elasticity cloud affords, then they are accurate in their self-descriptions. But if they are not using elasticity, then essentially what they have created is a virtual data center.

This leads to the first big questions that should be answered: why go to the bother of setting up and deploying a cloud platform when you aren't going to use it properly? Why not use a virtual data center platform that has everything you need and is much easier to install and configure?

The virtual data center landscape

In the open-source arena, there are several tools that fit this description: XenServer, a CentOS-based distribution that uses XAPI as the core technology to manage virtual machines; Ganeti, Google's cluster-management platform that's designed to handle both KVM and Xen virtual machines; and Proxmox Virtual Environment, a Debian-based distro that's dedicated to KVM virtual machine and container management.

There are also proprietary systems out there: the ones that comes up the most are VMware vSphere and virtual machine management with Microsoft's HyperV. They are decent tools, but you will be paying quite a bit to keep your licenses for those platforms going.

Then there is oVirt, the virtual data center management platform that is the upstream for the Red Hat Enterprise Virtualization (RHEV) product and Wind River Open Virtualization.

oVirt is the very definition of a virtual data center management platform, enabling users to manage their virtual machines by coordinating those machines at whatever level they choose. Whole data centers of virtual machines can be managed, as well as clusters, virtual networks, physical hosts, and virtual machines ... right down to the individual disks being used. Management can be done either through the administrator web portal, or via the command-line interface, REST API, or the oVirt software development kit.

With all of these features, it is surprising to many in the oVirt community that it isn't more widely discussed. The user base is strong (since those who use oVirt typically are very loyal), but not as broad as one would think. But oVirt has started to gain much more attention in recent months, which is a nice change from its closed-source origins when it was a virtual unknown in the data center ecosystem.

The secret origin of oVirt

Seven years ago, oVirt started as a humble little virtual machine manager written in Python by developers at the Israeli firm Qumranet. This was the component that would eventually become oVirt Node, a minimal hypervisor host that can still be run independently from the rest of the oVirt platform today.

The rest of the oVirt components, however, were created with the purpose of developing a virtual data center platform that would run on Windows—not Linux. The oVirt Engine, which acts as the control center for the oVirt environment, was originally written in C# as a .NET application. Two years later, when Red Hat acquired Qumranet in late 2008, this was exactly the technology Red Hat gained: a fairly mature virtual data center management platform that happened to be proprietary and would initially only run on Windows.

This was not exactly an intuitive move by the world's biggest Linux company. But Red Hat did not let that situation linger. Even when it released RHEV 2.2 in 2010, the RHEV-Manager (the commercial counterpart to oVirt Engine) was a C# application that only worked on Windows, and the console was an ActiveX browser extension. From the end of 2008 to the end of 2011, oVirt never saw a lot of traction, from either developers or users.

That's because, even as there was an RHEV 2.x product on the market, there never was an "oVirt 2"—there was only the RHEV 2.0 series that was for a while proprietary. Until 2011, oVirt would essentially disappear, entering a chrysalis where it would ultimately metamorphose from a .NET-based closed-source application to one that was open source and written in Java.

And while those two years would prove to be a good thing for oVirt, it was not without cost: two years off the radar of the open-source community that would turn to other tools to get things done with their virtual machines.

The release of oVirt 3.0 in 2011, and the subsequent downstream release of RHEV 3.0 in early 2012, marked a huge transition from closed to open source, and re-introduced a very capable virtual data center manager to the open-source ecosystem. Since that time, oVirt has done a lot of catching up in the virtual data center arena and its latest releases are doing a lot to bring people on board.

Welcome to oVirt 3.4

Earlier this year, the latest major release of oVirt, 3.4, debuted with a slew of new features that are all designed to make it easier for users to configure oVirt and lower the barrier to entry for getting started with it.

One of the cooler features is the self-hosted engine, which will enable the oVirt engine to be run as a virtual machine on the host it manages. Hosted engine will solve the basic chicken-and-the egg problem of having your oVirt engine tied to a single machine that's never able to be migrated. Now, if needed, virtual machine administrators can migrate the VM on which the engine is installed to another host, which greatly helps with fault tolerance.

Thanks to efforts from IBM and its El Dorado Research Center in Brazil, oVirt 3.4 has PowerPC-64 support, which gives oVirt a cross-architecture capability not found in competing virtualization platforms.

In older versions, you could use lots of different kinds of storage in oVirt, but a single oVirt data center was always locked into a specific sort of shared storage. In 3.4, data center storage is either local or shared across a network, and shared-storage data centers can include multiple types of storage domains. This enables VMs that need to access several virtual disks to allocate these disks on different storage domains, such as NFS, iSCSI, or Fibre Channel.

Network configuration was also simplified in oVirt 3.4, particularly with multi-host network configuration. That enables the administrator to modify a network already provisioned by the hosts and to apply those network changes to all of the hosts within the data center that the network is assigned to. This not only reduces the number of steps required to reflect a logical network definition change, it also reduces the risk of having a host's network configuration not be synchronized with the logical network definition.

Building on the scheduler features that were introduced in oVirt 3.3, the 3.4 release capitalizes on the scheduler to apply affinity (and anti-affinity) rules to VMs that will manually dictate scenarios in which those VMs should run together on the same hypervisor, or separately on different hypervisor hosts. Power-saving rules can also be added to the scheduler, as well.

Scheduling improvements have also been added to oVirt Manager, which has the capability to flag individual VMs for high availability. In the event of a host failure, these VMs are rebooted on an alternate hypervisor host. In earlier versions, it was possible that the resultant utilization of a cluster during a host failure may either not be allowed or could cause a notable performance degradation when HA VMs are rebooted. The new HA VM Reservations feature in oVirt 3.4 serve as a mechanism to ensure that appropriate capacity exists within a cluster for HA VMs in the event the host on which they currently reside does unexpectedly fail.

Wrapping up

In the last year, the oVirt community has seen a steady growth in vitality. Its mailing list and IRC traffic is growing and the numbers on download traffic are seeing an upward trend as well. The community is also seeing more variety in the use cases deployed in production environments. The wallflower days of oVirt are definitely coming to an end, as people discover there's a free and open platform available to manage virtual machines at any scale.

[ Brian Proffitt works for Red Hat as the Community Manager for oVirt and co-Community Lead for Project Atomic. ]


Index entries for this article
GuestArticlesProffitt, Brian


(Log in to post comments)

Virtual data center management with oVirt 3.4

Posted May 30, 2014 12:47 UTC (Fri) by ewan (subscriber, #5533) [Link]

"there never was an 'oVirt 2'"

There was an oVirt 1 (or 0.x?), though, wasn't there? A completely separate Linux native project that existed circa Fedora 9 era before the Windows stuff was brought in instead.

I'm sure I ran it on a test machine, but there seems to be virtually no online trace of it now.

Virtual data center management with oVirt 3.4

Posted May 30, 2014 17:16 UTC (Fri) by lkundrak (subscriber, #43452) [Link]

You're right. I'm surprised the article did not mention it.

Until Fedora 15 we shipped this package:

http://pkgs.fedoraproject.org/cgit/ovirt-server.git/tree/...

Virtual data center management with oVirt 3.4

Posted May 30, 2014 21:02 UTC (Fri) by fandingo (guest, #67019) [Link]

oVirt is a nice project, but the Fedora support is puzzling. Red Hat projects typically have superb support for current Fedora releases. oVirt is a glaring exception. It's been 6 months since Fedora 20 was released, and the oVirt project still cannot be run on Fedora 20. The bug reports that track Fedora 20 progress don't have meaningful detail and haven't been updated in months.

It's starting to look like Fedora 21, which itself is delayed by 5 months (for major project reorganization), will be released before Fedora 20 is supported.

Virtual data center management with oVirt 3.4

Posted Jun 1, 2014 5:47 UTC (Sun) by mab (guest, #314) [Link]

Virtual data center management with oVirt 3.4

Posted Jun 1, 2014 9:45 UTC (Sun) by fandingo (guest, #67019) [Link]

No, the packages install fine, but it's impossible to setup a Fedora 20 as an oVirt host.

Virtual data center management with oVirt 3.4

Posted Jun 3, 2014 19:35 UTC (Tue) by zdzichu (subscriber, #17118) [Link]

No it doesn't, the list of issues starts from https://bugzilla.redhat.com/show_bug.cgi?id=1060198

Virtual data center management with oVirt 3.4

Posted Jun 1, 2014 7:07 UTC (Sun) by bkp (subscriber, #53019) [Link]

Rather than rush to support every version of Fedora and do it wrong, the oVirt team would rather look at supporting future versions of Fedora properly. Plus, we are working closely with the CentOS project so that users can work with oVirt on an enterprise-ready operating system.

Virtual data center management with oVirt 3.4

Posted Jun 1, 2014 10:15 UTC (Sun) by fandingo (guest, #67019) [Link]

Compare that support attitude to other major projects at Red Hat, which also have complicated software stacks. FreeIPA and OpenShift have spectacular Fedora support, including Raw Hide.

No other Red Hat projects have such difficulties in keeping up with Fedora. Why is oVirt special? Red Hat lists 9 of its projects as emerging technologies (http://et.redhat.com/):

* KVM
* libvirt
* virt-manager
* libguestfs
* Spice
* oVirt
* Katello
* Augeas
* FreeIPA

oVirt is the only item on that list whose current release is not compatible with the current release of Fedora, which was released 6 months ago and largely defined for 12 months. I wonder if oVirt is also the only one that also considers CentOS more of an upstream than Fedora.

Virtual data center management with oVirt 3.4

Posted Jun 1, 2014 11:48 UTC (Sun) by bkp (subscriber, #53019) [Link]

First off, thanks for point out that page, which I would have to say (to put it mildly) is deprecated. oVirt, for instance, is four years old, and hardly new or "emerging." I will be talking to the folks for that page and get it updated.

Second, and more directly to your question, the big reason that we don't support Fedora 20 yet is that F20 came with JBoss 8 (Wildfly), which fundamentally effects the oVirt Engine (which relies on JBoss) architecture. The developers could have made the modifications in Engine to make it compatible with Wildfly and thus with F20, but doing so would have lost Engine's compatibility with earlier versions of Fedora, *as well as* any current or prior version of RHEL-based distributions.

Faced with that choice, it was really no choice at all... hold off on Fedora 20 support and continue with RHEL-based and Fedora 19 (and earlier) support until they can figure out a way to support Fedora 20 and not break compatibility.

There is, by the way, a workaround to this[1], essentially installing JBoss 7 and pointing the Engine at it, instead of JBoss 8.

You are correct in that normally oVirt should (and typically does) keep up with Fedora's cadence--but in this instance, the community needs more time to get it right.

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1062318#c5

Virtual data center management with oVirt 3.4

Posted Jun 1, 2014 19:02 UTC (Sun) by fandingo (guest, #67019) [Link]

oVirt has its own yum repositories. Why does it matter what version of Wildfly is included in the standard Fedora repositories? Just put JBoss 7 in the oVirt Fedora 20 repository. The RPM probably doesn't need a single change from the Fedora 19 src rpm. The oVirt repositories already do this for el6!

Btw, the solution that you suggested doesn't come with a SELinux policy for JBoss 7, which is a deal-breaker for most Fedora users.

Virtual data center management with oVirt 3.4

Posted Jun 2, 2014 8:20 UTC (Mon) by bkp (subscriber, #53019) [Link]

Right, that was a workaround, and not ideal because of the SELinux conflict you mention.

And you answered your initial question: that is one of the reasons we don't just toss JBoss 7 in the repos.

The oVirt community is working on this, and I would invite you to join us at users@ovirt.org and/or #ovirt on irc.oftc.net and roll out your ideas. The more ideas, the better!

Virtual data center management with oVirt 3.4

Posted Jun 2, 2014 20:13 UTC (Mon) by iheim (guest, #70622) [Link]

actually, the fedora 19 jboss is not a single rpm, as the jboss team (with ovirt team help btw) packaged it 'per fedora guidelines' into a couple of hundreds rpms. but yes, to provide a workaround, we plan on using the same approach as the .el6 jboss package - a single 'blob' rpm.

Virtual data center management with oVirt 3.4

Posted Jun 3, 2014 10:06 UTC (Tue) by nim-nim (subscriber, #34454) [Link]

Which only means that ovirt will suffer another big bang when JBoss 8 hits RHEL and needs to be supported, and will never be really mature.

It is really surprising that after all this time a Red Hat team still does not understand the benefits of integrating early in Fedora and rawhide instead of waiting the last minute to discover problems that can not be ironed out in time for RHEl release.

Virtual data center management with oVirt 3.4

Posted Jun 6, 2014 21:05 UTC (Fri) by job (guest, #670) [Link]

This reads disturbingly much like a sales pitch.

Anyway, I dabbled a bit with oVirt and must say it is promising software. However the biggest hurdle is that it is so heavily geared towards gigantic installations. There is simply no way to test this software at small scale (with only one or two physical nodes) without the clunkiness of managing a datacenter.

Sure, it probably works but no one will love it. You have to be sold on the whole datacenter vision right from the start.


Copyright © 2014, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds