r/openstack • • Oct 30 '22

Is openstack still the best open source option?

I am planning on building a private cloud. Is openstack still the most relevant or is it dying off? Are there better options? My needs include creating VMs, networking to access VM outside of network, image creation, snapshot creation, and block storage. Possibly also usage tracking, but not absolutely necessary. I dont need a full on public cloud set up, it is just for my own small operation. For this use case, would openstack be the best option long term or is there a better alternative? I am currently using a public cloud but it isnt a good fit.

25 Upvotes

57 comments sorted by

13

u/jjasghar Oct 30 '22

Frankly, if you don’t want to spend all your time supporting the cloud you should look into RDO so you can just use it.

But if you want to go down the learning journey of how a cloud is built, something like the OpenStack-Ansible ?Kolla? Will get it built and useable pretty quickly. All your time will be sucked away debugging it in the long run.

5

u/Oxlokesh Oct 30 '22

Totally agree, even after working on openstack for months I think that I only touched the tip of the iceberg.

1

u/MaximusDM22 Oct 30 '22

How has your experience been with setup and maintenance? Which OS and hypervisor did you end up using?

5

u/Oxlokesh Oct 30 '22

When I was starting, I was not even able to install it. But after going through 4-5 blogs I was able to at least install a working node. Slowly I learnt about various services like nova, neutron, cinder, horizon etc.

It was a challenging experience but I would say I have learnt a lot from it.

For setup I choose packstack on Centos 7 machine. Openstack's flavor that I used is "train".

1

u/MaximusDM22 Oct 30 '22

Awesome, you were able to eventually figure it out. How has maintenance been?

1

u/Oxlokesh Oct 31 '22

Actually we are still in our testing face, the goal is to deploy HPC (High Performance Computing) clusters on openstack.So it requires more time and RnD.

1

u/MaximusDM22 Oct 30 '22

I looked into RDO. Ill give that a shot with CentoOS. Thanks for pointing that out.

For the other options would debugging really be that time consuming even for smaller setups?

I fully expect setting everything up to be a monumental task, but if it will be a constant ongoing battle that is worrisome.

5

u/jjasghar Oct 30 '22

This is not hyperbole, I know peoples whole careers are based on supporting and debugging OpenStack setups. Like 40+ hours a week maintenance. (Ranging from AIOs to 3 node to 1000s of nodes)

There be dragons on this path, it’s rewarding but can take a chunk of your life.

1

u/MaximusDM22 Oct 30 '22

Wow, how does RDO radically simplify this?

3

u/jjasghar Oct 30 '22 edited Oct 30 '22

Yep! And if you have any “business operations” (like production of your company will be using it) pay for the support. You’ll get an army of nerd to make sure you can just focus on the downstream usage, and in turn leverage the OpenStack tooling and ecosystem without knowing where all the nuts and bolt go.

With a tad bit of money invested, (especially for a business) you’ll save factors of engineering time and cost in the long run.

Tl;dr this shit is hard (anyone who says otherwise either is lying or it’s all they do), and while rewarding, there’s more valuable things you can do for your business then messing with infrastructure and cloud software.

2

u/MaximusDM22 Oct 30 '22

This is totally new to me so thanks for the warning. I am a software developer and this is a totally different field. One more question, I have been reading up on CentOS Stream. Apparently, it isnt fit for production for many use cases. For my use case would CentOS Stream still be appropriate?

2

u/jjasghar Oct 30 '22

Yep, but be sure to have a Dev/test env where you can run the updates to the OS as needed. Yep, I just implied whatever hardware you think need you’ll need to triple it so you can test things.

2

u/MaximusDM22 Oct 30 '22

Im confused, even for multiple nodes or just for a small setup? So just to make sure I understand, RDO makes it easy to get Openstack up and running quickly and also gives you access to Redhat support correct? Could you get similar support from other third-parties using other operating systems like Ubuntu or Debian? Or is Redhat just the way to go for something like this to minimize cloud maintenance? Thanks for answering my questions, ive been doing a deep dive into hypervisors and openstack the past couple days and there is so much to learn.

6

u/triplewho Oct 30 '22

Hey. I’m a Software Engineer for Red Hat working on OpenStack. Red Hat only provides support for Red Hat OpenStack Platform. RDO is the upstream community release of the product. We use CentOS9 stream as our OS for releases after Wallaby. We use TripleO for deployment and day 2 operations of OpenStack.

I have a bunch of videos related to deploying and configuring OpenStack using TripleO:

https://youtube.com/playlist?list=PLSsjlbQ1lz_Jd_HzbAk8FhKjYUqkTfIy2

1

u/MaximusDM22 Oct 30 '22

Interesting. Is CentOS9 Upstream good for production or is it intended to be used for development with the expectation of upgrading to the Openstack Platform? That is what I gathered from researching CentOS Upstream.

→ More replies (0)

1

u/jjasghar Oct 30 '22

You asked about CentOS Stream. The update/rolling cycle of Stream will require constant validation. And heaven help you if you ever have nodes without the exact configuration on each.

Again, people’s whole careers are based on knowing where all the gotchas are using this stuff.

1

u/MaximusDM22 Oct 30 '22

Sounds like a pain then. Seems like RHEL is the way to go unless I use another OS. Thank you for your help. Really clears things up for me.

→ More replies (0)

2

u/port53 Oct 30 '22

We have a team of people dedicated to running OS, way more than we needed for the equivalent VMWare solution it replaced. I'm not sure it actually saved any money either.

2

u/KernelFrog Oct 31 '22

Seconding this; I was a Red Hat TAM (technical account manager) for an enterprise running a large Openstack set up (large = ~200 compute nodes, plus storage, plus networking). There was a small team of full-time staff dedicated to just running & maintaining the Openstack system.

Private cloud is great, but it comes at a cost.

2

u/Particular-Elk-2594 Oct 30 '22

RDO is literally just a set of packages in a repo for installation on RHEL and derivative platforms. RHOCP is the commercial product.

If you don't want to pay for a commercial product, both kolla-ansible and Openstack-Ansible are great. There is a learning curve, but honestly, if you're not up to that, you're not up to running your own private cloud. It's not a single piece of software. It's and entire ecosystem of interdependent things.

1

u/jjasghar Oct 31 '22

Ah yeah thanks for that clarification. When I was deeper in that space I just remembered people referred it as “RDO.”

1

u/Worldly_Quality_800 Aug 29 '24

Oque é esse RDO? teria algum link de datasheet? ou algum video para estudo?

12

u/genteelbartender Oct 31 '22

The idea that OpenStack is so overly complex and bloated that it takes a massive team of engineers is simply not true. Adobe runs their entire OpenStack cloud of 60K nodes with a team of 3 people. OneQode stood up their entire high performance gaming data center with a team of 4 guys in six weeks - they had never used OpenStack before. Can it get very complex, for sure. Is it necessary to have that kind of complexity? Not at all.

3

u/MaximusDM22 Oct 31 '22

Thats awesome. Cool to hear some success stories.

1

u/gwaewion Nov 01 '22

I can't find any information about Adobe and their Openstack installation driven by only three engineers. May you provide some links to this, please?

6

u/genteelbartender Nov 02 '22

Sorry. 4 engineers and now they're up to 100K nodes - https://www.youtube.com/watch?v=bf5KV3VISp8 and https://www.youtube.com/watch?v=GWbLi_I3YZ8 (at 11:00)

2

u/gwaewion Nov 02 '22

Thank you a lot!

2

u/genteelbartender Nov 02 '22

Happy to help :)

2

u/M0HAZ Jul 12 '23

100k cores, not nodes! Think of 200 cores per node, then they are managing ~500 nodes in 6 data centers.

4

u/memrobo Oct 30 '22

Use Charmed Openstack! Juju makes life so much easier. Regular maintenance, adding and removing units etc. I use Juju + MAAS that covers everything including bare metal provisioning. In other words it's the whole package.

1

u/MaximusDM22 Oct 30 '22

Thanks! Ive seen Juju mentioned before. Ill definitely check it out.

1

u/memrobo Oct 30 '22

Cool! Stay on Juju 2.9 for the time being. Version 3.0 was just released and they made some command / alias changes and not all deployment bundles are ready for it.

4

u/arcticblue Oct 31 '22

Juju and MAAS are two of the best things Canonical has ever put out in my opinion. It was how I tested out OpenStack on a couple of spare servers several years ago and the experience was so good that it inspired me to apply for a position with Canonical (made it to the final round of interviews, but wasn't selected).

1

u/yotis Nov 04 '22

Since you mentioned testing, isn’t MicroStack easier to deploy than Charmed? Not sure is valid in a production context, but for learning, homelab, getting familiar to Openstack…Thanks!

2

u/lunar_bear Oct 30 '22

If you’re doing this on a single physical host, you can probably meet your needs and radically reduce complexity just by using the simple qemu/kvm suite of tools. Interfaces like virt-manager…(there are several).

1

u/MaximusDM22 Oct 30 '22

Initially I will start with just a few VMs. Would the suite of tools meet the networking, image, and snapshot needs my project has? Eventually I do want to expand and have a larger datacenter.

2

u/lunar_bear Oct 30 '22

It is probably reasonable to manage 5-6 physical servers just using a tool like virt-manager. Honestly running OpenStack is a large undertaking and one that you probably shouldn’t bite off unless you have a very, very solid understanding of networking, linux, storage, shared storage over a network, physical switch configuration….basically a full stack of datacenter skills

1

u/MaximusDM22 Oct 31 '22

I researched your suggestion but it appears there isnt an API that I could use to automate the functionality. It is all GUI based correct?

You and 90% of everyone else here has definitely warned me about the difficulty lol but I am definitely up for the challenge. I have 0 experience with any of those things except for Linux. I have used kolla-ansible to start up Openstack tonight and I would have been stuck immediately if I didnt have prior knowledge of Linux and how to debug things. I intend on learning everything else along the way.

How do people normally get into learning how to use Openstack? Is it just dive in head first? Tutorials? Consultants? Is there a decent community or forum out there that is the go-to?

3

u/lunar_bear Oct 31 '22

Well, yes, you've hit upon the primary difference between a "cloud" and simple virtualization platforms like Qemu/KVM or VMware: a cloud has an API. But it doesn't mean you can't glue on some ways of automating simple virtualization platforms. Combine bash with some PDSH and you can be well on your way to automating just about anything that relies on QEMU/KVM...

But I get it....you want to learn OpenStack. That's fine, go for it. I run OpenStack as my full time job (and it is a full time job). I also have another sysadmin whose full time job is just helping me run OpenStack. We also have another FTE who manages storage. And we have an independent Security team. We have hundreds of hypervisors, so it's a big operation. But aside from the scale of bare metal, you'd still have to cover almost the same number of technologies.

Most large scale OpenStack deployments use a custom, home-grown deployment and management mechanism. And I suspect that's because, once you start to customize OpenStack to meet very specific needs of your organization, then you quickly start to find the canned deployment tools rather limiting. I learned OpenStack just by reading the guides on docs.openstack.com, trial & error, reading the python code, reading and submitting bug reports...and just years of practice. About a full decade now....

You won't really find consultants, and if you do, they will be asking you to deploy a super specific configuration, and they're likely to not support any other configuration. You should go to the Open Infrastructure conferences. Attend meetings. Join special interest groups within the community. It is a big commitment, but if you're really passionate about going down the OpenStack path.....just dive right in!

2

u/Particular-Elk-2594 Oct 30 '22

It is really the only viable choice if you want to run your own private cloud. The things that you mention you're looking to do are core components and not terribly difficult to do. As others here have mentioned, there are quite a number of deployment tools to get you up and running. I have used Kolla-ansible for many years, and find the community supportive and responsive when I hit problems. You also will probably want a Ceph cluster to go along with it if you want to do things like live migrations.

IF you want to start with a home lab kind of setup, Kolla-Ansible has a single node deployment so you can mess with things.

2

u/MaximusDM22 Oct 31 '22

I have seen good reviews of Kolla-Ansible. I believe Ill start with this and hopefully learn about the whole ecosystem through that.

1

u/Think-Report-5996 May 02 '25

Is there any hot migration tool to migrate a kvm virtual machine to an OpenStack cluster?

3

u/[deleted] Nov 04 '23

Try CloudStack, it’s more simpler than Openstack - easy to install, manage, use and upgrade.

2

u/till Oct 30 '22

I feel like everything people suggested is valid until you hit Ceph (storage) which is very painful. I agree that paying someone to do that is a good choice. Personally would recommend Virtuozzo‘s distro as they also make the storage part bearable.

2

u/Particular-Elk-2594 Oct 30 '22

Ceph isn't that bad. It just takes getting familiar with it like anything else. I've been running it since 2012 with great success. There are somewhat more simplified deployment methods for it like Proxmox. The benefit of sticking with Ceph is simply that the Ceph<->Openstack community is by far the largest and therefor getting community community support for it is a lot easier, and the support between the 2 much more mature. I wouldn't recommend splitting up that pairing to someone new to either platform.

2

u/Avoahcado Oct 31 '22

I will throw https://yaook.cloud in the mix. It is Yet Another Openstack On K8s.

2

u/instacompute Apr 22 '24

I would look at CloudStack, Opennebula and Proxmox.

1

u/lmux Nov 01 '22

If you can live without snapshot, kubernetes is a more modern and resource effective way to handle business workloads imo. Only downside is that not everything can run inside containers.

1

u/Radhika-Singh Jan 09 '25

OpenStack remains a top open-source choice for private clouds, supporting VMs, networking, snapshots, block storage, and usage tracking. It's highly flexible and actively developed, making it ideal for long-term use. For simpler needs, Proxmox VE or oVirt are good alternatives, but they lack OpenStack's scalability. At Accrets, we often recommend OpenStack for those seeking control and adaptability over public cloud constraints.

1

u/electrocucaracha Oct 31 '22

I started my journey in OpenStack since Havana release, went from many installers( and submitted many changes). I'm not going to deny that deploying and upgrading it is hard. I found Kolla-ansible quite simple compared with others and it's well maintained, so few releases ago I decided to create a project for provisioning vagrant boxes with different setups( All-in-One, No HA and distributed), somethingto capture part of learnings. It has some documentation and GitHub actions to validate its relevance. Hopefully that helps https://github.com/electrocucaracha/openstack-multinode

1

u/Embarrassed_Dig8523 Nov 22 '22

OpenStack is hugely powerful and flexible but in that realm that creates so many possibilities that it can be hugely complex. If you go with a bundled version like from Red Hat a lot of complexity is worked out for you. There are some things that are turned off or limited to which helps for stability and integration too.

1

u/todd_openmetal Sep 28 '23

Hey All, sorry for so late to the party...

u/MaximusDM22 - I hope you have had success because having a well running Openstack is a huge cost savings over buying public cloud or similar. But it is hard to get up and running.

I always recommend people use a cloud as an operator first before trying to build one out. Check out https://openmetal.io/docs/manuals/operators-manual and if you are interested/still working on this, let me know here and I can give you a cloud to learn on for a while. It has Ceph also on it - that is the most common storage system to have alongside Openstack.

Hope that helps and sorry for not seeing this early.