r/openstack • u/MaximusDM22 • Oct 30 '22
Is openstack still the best open source option?
I am planning on building a private cloud. Is openstack still the most relevant or is it dying off? Are there better options? My needs include creating VMs, networking to access VM outside of network, image creation, snapshot creation, and block storage. Possibly also usage tracking, but not absolutely necessary. I dont need a full on public cloud set up, it is just for my own small operation. For this use case, would openstack be the best option long term or is there a better alternative? I am currently using a public cloud but it isnt a good fit.
12
u/genteelbartender Oct 31 '22
The idea that OpenStack is so overly complex and bloated that it takes a massive team of engineers is simply not true. Adobe runs their entire OpenStack cloud of 60K nodes with a team of 3 people. OneQode stood up their entire high performance gaming data center with a team of 4 guys in six weeks - they had never used OpenStack before. Can it get very complex, for sure. Is it necessary to have that kind of complexity? Not at all.
3
1
u/gwaewion Nov 01 '22
I can't find any information about Adobe and their Openstack installation driven by only three engineers. May you provide some links to this, please?
6
u/genteelbartender Nov 02 '22
Sorry. 4 engineers and now they're up to 100K nodes - https://www.youtube.com/watch?v=bf5KV3VISp8 and https://www.youtube.com/watch?v=GWbLi_I3YZ8 (at 11:00)
2
2
u/M0HAZ Jul 12 '23
100k cores, not nodes! Think of 200 cores per node, then they are managing ~500 nodes in 6 data centers.
4
u/memrobo Oct 30 '22
Use Charmed Openstack! Juju makes life so much easier. Regular maintenance, adding and removing units etc. I use Juju + MAAS that covers everything including bare metal provisioning. In other words it's the whole package.
1
u/MaximusDM22 Oct 30 '22
Thanks! Ive seen Juju mentioned before. Ill definitely check it out.
1
u/memrobo Oct 30 '22
Cool! Stay on Juju 2.9 for the time being. Version 3.0 was just released and they made some command / alias changes and not all deployment bundles are ready for it.
4
u/arcticblue Oct 31 '22
Juju and MAAS are two of the best things Canonical has ever put out in my opinion. It was how I tested out OpenStack on a couple of spare servers several years ago and the experience was so good that it inspired me to apply for a position with Canonical (made it to the final round of interviews, but wasn't selected).
1
u/yotis Nov 04 '22
Since you mentioned testing, isn’t MicroStack easier to deploy than Charmed? Not sure is valid in a production context, but for learning, homelab, getting familiar to Openstack…Thanks!
2
u/lunar_bear Oct 30 '22
If you’re doing this on a single physical host, you can probably meet your needs and radically reduce complexity just by using the simple qemu/kvm suite of tools. Interfaces like virt-manager…(there are several).
1
u/MaximusDM22 Oct 30 '22
Initially I will start with just a few VMs. Would the suite of tools meet the networking, image, and snapshot needs my project has? Eventually I do want to expand and have a larger datacenter.
2
u/lunar_bear Oct 30 '22
It is probably reasonable to manage 5-6 physical servers just using a tool like virt-manager. Honestly running OpenStack is a large undertaking and one that you probably shouldn’t bite off unless you have a very, very solid understanding of networking, linux, storage, shared storage over a network, physical switch configuration….basically a full stack of datacenter skills
1
u/MaximusDM22 Oct 31 '22
I researched your suggestion but it appears there isnt an API that I could use to automate the functionality. It is all GUI based correct?
You and 90% of everyone else here has definitely warned me about the difficulty lol but I am definitely up for the challenge. I have 0 experience with any of those things except for Linux. I have used kolla-ansible to start up Openstack tonight and I would have been stuck immediately if I didnt have prior knowledge of Linux and how to debug things. I intend on learning everything else along the way.
How do people normally get into learning how to use Openstack? Is it just dive in head first? Tutorials? Consultants? Is there a decent community or forum out there that is the go-to?
3
u/lunar_bear Oct 31 '22
Well, yes, you've hit upon the primary difference between a "cloud" and simple virtualization platforms like Qemu/KVM or VMware: a cloud has an API. But it doesn't mean you can't glue on some ways of automating simple virtualization platforms. Combine bash with some PDSH and you can be well on your way to automating just about anything that relies on QEMU/KVM...
But I get it....you want to learn OpenStack. That's fine, go for it. I run OpenStack as my full time job (and it is a full time job). I also have another sysadmin whose full time job is just helping me run OpenStack. We also have another FTE who manages storage. And we have an independent Security team. We have hundreds of hypervisors, so it's a big operation. But aside from the scale of bare metal, you'd still have to cover almost the same number of technologies.
Most large scale OpenStack deployments use a custom, home-grown deployment and management mechanism. And I suspect that's because, once you start to customize OpenStack to meet very specific needs of your organization, then you quickly start to find the canned deployment tools rather limiting. I learned OpenStack just by reading the guides on docs.openstack.com, trial & error, reading the python code, reading and submitting bug reports...and just years of practice. About a full decade now....
You won't really find consultants, and if you do, they will be asking you to deploy a super specific configuration, and they're likely to not support any other configuration. You should go to the Open Infrastructure conferences. Attend meetings. Join special interest groups within the community. It is a big commitment, but if you're really passionate about going down the OpenStack path.....just dive right in!
2
u/Particular-Elk-2594 Oct 30 '22
It is really the only viable choice if you want to run your own private cloud. The things that you mention you're looking to do are core components and not terribly difficult to do. As others here have mentioned, there are quite a number of deployment tools to get you up and running. I have used Kolla-ansible for many years, and find the community supportive and responsive when I hit problems. You also will probably want a Ceph cluster to go along with it if you want to do things like live migrations.
IF you want to start with a home lab kind of setup, Kolla-Ansible has a single node deployment so you can mess with things.
2
u/MaximusDM22 Oct 31 '22
I have seen good reviews of Kolla-Ansible. I believe Ill start with this and hopefully learn about the whole ecosystem through that.
1
u/Think-Report-5996 May 02 '25
Is there any hot migration tool to migrate a kvm virtual machine to an OpenStack cluster?
3
Nov 04 '23
Try CloudStack, it’s more simpler than Openstack - easy to install, manage, use and upgrade.
2
u/till Oct 30 '22
I feel like everything people suggested is valid until you hit Ceph (storage) which is very painful. I agree that paying someone to do that is a good choice. Personally would recommend Virtuozzo‘s distro as they also make the storage part bearable.
2
u/Particular-Elk-2594 Oct 30 '22
Ceph isn't that bad. It just takes getting familiar with it like anything else. I've been running it since 2012 with great success. There are somewhat more simplified deployment methods for it like Proxmox. The benefit of sticking with Ceph is simply that the Ceph<->Openstack community is by far the largest and therefor getting community community support for it is a lot easier, and the support between the 2 much more mature. I wouldn't recommend splitting up that pairing to someone new to either platform.
2
u/Avoahcado Oct 31 '22
I will throw https://yaook.cloud in the mix. It is Yet Another Openstack On K8s.
2
1
u/lmux Nov 01 '22
If you can live without snapshot, kubernetes is a more modern and resource effective way to handle business workloads imo. Only downside is that not everything can run inside containers.
1
u/Radhika-Singh Jan 09 '25
OpenStack remains a top open-source choice for private clouds, supporting VMs, networking, snapshots, block storage, and usage tracking. It's highly flexible and actively developed, making it ideal for long-term use. For simpler needs, Proxmox VE or oVirt are good alternatives, but they lack OpenStack's scalability. At Accrets, we often recommend OpenStack for those seeking control and adaptability over public cloud constraints.
1
u/electrocucaracha Oct 31 '22
I started my journey in OpenStack since Havana release, went from many installers( and submitted many changes). I'm not going to deny that deploying and upgrading it is hard. I found Kolla-ansible quite simple compared with others and it's well maintained, so few releases ago I decided to create a project for provisioning vagrant boxes with different setups( All-in-One, No HA and distributed), somethingto capture part of learnings. It has some documentation and GitHub actions to validate its relevance. Hopefully that helps https://github.com/electrocucaracha/openstack-multinode
1
u/Embarrassed_Dig8523 Nov 22 '22
OpenStack is hugely powerful and flexible but in that realm that creates so many possibilities that it can be hugely complex. If you go with a bundled version like from Red Hat a lot of complexity is worked out for you. There are some things that are turned off or limited to which helps for stability and integration too.
1
u/todd_openmetal Sep 28 '23
Hey All, sorry for so late to the party...
u/MaximusDM22 - I hope you have had success because having a well running Openstack is a huge cost savings over buying public cloud or similar. But it is hard to get up and running.
I always recommend people use a cloud as an operator first before trying to build one out. Check out https://openmetal.io/docs/manuals/operators-manual and if you are interested/still working on this, let me know here and I can give you a cloud to learn on for a while. It has Ceph also on it - that is the most common storage system to have alongside Openstack.
Hope that helps and sorry for not seeing this early.
13
u/jjasghar Oct 30 '22
Frankly, if you don’t want to spend all your time supporting the cloud you should look into RDO so you can just use it.
But if you want to go down the learning journey of how a cloud is built, something like the OpenStack-Ansible ?Kolla? Will get it built and useable pretty quickly. All your time will be sucked away debugging it in the long run.