July 26, 2020

1230 words 6 mins read

Seriously using virtualization clashes with our funding model

Seriously using virtualization clashes with our funding model

In a comment on my entry on us needing to get experience with Ubuntu 20.04, Miksa pointed out the advantages of investing heavily in virtualization. These definitely exist, but among other practical issues, heavy investment in virtualization clashes with our funding model, which you could describe as ‘erratic’ or ‘nonexistent’. Our equipment funding is quite erratic and as a result we have to buy

stuff mostly in bursts.

A significant commitment to and investment in virtualization really calls for big servers, ones that have a lot of memory and CPUs to support a lot of virtual machines at once (and possibly a lot of storage, or a very fast storage network). Big servers are expensive and you have to spend that money all at once, both the initial purchase and their replacement when they reach their (finite) sensible operating lifetime. Periodic big investments on big VM host servers may well cost less overall than a series of smaller but more spread out investments on physical servers, but they require you to have large sums of money available at predictable times. Unfortunately, we don’t.

(There’s an alternate model of lots of smaller virtualization hosts with fewer VMs on each host, but it’s not what people talk about or recommend.)

This is the same effect I’ve seen before with network routers and switches, where buying a highly capable but expensive router doesn’t make sense for us. With routers and switches we’re better off with a bunch of smaller switches than trying to do everything in a few big units, because we can buy and replace them piece by piece. The same is true for us with virtualization servers, at least in the conventional model of them. Our funding model is mostly incompatible with periodic big purchases.

(We’ve been surprisingly good at turning over our fileserver infrastructure more or less on schedule, but that has traditionally had a natural forcing function because hard drives wear out. Even then we pushed one fileserver generation alarmingly far, to the point where we saw significant drive failure rates.)

PS: This funding issue isn’t solved by using someone else’s host infrastructure so that we pay this as an ongoing smaller operating cost instead of a periodic hardware purchase cost. We don’t have reliable money for cloud operating costs either, and that can be a worse problem.

(3 comments.)

Author: cks

Date: 2020-11-10

URL: https://utcc.utoronto.ca/~cks/space/blog/sysadmin/VirtualizationFundingProblem

utoronto.ca

More problems with Fedora 31 DNF modules and package updates (2020-08-09) A while back I wrote about how Fedora 31 had fumbled DNF modules and package updates which ended with me believing that I had fixed the problem so that I would get updates to packages I cared about despite the DNF module versions not being updated Then recently I tweeted: It turns out that Fedora 31 DNF modules even reset ones that arent active are apparently still both out of date and blocking pa..
The issue of how to propagate some errors in our Django web app (2020-08-03) Much of what our Django application to handle Unix account requests does is only available to special people such as professors who can actually approve account requests instead of just making them Following our usual we protect the management section of the web app with Apache HTTP Basic Authentication where only people in designated Unix groups such as the sponsors group have access However the ..
Remotely upgrading my office workstation to Fedora 32 worked fine (2020-10-25) One of the things Ive been worried about during the current long length of working from home has been upgrading my office workstation to Fedora 32 Upgrading my home machine is straightforward at one level because Im here right in front of it and I can probably sort out anything that goes wrong although thats complicated by my home machine being my Internet gateway Im not in front of my office work..
Apple Silicon Macs versus ARM PCs (2020-11-19) In a comment on my entry on how I dont expect to have an ARM-based PC any time soon Jonathan said: My big takeaway from the latest release of Apple laptops is that these new laptops arent necessarily ARM laptops When a person gets an Apple Silicon Mac they are not getting an ARM computer They are getting an Apple computer As it happens I mostly agree with this view of the new Apple machines and i..
Some settings you want to make to CyberPower’s UPS Powerpanel daemon (2020-10-31) I have a CyberPower UPS and a while back I installed their PowerPanel software to talk to it in large part to get various status information in an automated way The other day I discovered that it has some undesirable default settings So here are some notes on things that you will almost certainly want to change in /etc/pwrstatdconf if youre using PowerPanel too As I discovered the daemon has at le..
Whether extra disks should be live or spare now depends on HDs versus SSDs (2020-10-09) Suppose not entirely hypothetically that you have a server with at least three or four spare drive bays and you want to build a mirrored storage setup that can maintain redundancy without requiring an in-person drive swap should a drive fail Lets say you go with three drives in the system in total Obviously two of them have to be mirrored in order to get your basic redundancy but the third one cou..
People still use newgrp (to my surprise) (2020-10-01) One of the things that came out of me writing about why newgrp exists and casually mentioning that it was a relic and that OpenBSD had gotten rid of it is that a number of people left comments discussing how they actively use newgrp even today This surprised me more than a bit although in retrospect it probably shouldnt have Theres long been an aphorism in software development that if you have a l..
Link: Old-School Disk Partitions (2020-10-04) Warner Loshs Old-School Disk Partitions via is a discussion of how disk partitioning worked and evolved in the early days of Unix up through 43 BSD This has more information than what I wrote about how major and minor device numbers worked in V7 because I missed that various disk device drivers had their own partitioning tables for minor numbers Warner Loshs blog has a lot of interesting writing o..
Unix options conventions are just that, which makes them products of culture (2020-08-10) Recently I wrote about my views on some conventions for Unix command line options where I disagreed in part with what Chris Wellons considered Conventions for Command Line Options Both Wellons and I have a lot of Unix experience and that we disagreed on parts of what rightfully should be a well established core of Unix in practice shows some things about them The first thing to note about Unixs co..
If you send automated email, you should scan it with anti-spam software (2020-10-13) Partly in light of Microsoft SharePoints problem with spam here is an obvious thing: If you send automated email to the outside world you should always run it through some anti-spam system and raise big alarms if they ever trigger If I was doing this today I would use ClamAV and rspamd because theyre free and what Im used to but anything will do You should do this even if you arent allowing extern..