Do all the things like ++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatarSign Up
Get a devDuck
Rubber duck debugging has never been so cute! Get your favorite coding language devDuckBuy Now
Search - "openstack"
I started two months ago a new role in a new company.
Together with 3 colleagues I manage a HUGE OpenStack platform (I’m talking about more than 300 customers, many petabytes of data, dozens of compute nodes 😍).
On Friday night a well-known multinational had the GREAT idea to update the software of one of the core components of the platform (Neutron).
Obviously it all went wrong and customers started to call and open tickets, so even if it was already past midnight we’ve been all called to arms.
As a workaround we had to rebuild ALL the networks, detach all the ports and reattach them to the VMs, with all the errors that came with this kind of operations, such as failing to get an internal/external IP, fail to boot etcetera.
What amuses me is the fact that the above-mentioned multinational just asked for logs with no solution (except for the above workaround) until Monday morning.
It has been a good weekend, i talked with professionals from all over the world, in various languages, and worked multi-tasking with two different computers, with a third that was used just to share my screen and VPN for the management network.
During this weekend I virtually met all the possible colleagues that I will meet in this new role, and it was pretty funny to see how they handle stress. (Badly if you ask)
I’ve been woken up at 7:30 after falling asleep at 6:45, I’ve slept 17 hours in 5 days, haven’t taken a shower in 5 days (I know, it happens, I worked from home) but it was worth it.
Not only and merely for the money (overtime work), but mainly for the job itself.
I love to handle this HUGE infrastructures for now, even if I think they have many limitations and many components could have been written better.
The best thing about this weekend was to meet a group of people from all over the country and the world that worked non-stop from Friday night until Wednesday night to solve the situation.
All of them understood me when I asked them questions, and didn’t treat me like the [insert random]science nerd that I am.
I felt like in the movies, in front of three monitors, working from the comfort of my chair, in my underwear, eating as fast as I could because I was constantly in call with someone.
Apart from that, WHAT THE FUCK WENT THROUGH YOUR HEAD TO DEPLOY AN UPDATE ON FRIDAY NIGHT, YOU FUCKING PIECE OF adorable man???
WHY COULDN’T YOU WAIT UNTIL MONDAY??? NOBODY USES THOSE SERVICES AT NIGHT APART FROM THE SCHEDULED JOBS!!!!!
I HOPE YOU’LL HAVE A LONG AND PROSPER LIFE, FULL OF JOY AND HAPPINESS5
My company is providing cloud infrastructure to our customers. For research purposes we are running a little openstack cloud in our laboratory datacenter were we can test stuff before implementing it in the productive environment.
Last week the manager asked me to shut down the cluster over night and only power on the servers when we need it. (about twice a week)
The reason: it produces too much heat.
My answer was: No.
First off thats not how cloud infrastructure works, and how about a proper climate control?
Sometimes i ask myself in which parallel universum our managers live 😑5
We pay 10's of 1000's of $/£ to these companies for support and either they don't get back to us or don't listen to the problem or come up with dumb suggestions. More often than not you get a valid answer on Redit or openstack before the supplier has even understood the problem.2
Here it goes,
So there I was a Linux enthusiast stuck in a windows job for about 3 years. I would spend my weekends doing Linux related tasks for my personal amusement, while I spent my week doing windows maintenance and development (partially) professionally.
It was about 2014 I started building an openstack cluster at home and i was so stoked! I searched for openstack summits or meetups and for my surprise there was an openstack meetup in my town. Holly 🐄 I said.
The date of the event came and I left work earlier to attend the meetup.
There , I had a talk with the meetup organizer/speaker and he told he was interested in what I was doing and that they were going to open a job in the next months.
A few months later still at my boring job I got an email from him for an interview.
Everything went just about right...and here I am a Linux systems engineer doing everything I love for a living...
[Talk by a security expert. The main point was, complexity kills security.]
7 minutes later a friend via IM: Hey, let's use OpenStack! Just 33 micro services to install!
Rails, React, React-Native, Docker, Kubernetes, Openstack, Jenkins, AWS, Microservices, Realm, MongoDB, PostgresQL, GraphQL (list goes on...), and I'm not even done yet.
6 months was spent learning all of the above because I found a Rails-only monolith on Heroku unsettling. My first batch of containers was just deployed and I couldn't be happier. Love my job.3
Had a good interview for sysadmin gig. I'm pretty weak with Linux. If I get the gig, my first task will be creating an openstack environment. Reading docs and watching videos like a madman, I feel like I'm a decade late to the party.2
Next week I’m going to install Openstack via TripleO on 12 physical nodes in another city far from mine.
My boss “sold me” as an expert, obviously.
I know Openstack, I love it, but I’ve never installed it yet.
This weeks are going to be tough 😅
Normal Ppl: What could be Worst Than a Breakup? :(
Me: Having your Openstack Installation getting Fucked Up at its last leg.1