They didn't mention which configuration this was specifically, but now we're actually getting more specific detail and this is worth a read if you're interested. Here's the crux of it via WSJ through MSN to avoid the paywall:

"Data from that router and another at the Texas location overwhelmed the system, government and industry officials said. It led to 17 out of the FAA’s 22 centers that oversee high-altitude flying to experience disruptions in communications, Bedford said, resulting in the FAA ordering the ground stop.

There are about 60 Juniper routers active and operating normally in the FAA’s air-traffic network, said a government official familiar with the system. It wasn’t clear if the problems Friday resulted from a bad router or if L3Harris didn’t configure it properly.

“Was it a faulty installation? Was it a faulty configuration? Or was it just a bad piece of router technology that we put into this system that propagated these errors?” Bedford said Saturday, noting the FAA is still investigating the situation.

An HPE spokesman said the Juniper devices appeared to have been working as intended. “They did not fail,” he said.

FAA officials identified a feature on the router that appeared to be resulting in the data overload, according to government and industry officials. A government official described it as a broadcasting feature that sent data more broadly than necessary, and said the agency has since disabled it on all the Juniper routers."

https://www.msn.com/en-us/news/other/the-single-router-in-southern-arkansas-that-ground-air-travel-to-a-halt/ar-AA2hs7wV

So it looks like L3Harris installed a new router and didn’t enable Spanning Tree Protocol.
That took down air traffic control yesterday

https://www.reuters.com/business/aerospace-defense/us-aviation-shutdown-blamed-l3-harris-installed-router-2026-11-14/?utm_source=reddit.com

You read that title correctly: not “routers” (plural), but “router”.

https://arstechnica.com/security/2026/11/windows-0-day-dropped-by-disgruntled-researcher-hands-hackers-system-rights/

https://github.com/MSNightmare/SignDrop

If everything is chained correctly, funnily this legit security mitigation can be used against itself and allow an elevation if privileges. Everything is done properly by Microsoft here but the logic allows abuse. What makes it funnier is the fact that it can be used against any antimalware engine to bypass their self defense (or tamper protection) mechanism as you can trigger arbitrary file creation in the context of their own antimalware process so from the perspective of their kernel drivers, the file creation request is coming from their own legit process so it passes, this makes this vulnerability unique as it can be used to turn off any antivirus/EDR.

11th zero day dropped by this person, in what 6 months? I'm tired boss.

From CNN: Homeland Security Secretary Markwayne Mullin pointed to FAA updates to the air traffic control system as the reason behind today’s nationwide ground stop. He said the FAA added new technology to the old system, causing the massive breakdown.

“What it appears to be right now is, as Secretary Duffy and FAA was going in and putting patches into the system, they were putting new equipment and new technology, and that new equipment, new technology… it was overwhelming the older system,” Mullin said.

https://www.cnn.com/2026/11/13/us/live-news/flights-ground-stop-faa

Mullin just went off message and confirmed they broke it trying to install new things with no change management. Almost certainly the SMART system they were bragging about yesterday.

So this thing has been keeping me busy for a while now.

We manage a fleet of devices and deploy sets of policies on them. Now one of the sets of policies is a security baseline which regularly gets updated.

At the moment when the new set gets published we deploy the baseline through a build kit and go through it by hand to see what exceptions we have to put back, find out which settings are new and which are obsolete.

It is doable, however each time it takes a lot of time and mental gymnastics to find out the aforementioned diffs.

After we're done we can push the new config for testing and deploy it at other tenants as well.

What do people do / use to smooth out this process? I am fairly certain there must be a better way.

https://x.com/olivialarinaldi/status/2121385751036240079

Whos bright idea was it to push an update to prod at 3pm
On a Friday?

I inherited some servers. Two are an AD server replicating each other. During this time we have migrated from VMware to proxmox. Since then, we have had an issue where logging into the server will take roughly 2-3 minutes with the screen displaying "Applying Configmgr User State Management Extension. policy" I have discovered it is SCCM causing this issue. Talking to other users they have never used SCCM but apparently it was setup and pointed to a server that wasn't migrated.

I tested removing it from another server that is no longer is use but thats getting the same issue. I ran ccmsetup.exe /uninstall with success and error goes away.

Question is, does anyone know if I run this on the AD servers what issues could happen? Never used SCCM so would like to try and be ready for anything.

Howdy all. I'm making this post in hopes of affirmation or a reality check. I run a small visual effects studio and through self-teaching over the last six years have implemented a fully remote cloud based infrastructure. There is some growth on the horizon and it will likely be happening at a speed that I will not have time to figure out myself. Thankfully the growth will come with a budget to find people to support that growth much better than I would probably ever be able to.

What I want to know is the idea of a single person having the knowledge and ability to implement the below crazy? Is this job posting describing multiple roles? I can't state enough that I am NOT an IT professional and have only learned what I have needed in very isolated ways in order to accomplish our goals as a studio so I am not actually sure what role/responsibility split should be.

I put 7+ years based on the time it took me to build out my own knowledge of the posting contents. For me, this isn't about "cheaping out" by combining it all so much as I'm not sure if this needs to be broken up into multiple hires due to my own knowledge gaps.

The short term goal is to go through some security audit processes and modify/build out our current infrastructure as needed. Ideally there would be enough work coming down the pipe that we would bring someone on to build a small team dedicated to it.

Any advice is appreciated. Post is below, thanks!

About Us

We are a boutique, cloud-forward VFX studio based in Vancouver delivering visual effects for film and episodic television.

The Role

We’re looking for an experienced CloudOps Architect with a lean towards SecOps. You will lead the analysis, architecture, implementation, and documentation of our growing cloud infrastructure. In your estimation, if required, you will outline additional roles needed to support this process.

Requirements

• 7+ years in IT with direct, practical experience in CloudOps and SecOps within AWS.

• Demonstrable experience utilizing principles of least privilege operating in Windows and Linux environments.

• Knowledge of principals and implementation of Cloudflare Zero Trust network/VPN policies and associated configurations.

• Demonstrable knowledge of AWS VPC, EC2, AMI configuration, operation, and maintenance.

• Experience with AWS Network Firewall services

• Demonstrable knowledge of AWS ACL/IAM policy and role implementation.

• Understanding of network segmentation as it relates to different aspects of the overall network infrastructure (security/logging, staging, production, etc.)

• Great written and verbal communicator. Able to translate complex ideas into practical targets and goals for a small team.

Nice to Have

• Experience supporting Trusted Partner Network implementations and Content Security Best Practices.

• Experience in VFX, post-production, or media-based pipeline environments.

• Knowledge of Amazon FSX Lustre and SMB file servers

• Knowledge of Google org administration and GCPW

• Knowledge of LDAP services/implementation

• Knowledge of Parsec remote desktop client and its associated API

• A dog or cat that you can wave around in front of the camera during company video calls.

---------------------------------------------

**EDIT**
Based on some of the quick responses-- yes I'm not surprised that the ask for someone like this in a single role would be in the $200K+ range. Ultimately I don't want the real job posting to be ignored and I don't want to look ignorant as the potential employer. Thanks again.

**EDIT EDIT**
If you were going to break these responsibilities into separate roles, what would you expect the salary to be for each role?

**EDIT EDIT EDIT**
I'm not sure what to expect exactly timeline wise but I was picturing a 3-ish month contract-- evaluate/design/implement and it would be fully remote. Of course if someone gets in and it looks like it's going to take longer than that so be it but I don't know what I don't know.

-------------------------------------------------

** EDIT EDIT EDIT EDIT**
Have modified things a bit based on feedback from folks, please continue to chime in if you'd like... very much appreciate everyone's thoughts-- we're trying our best to get this right in the current hellscape that is the VFX and tech job market...

The Role
We’re looking for an experienced CloudOps Architect with a lean towards SecOps. You will lead the analysis, architecture, implementation, and documentation of our growing cloud infrastructure. After initial evaluation and consult, in your estimate, if required, you will outline additional roles required to support this process if the scope is deemed too large.

Desired Qualifications
• 7+ years in IT with direct, practical experience in CloudOps and SecOps within AWS.
• Demonstrable experience utilizing principles of least privilege operating in Windows and Linux environments.
• Knowledge of principals and implementation of Cloudflare Zero Trust network/VPN policies and associated configurations.
• Great written and verbal communicator. Able to translate complex concepts and tasks into practical targets and goals for a small team.

Nice to Have
• Experience supporting Trusted Partner Network implementations and Content Security Best Practices.
• Experience in VFX, post-production, or media-based pipeline environments.
• Knowledge of Amazon FSX Lustre and SMB file servers
• Knowledge of Google org administration and GCPW
• Knowledge of LDAP services/implementation
• Knowledge of Parsec remote desktop client API
• A dog or cat that you can wave around in front of the camera during company video calls.

Holy shit, just heard it from a correspondent on CNN right now who's been talking to FAA and ATC, and nearly spit out my drink.

EDIT: CNN just gave an update and said from directly on a crisis call it originated from Chicago and propagated out to affecting network routers at all the other ATC centers.

EDIT 2: Here's the official link:

Source: FAA told airlines that problem originated with network routers

"The Federal Aviation Administration told airlines the nationwide outages that prompted the ground stop were the result of a problem with network routers, according to an airline source.

The problem is believed to have started at Chicago Midway International Airport and cascaded nationwide.

Some airports are already reporting being saturated with flights on the ground that cannot take off."

https://www.cnn.com/2026/11/13/us/live-news/flights-ground-stop-faa#cmwfltd6o00053b6uiou9fzqs

It feels like a constant stream of new vulnerabilities and attack techniques often fueled by AI is emerging these days.

As an IT administrator, I find myself responding to these issues far more frequently than in previous years often having to handle urgent matters during weekends or after hours. How do you decide which vulnerabilities require immediate patching and which ones can wait? Do you primarily follow vendor recommendations, or do you use tools that validate these alerts against your actual operational environment?

I’m also curious: are there any specific sources of information that have helped you identify critical vulnerabilities before they escalate into major problems?

I imagine many of you are facing similar challenges I’d love to hear how you handle this.

* I apologize for not being clear. I would like to know if there is a specific category for vulnerabilities that require immediate action such as those for which patches must be applied right away and what procedures you have in place to handle vulnerability patching (for instance, whether all necessary patches are applied immediately as they arise).

I admin a saas PPM that is used by the entire enterprise, more than 10K active users.

It has a REST API and is fairly extensible. Historically, only developers in our org have requested API access which, for this product, requires creating a distinct API account not associated with the user. So we have, let's say, 40 of these API accounts that have accumulated over the past few years.

Our company is fairly generous with AI access and credits. What that has meant for this application is a huge influx of users who are now developing their own micro front ends or custom HTML dashboards to produce highly customized experiences. Which they love because generally speaking, no user has ever loved the out of the box experience.

Now that users can leverage AI to improve their experience with the app, we are getting hit up daily for API account requests. Hundreds of users are just vibe coding their own front end in Claude, which works great for them as a local artifact, but gets all of its data via the user’s locally auth’d MCP.

Once they realize that what they've built is not easily distributed, their AI gives them directions for how to request or procure the developer API access that will unblock them.

That's the point at which they contact my team and casually demand “oh yeah, just give me my API account now, thanks!” We get these requests almost hourly now. Sometimes this is for team-based development, and the user requesting this is working on something that they were told to develop by their manager. I have no interest in getting in the way of those use cases.

But 3 times out of 4, this is just an individual who thinks they are a superior product designer and become nearly belligerent if you dare to challenge the appropriateness of giving them developer roles or developer access when they themselves have never coded anything outside of an AI harness.

Is everyone getting hit up with these types of requests? How do you effectively say no to anyone? In our case, when we reject a request, the user escalates through their own management and emphasizes how we are not supporting the company's effort to use AI to do better work faster. Then we look like the asshole. Never mind the fact that these hundreds of users have never used the API and have no idea if what they're producing actually shows correct data or not while fragmenting the UX in such a way that the original app cannot even be recognized.

And of course, no one outside of my team cares that we're responsible for maintaining the documentation on these API accounts so that we understand exactly what every non-human account is doing, where it does it within the application, and which users or teams are responsible for maintaining the solutions it supports.

What are effective and appropriate barriers we can stand up so the application is only extended by knowledgeable individuals and without creating hundreds of throwaway API accounts that can never be removed from the system?

I'm wanting to make this post out of an interest as to what the future of system administration could look like with all the outages.

I want to start by highlighting the major outages the past few months:

- Azure West US went down in July

- The next day, AWS took out Apple Pay, DoorDash, Reddit and other platforms

- Google's new region in Melbourne fell over about a month after it launched

- PHP had a bug last month which impacted many things across the globe

- Microsoft's outage over the past few days

It feels like the answer from Managers to employee burnout is "use AI", whilst also cutting headcount because of AI.

As someone who isn't in the industry but does know a teeny weeny bit about it, I was wondering, what could the future of being a system admin look like?

Hi guys,

currently i'm working as junior linux sysadmin and managing about 50+ linux servers (different distros, services etc.). For every task i connect to servers with SSH and in my opinion its really inefficient. My main task is patching the servers and this would be great to implement ansible.

Do you have any recommendation about best practises with ansible? Like good articles, books, popular YouTube vids?

ps: its my first post 😄

"We regret that today’s outages caused disruptions for our customers, and we are working to address the issue," Charles Lamanna, Microsoft's executive vice president of Copilot, Agents, and Platform, said in a statement: https://www.windowslatest.com/2026/11/13/was-the-microsoft-365-outage-a-hack-microsoft-says-no-it-was-its-own-servers-and-its-copilot-boss-regrets-it/

We're hearing an apology from "Copilot EVP," not Outlook/Teams/MSFT 365 boss, makes me seriously wonder if everything is under Copilot umbrella now

Got a head scratcher for you.

1 of my 3 Idrac9 equipped servers just up and quit sending alerts automatically. Near as I remember, it happened around the time Google enforced Oauth, but switched them all to Smtp2go.

Test email: passes and received
Test Event: passes and received
Normal chatter on monthly patching reboots: Crickets

Alerts - e-mail is checked

Give me the off the wall stuff to look at, I’m fresh out of normal.

Migrate to what?

There's a reason Microsoft and Google run most businesses in the world. Outages and all, they're ridiculously reliable, and no-one else comes close on features and integration. You can hate the licensing, the never-finished products, the abysmal support. You can pine for the days of yore when we all ran domain controllers on workstations in broom closets. But bleat as you will, the product works and your business runs on it.

"Just self-host." Cool. Now you own uptime. Have a read about the French and South Korean governments who have both tried that. Maybe you're a hotshot who can design a better geo-resilient hosting architecture than a national government. Most orgs can't and won't, especially when the alternative is more reliable, more functional, and costs less.

The bigger problem is that once you leave the walled gardens, you lose the native integrations. I have a lawyer friend who used to spend days writing a single contract. Now Copilot drafts it in minutes, grounded in her firm's own client data in M365, and she spends maybe a few hours reviewing and polishing before it goes out.

Do you think her firm gives two hoots about a day of downtime once in a while when its people are several times more productive? Guess what: they don't. They'll bend over and pay for that juicy E7 uplift, and so will you. Sorry, but corporate is not swapping something that works for your homebrew MCP stack that couldn't draft a bedtime story for my four-year-old and costs more than the COTS product they already have.

So email your higher-ups. Post Microsoft poo memes in your Teams chats. Write your angry, low-effort venting posts on Reddit until you get it out of your system.

Then come back to work on Monday morning and open Outlook like everyone else. Because you're not going anywhere.

Over the last few weeks I gave my pet OSS thin client project a massive upgrade and changed its name: Say hi to ThinFloe.

ThinFloe is ubuntu based, can live entirely in ram, boot of a stick or from the network. It uses wayland as its graphics subsystem and it comes with a custom menu application written in rust. And it looks pretty stylish I think :)

Details on github: https://oposs.github.io/thinfloe Enjoy!

ps: if you wonder what oxulnk is, ask me :)

Anyone else getting the feeling that something else is actually going on here? Surely just another random coincidental bug happening to work its way into prod this week. Maybe their DB is stored in Outlook PSTs?

Link to SF Chronicle Article

Their page currently shows “all products are operational”. So, everything is good now? I haven’t experienced any issues in the past day now but last I checked they were still monitoring.

Friday the 13th, keep your guard up boys and girls..

I just went to a local site to drop a part off and someone in the office jokingly said to me that their computer just started running updates as if it was my fault

Upon closer Inspection on the dell micro there was a blue screen up that said updates were in progress, and to not shut the computer down

the font looked off, so I hit ctrl+alt+delete and noticed we were on a desktop with screen connect running, I immediately unplugged the network cable, the screen locked again sure enough they were connected with Wi-Fi as well, so I powered the machine down and removed the Wi-Fi card and rebooted to see what was going on..

After reboot, the ability to shut down restart or use task manager was removed by Group policy, apparently, after I unplugged the network cord they noticed and immediately started trying to lock the machine down while I was using it..

Reloaded the machine they were back up and running within 20 minutes with all of their data migrated..

I only wish I had time to clear userdata, clear credential manager, throw a wallpaper up with the middle finger on it and let them reconnect before i wiped it.

Stay vigilant.. they are

"Senior govt source tells me: We have preliminarily isolated the faults. They are equipment failures in the legacy system and we are validating."

Issue was with the L3 legacy network.

https://x.com/krisvancleave/status/2121396061600383130#m