r/SysAdminBlogs • • 35m ago

Standardizing Cisco UC DRS backup configuration across separate managed networks with PowerShell

2 Upvotes

Configuring a Cisco UC backup schedule is familiar work. The repetition gets tedious when you manage separate networks, each with its own local SFTP server (Windows -- OpenSSH), publisher addresses, credentials, and cluster topology.

I put together a PowerShell workflow to make that process more consistent. It uses reusable site profiles and includes:

  • Windows OpenSSH/SFTP setup with preview and explicit apply.

  • DRS configuration workflows for CUCM, Unity Connection, CER, and UCCX.

  • Node and feature registration checks, including CUCM environments with IM&P.

  • Optional Windows Credential Manager storage and per-run JSONL logs.

I wrote up my use case (MSP/Separated UC Deployments), the manual comparison, and the operating limits on my blog. The post includes the script, README, example inputs, and expandable code previews.

v1.6.1 is a testing candidate. Offline checks have passed; native Windows and live appliance qualification remain pending. The script configures backup destinations and schedules—it does not establish that a backup or restore will succeed.

Development and review included AI assistance to translate python scripts (deprecated) into an easy to use PowerShell script.

Full write-up and downloads on NOC Thoughts - https://nocthoughts.com/2026/11/14/standardizing-cisco-uc-backup-configuration-with-powershell.html


r/SysAdminBlogs • • 14h ago

Dev and Ops Facing AI: an asymmetric transformation

1 Upvotes

I wrote a short essay on how AI agents affect the nature of Dev and Ops work differently:

- for Devs, they change a core activity (writing the code)
- for Ops, they mostly add another layer to the automation and orchestration already in place.

By Ops I mean infrastructure and reliability work, closer to SRE or platform engineering than traditional sysadmin.

I’m currently Ops, previously Dev, and I’d like to hear how this matches what you see in practice, thanks !

https://cl3don.substack.com/p/dev-and-ops-facing-ai


r/SysAdminBlogs • • 1d ago

Script to collect the evidence for your M365 outage SLA claim

61 Upvotes

According to Service Health, EX1550543 ran 30 hours, which puts November at 95.8% uptime. That’s the 50% tier, but only on the Exchange Online share of your license, roughly $2 per user.

Microsoft won’t apply it automatically, and claims without the impact window and affected users per location get rejected.

The article covers how to file the claim directly or through a CSP, what Microsoft needs, and includes a script that collects the evidence and writes a claim summary. The deadline for the claim is December 31.

https://lazyadmin.nl/office-365/claim-microsoft-365-sla-credit/


r/SysAdminBlogs • • 1d ago

Linux High Load Average but Low CPU? A Practical NFS Troubleshooting Scenario

0 Upvotes

Hi everyone!

I've published a Linux troubleshooting walkthrough covering a scenario that can be confusing during production incidents.

The problem:

A Linux server has:

  • Increasing load average

  • Low CPU utilization

  • Slow application response

  • Multiple processes stuck in D state

  • An application dependent on an NFS mount

The article walks through the investigation, including:

  • Checking load average and CPU activity using uptime and vmstat

  • Identifying blocked processes and checking kernel wait channels

  • Investigating NFS mounts and network connectivity

  • Finding the root cause

  • Applying the resolution and discussing preventive measures

I have also included related interview questions at the end.

Read the complete walkthrough:

https://datadevblog.com/linux-high-load-average-low-cpu-troubleshooting/

I'd appreciate feedback from fellow sysadmins. If you've encountered a similar issue, I'd be interested to know how you diagnosed it and what tools helped you.


r/SysAdminBlogs • • 1d ago

Registering VBR and Provisioning Vault Repositories with the VSPC 9.2 API

Thumbnail
bcthomas.com
2 Upvotes

If you're onboarding customers to VDC Vault through VSPC, I've written up the second half of the API flow.

Part 1 covered creating the Vault tenant and storage vault through the VSPC 9.2 API. This one picks up from there. It registers the customer's VBR server with VDC, assigns the vault to it, creates the folder, and creates the repository inside VBR. There are curl and PowerShell examples for each call.

All of these endpoints are still in Preview Operations, so there are rough edges. A few that caught me out:

- Every POST comes back as a 202, so you have to poll the async action, and the result is only kept for about 5 minutes.

- A folder creation reported failed, but the folder had been created anyway.

- Lots of errors that aren't server faults come back as HTTP 520.

- A VBR 12.3 server can still be registered and have vaults assigned. It only fails when you browse folders, and the error doesn't mention the version.

https://bcthomas.com/2026/11/registering-vbr-and-provisioning-vault-repositories-with-the-vspc-9.2-api/


r/SysAdminBlogs • • 2d ago

No syslog during the outage = a stalled support case. I built a free syslog server to fix that part

3 Upvotes

I work escalations for network gear. The cases that stall the longest usually look the same: the outage happened, the device rebooted or rolled its buffer, and there's no syslog from the window that matters. Either nobody had a syslog server, or the one they had dropped messages and nobody knew. At that point the best anyone can do is "set up logging and wait for it to happen again", and the case just sits.

A lot of the time it's not that people don't know syslog. It's that the box available is a Windows server or a laptop, and standing up something reliable there takes longer than it should. Woodshed is my answer to that: MSI, pkg, deb, rpm or a portable zip. Listens on UDP and TCP 514 straight away. Plain text files per device per day, a disk budget it won't exceed, drop/refused counters shown in the UI, and an export zip with a manifest, SHA-256s and the gaps when it wasn't running, so the person on the other end of the case can trust it.

Most of the code was written with AI assistance. I did the design and ran the lab testing; the security review was a separate AI reviewer with read-only access to the code, and I went through every finding, decided the fixes and had them re-tested.

All the testing so far is lab traffic generated by my own sender (RFC 5424, RFC 3164 and bare lines, 8 source IPs). No real devices yet beyond a friend's homelab, which is in progress. It doesn't depend on any vendor's format and always keeps the raw line exactly as received, so any device that speaks syslog should work, but I haven't proven that.

What it's been through:

- release bench every tag: 10 min at 10k msg/s UDP on a 4 vCPU GitHub runner, 6,000,000 sent / 6,000,000 stored / 0 missing

- Ubuntu 24.04 (deb) and AlmaLinux 9 (rpm) VMs, 8 senders over a real network: 0 loss to 40k msg/s TCP at ~1/3 of a core and <50 MiB RSS. UDP loss above that was before the VM's NIC (interface counters), every datagram that arrived was stored

- reboot mid-stream: service back on its own, 2 UDP messages lost, export shows the 17-19 s gap as "Woodshed wasn't running"

- 24 h soak at 3,000 msg/s on the Linux VMs, 259.2M messages each: TCP exactly once, UDP lost 3-4 per million, all of it upstream of the VM

- security review before the first RC: 0 critical, 1 high (memory exhaustion from spoofed sources), 7 medium. fixed and re-tested twice

- CI install/upgrade/uninstall on Windows, macOS and Linux, x64 and ARM. checksums + `gh attestation verify` on releases

Limits, plainly:

- unsigned installers for now. SmartScreen ("Windows protected your PC", More info > Run anyway) and Gatekeeper (Privacy & Security > Open Anyway) ask once

- 1.0.0

- use the sender allowlist on untrusted segments. in my lab an open 514 on a shared /16 collected a stranger's syslog within minutes

- not a SIEM, no TLS syslog/alerts/forwarding yet

- Windows and macOS don't expose kernel UDP drops, the UI says so instead of showing 0

What I'd like to know:

  1. Which devices or formats break the parser? Redacted raw line please.

  2. What would you need to see before you'd drop this at a customer site during an outage?

  3. Windows folks, especially with endpoint protection: did it get flagged, did the firewall rules behave?

Repo: https://github.com/gmccollu/woodshed

Site: https://gmccollu.github.io/woodshed/

Releases: https://github.com/gmccollu/woodshed/releases


r/SysAdminBlogs • • 2d ago

Microsoft says the 365 outage spread because servers kept failing health checks. When do you let health checks fail open?

Thumbnail reddit.com
0 Upvotes

r/SysAdminBlogs • • 2d ago

eMudhra's RSA root is distrusted too, and InCommon schools have to move again

Thumbnail
certkit.io
3 Upvotes

r/SysAdminBlogs • • 2d ago

Hey, I hear you like Microsoft threads!

3 Upvotes

I don't post often, so bare with me, but I wanted to comment on something that I didn't see get a lot of traction. I happened to notice that Microsoft Visio has been quietly pulled and unavailable over the course of the last few days. It makes sense now, since I read it, along with Azure and like 1300 other items had been updated, many a CVE, unfortunately.

Though I am greatful that I remain mostly unaffected by this 365/Email issue, I'm pouring one out for my SysAdmin brothers who are having to live through this support hell. May we all find peace one day in the Great Tech Heap in the sky.


r/SysAdminBlogs • • 2d ago

Two Internet Providers Are Not a Resilience Strategy

Thumbnail
inwoodtech.com
0 Upvotes

One question I keep coming back to in technology operations is: what can our backups actually survive?

Two internet providers can share a conduit. A generator can start successfully while a small but essential network device remains without power. Two cloud services can depend on the same sign-in system.

After more than 20 years in broadcast technology and operations, I have learned to follow those dependencies through to what the business needs to deliver. A television channel can remain on air while the newsroom loses the ability to produce its next newscast. The equipment status alone does not tell the whole story.

I wrote an article for my site, Inwood Tech, exploring these issues across connectivity, power, and outside services. It also considers what happens after a successful failover: who recognizes that we are operating with less protection, how long we can sustain it, and who owns recovery.

The examples come from broadcasting, but I think the questions will be familiar to anyone responsible for keeping an operation running.

Full article: [https://www.inwoodtech.com/eden/resiliency

What shared dependency have you discovered during testing or an outage that changed your recovery plan?


r/SysAdminBlogs • • 2d ago

Powershell collection for IT Admins and not only

Thumbnail
reddit.com
1 Upvotes

r/SysAdminBlogs • • 2d ago

How are the Big20 surviving! With M365 service OUTAGE….

0 Upvotes

With the Subject! How are big20 surviving!

IT support guys! What are their reasons?

People share your thoughts!..


r/SysAdminBlogs • • 2d ago

ADSearch - User/Computer comparison tool

Thumbnail
reddit.com
1 Upvotes

I hope you guys like this more than they did in /PowerShell lol


r/SysAdminBlogs • • 3d ago

Cisco Webex Calling | Phone System (UCaaS) Review & Demo | I changed my mind.

Thumbnail
youtu.be
1 Upvotes

r/SysAdminBlogs • • 3d ago

Anyone else hunt Zombie accounts?

Thumbnail fabian.fyi
1 Upvotes

r/SysAdminBlogs • • 3d ago

After months of building, I finally launched my IT support SaaS. Now comes the hard part.

3 Upvotes

Hi everyone,

After months of evenings and weekends spent building, I finally launched my IT support SaaS platform.

Originally, I built it because I was learning IT support myself and wanted a single place for troubleshooting, playbooks, SOPs, commands, Microsoft 365 guidance, Active Directory workflows, and IT learning resources.

The platform is live, accounts work, subscriptions work, and payments are integrated.

What surprised me is that building the product was actually easier than figuring out how to get people to discover it.

For founders who have already been through this stage:

What was the biggest thing that helped you get your first real users?

I'd love to learn from your experience.

Thanks!


r/SysAdminBlogs • • 4d ago

Now its time - my new tool 'GSAClientDiagnosticsToolkit' is out!

Thumbnail
gallery
12 Upvotes

I work Global Secure Access, the Product Team at Microsoft too, and I use it every day. Over time I got tired of manually checking the same things whenever a client wouldn't connect (DNS issues, certificates, stale forwarding profiles, proxies...). So what did I do? 🤔

I built a PowerShell module that runs them all in one go ofc! And the nice part is it's open source, Windows PowerShell 5.1+ (Windows only for now), but who knows whats come later 😉

And to be fair, this is not a weekend project. It is a collection of checks I have built up over time - on and off for almost a year - every time I (or someone in the community) ran into a new GSA problem and thought "this should be a check".
Original it started as a single connectivity script, and has since been converted to a proper module with a `Public`/`Private` structure, a Pester test suite, and 35 exported functions - all orchestrated by one command:

Invoke-GSAClientConnectivityCheck

And the good part is, it's open source and build in PowerShell!

What it can do:
> `Invoke-GSAClientConnectivityCheck` runs everything and prints a pass/warn/fail summary
> Local checks: service health, Entra device/PRT status, cached forwarding profile (registry + timestamp), proxy detection, Secure DNS, IPv6, event log, DNS/TLS/mTLS to the edge
> Private Access: checks whether a target FQDN/IP + port + protocol is allowed by the cached profile, and whether it actually goes through the tunnel (synthetic 6.6.x.x + private DNS resolver) and assignments
> mTLS auth certificate: check, backup, and a guarded repair (always backs up first and needs two confirmations before deleting)
> Graph-based tenant checks: forwarding profile assignment, Private Access app segments, and Intelligent Local Access private networks with public probe FQDNs/DNS servers. That last one can make GSA bypass Private Access traffic for users who were never on the corporate network
> Real-world edge cases: Cisco VPN split-DNS REFUSED lookups, home subnets overlapping Private Access IP rules, hosts-file overrides of the tenant DNS names
> It also lists the GSA service principals you should exclude in App Protection policies and checks whether they exist in your tenant
> ...and more. 35 exported functions, Pester tests, and every check can run on its own!

How to install you may think? 🤔

Install-Module GSAClientDiagnosticsToolkit -Scope CurrentUser -AllowPrerelease

or clone it from GitHub.

It's a pre-release, so I'd like to hear:

  1. What GSA problems have you hit that a check like this should catch?

  2. Anything that gives false positives in your environment?

GitHub: michaelmsonne/GSAClientDiagnosticsToolkit: A PowerShell module that runs connectivity, proxy, health probe, mTLS diagnostic checks for the Microsoft Global Secure Access (GSA) Client, validate Service Principals and more!

Write-up with screenshots and more can you find on my blog: GSAClientDiagnosticsToolkit is here: a PowerShell module to find out why Global Secure Access isn't working on your device · Michael Morten Sonne | Microsoft MVP

(Disclosure: I'm the author. It's a free community project, not a Microsoft-supported tool)

#Microsoft #MVP #MVPBuzz #GSA #Community #Identity


r/SysAdminBlogs • • 3d ago

Centralized BIOS Password Management and Automatic Rotation for Dell & HP Devices.

Thumbnail reddit.com
1 Upvotes

r/SysAdminBlogs • • 4d ago

Microsoft turns on Claude in Copilot for every EU tenant on December 9

13 Upvotes

Claude in Copilot has been off by default in the EU because it was processed outside the EU Data Boundary. That changes in December, and on December 9 Microsoft enables it for all users (MC1546438).

Only allowed Claude in Word, Excel and PowerPoint? That option is retired, so you move to All users as well.

https://lazyadmin.nl/office-365/claude-in-microsoft-copilot-enabled-by-default-for-eu-tenants/


r/SysAdminBlogs • • 4d ago

Omada launched cameras today, license-free and managed from the same gateway as your network

3 Upvotes

Until now, adding cameras usually meant another app, another recorder, and often another subscription. Omada Guard runs on the new Fusion Pro gateways, next to your network, and it’s license-free. I tested the 8MP camera kit with the NVR for two weeks.

Read the full review: https://lazyadmin.nl/home-network/omada-guard-review-and-setup-guide/


r/SysAdminBlogs • • 4d ago

Helper GUI tool for nssm lovers

1 Upvotes

I created a Helper GUI tool for nssm lovers.
https://github.com/muath-ye/nssm-services-manager/releases
Star it on GitHub or curse it here.


r/SysAdminBlogs • • 4d ago

Building a Free Interactive Training Hub for Tier-1 Helpdesk Onboarding – Looking for Feedback from Admins

1 Upvotes

Hey Sysadmins,

I am currently working on a community-focused learning project aimed at solving a common pain point: the time-consuming onboarding process for junior Tier-1 helpdesk technicians.

When juniors start out, they often struggle with understanding the syntax and risks of PowerShell commands for M365, Entra ID, or Exchange under pressure.

To help them practice safely, I built a 100% free interactive workspace: https://itsupportworkspace.com

Key Features built so far:

• Interactive IT Support Incident Playbooks & Simulators

• 120+ structured Command Cheat Sheets (M365, AD, Entra ID)

• "AI Marc" – an integrated Google AI mentor that actively breaks down script parameters and flags high-risk commands before juniors execute them on live production tenants.

The moderators over at r/sysadmin kindly redirected me here to gather feedback from experienced product owners and administrators.

I would love to get your insights:

  1. What practical scripting or troubleshooting skills are your new IT technicians most often missing when they join?

  2. What specific scenario playbooks should I prioritize adding next to improve their real-world readiness?

Check out the project here: https://itsupportworkspace.com


r/SysAdminBlogs • • 5d ago

GoTo Connect Call Center Software Review & Demo | Automotive & Healthcare Niche

Thumbnail
youtu.be
1 Upvotes

r/SysAdminBlogs • • 5d ago

Tired of patching NetScaler every time a new CVE or KEV drops? Live walkthrough Nov 19

Post image
0 Upvotes