No Stupid Questions

Sorry this doesn't explain anything, cause I think others have already put in the work. At my old job, there was a slack icon for "Is it DNS?" because it's often DNS. You already know and that's why you asked, but I'm just reinforcing that this is how common it is.

There’s even a haiku:

It’s not DNS
There’s no way it’s DNS
It was DNS

In addition to the other comments which more directly address your question, DNS has been / can be used to exfiltrate data from "secure" networks. Search "dns data exfiltration" in your favourite search engine and you'll get several high quality articles. Typical mitigations might be to limit which DNS servers your network can contact, restrict packet sizes to the bare minimum which valid use would have and so forth.

Because so few understand it and so many things use it.

If you read a guide on setting up a website. They might have you change a DNS record and you might not realize it's doing something else. Web developers frequently want to make changes to DNS and will change the name servers away to theirs but not migrate any of the records for anything besides the website. They'll break EVERYTHING but hey, the website will load.

If you read a guide on connecting some service like hubspot. They will have you add spf records. But those need to be included with the existing ones and not just replacing what's already there. Mess it up and every single email you send will get sent to spam folders.

I can speak to Windows DNS and AD.

Yes, the basis of DNS is to match IP addresses with hostnames. But there are plenty of other kinds of DNS records. SPF, DKIM, DMARC use DNS for email validation; AD uses SRV records to point clients to find domain resources. There are also reverse zones, where you send a query for an IP address to learn the hostname(s) associated with it. There are CNAME records that associate a hostname with whatever IP address another hostname is using.

Point being, there are a lot of different interconnected layers, and if some entry is wrong, it can easily have a cascading effect that creates a problem with something entirely different.

I would also extend the "It's always DNS" trope to "It's always name resolution." In a Windows environment, at least, DNS name resolution is only used when a FQDN (fully qualified domain name) is being queried. If your application is only looking for [ServerName], NetBIOS name resolution is used.

When NetBIOS name resolution is used, that is querying a WINS server (if one is specified and exists). In the absence of a WINS server, the query is sent to the "master browser" on your network segment. What machine is the "master browser"? By default, all machines on a network segment (subnet) have a browser election behind the scenes to choose the master browser, based in large part on the machines' hardware capabilities.

This means that any machine on the segment (again, by default) can become the master browser and respond to NetBIOS queries. Laptop, desktop, server, doesn't matter. There are registry entries that can be manipulated to have manual control over what machine is master browser, what machines are and are not allowed to participate in elections, but it is rare that those are configured.

Why do I know all this? Because about 25 years ago, I came across a situation where different machines were configured with different overlapping subnet masks, and users were trying to browse \\servername\share, and getting only partial results. It took a long time to narrow that down to the misconfigured subnet masks. At the company I'm currently at, the developers still use NetBIOS names instead of FQDNs in applications.

Always use FQDNs in any in-house development. Always use FQDNs when accessing resources by hostname. And if "some weird, inexplicable, possibly intermittent issue" is happening, check name resolution.

100% of the internet depends on it, and 90% of technical people can't be bothered to learn how it works and understand it. Partly because they only touch it once every 5 years. They get what they need done but don't understand why it worked, so it ends up feeling like black magic to them.

What's an example of a joke? Because that's not what I experienced... In my world people make similar jokes if you mess up any aspect of networking. Same if you break the routing. Or mess up the servers, replication or virtualization infrastructure. DNS is one aspect and people will crack a similar amount of jokes as they do with any other f...-up. (It's a way to cope with a stressful day or whatever. Or to get some relief.)

When it is the cause of a problem it's not always obvious at first so you spend hours troubleshooting the broken app until you look at DNS and a simple DNS issue

Because it's a fucking unauthoritative clown show that is necessarily decentralized which leads to all sorts of difficult to diagnose (and sometimes impossible to quickly fix) issues.

It's like 100% footguns.

Only a support tech chiming in, so far I've found when it goes wrong, it causes errors or behaviours that are unusual and could be hard to trace back. Clients might be confused as to why their laptop isn't connecting to some services but their co-worker still can.

I've currently got an infuriating issue where the DNS on my modem just dies at seemingly random intervals. I set up a monitor using Uptime Kuma to let me know when it goes down, and ever since it just hasn't been a problem yet so I have no idea why it's going down. I might just set up a pihole and just work around the problem.

Might be related to long TTL on DNS entries making it hard to connect one failure to a thing you changed days ago.