Back to Summary
Beyond Coding

Google & AWS Veteran: What Top Tier Software Architects Do Differently

6 min read

What Top-Tier Software Architects Do Differently, with Gregor Hohpe

What actually separates a great software architect from a mediocre one? It isn't the number of patterns they can name or the buzzwords they can deploy. On the Beyond Coding podcast, host Patrick Akil sat down with Gregor Hohpe — a veteran of Silicon Valley, big enterprises, and vendors like AWS — for a conversation that reframes the entire role. The short version: the best architects don't hand down answers, they make everyone around them smarter.

Everything below reflects what Gregor said in the episode.

Amplifiers, Not Oracles

Gregor's opening move was to define the role by its failure mode. Bad architects are easy to spot: they spew buzzwords ("everything must be cloud native and loosely coupled"), and they hoard decision power, acting as a checkpoint developers must clear. Good architects are harder to identify precisely because, around them, "everything magically goes well and nobody knows exactly why."

His mantra: an architect shouldn't try to be the smartest person in the room, but should make everybody else smarter — an amplifier, not an oracle. When people bring him their problems, his instinct isn't to solve them but to absorb the context, surface blind spots, and distill the trade-offs they're making implicitly. It's their application; his job is to help them make a better decision, not to make the decision for them.

Architecture as Risk Management

Press on what architects are actually for, and Gregor's answer is risk. You could cobble an application together without an architect and maybe it works, maybe it scales, maybe it has no security holes — but that's a risky proposition. Architects anticipate and mitigate those risks, and since lower risk equals lower cost, that's money in the bank.

Crucially, he warned against the narrow view of risk common in traditional enterprises and banks, where a perfect plan is equated with low risk. That only addresses execution risk — did we build what we said we would? Software carries a whole different set of risks: will users like it, will it move the business needle, will it grow market share? Which risks an organization focuses on, he noted, shapes how its architects behave.

Simple, But Not Simpler Than Reality

Gregor is a strong advocate for simplicity — but a careful one. Distributed systems have inherent complexity: retries, timeouts, idempotency, back-pressure, retry storms. "There's lots of physics," he said; you can't cheat your way out. At AWS, product designers always wanted things simpler, and his answer was that you can only go so far before you're hiding complexity that genuinely exists.

His guideline: make it as simple as possible but no simpler, and where complexity is inherent, make it intuitive to deal with rather than pretending it's absent. The stakes are real. Too much complexity drives up cognitive load, people make mistakes, changes in one place break things in another, and eventually you get software nobody dares touch — which is just another word for legacy.

Mapping the Map

One of the most useful ideas was about how architects run a discussion. Gregor's "circle versus triangle" image captures it: two people describe the same cylinder, one seeing a circle, the other a rectangle, and they argue forever because they're looking from different angles. Engineers do this constantly — JSON versus YAML, Kubernetes versus everything — attaching themselves to a technology without agreeing on the underlying map.

So before debating, he frames the solution space. Take microservices: he breaks it into design-time modularity and runtime modularity, which yields four quadrants instead of a false binary — and that's exactly where the modular monolith lives. He calls this "mapping the map." Agree on the coordinate system first, then argue about which quadrant fits. The disagreement becomes constructive because everyone shares the same world map.

Drawing, Storytelling, and the Multiplier

Gregor is a committed analog thinker — flip charts, pen and paper — because a diagram can't be as fuzzy as words. "Two boxes, either there's a line or there's no line." He described roughly twenty dimensions you can express with two pens (size, shape, shading, nesting, ordering) and a constant "ping-pong" between structured left-brain logic and creative right-brain pattern-spotting.

This feeds his bigger point about skills: don't aim to be a good engineer plus a good communicator, aim for the intersection — a technical storyteller. He calls it the "architect elevator." You ride into the executive penthouse with a catchy visual or story (he even names them, like the "IT Strategy Ladder," to make them stick), but you can defend every line of it technically when someone pokes. You can't split that across two people; the model and its expression have to live in one head. His Phantom Sketch Artist metaphor drives it home: like a police sketch artist, the architect often knows less than the team about their own system but has the skill to help them express it — and "that's wrong" is a wonderful response, because now you're in dialog.

Staying Sharp, Spending Capital, and the AI Test

Two warnings stood out. First, heuristics expire. A decision that was right a decade ago can quietly become wrong, which makes seasoned architects "well-meaning but dangerous." His example: the reflex that everything must scale out, when Moore's Law has outrun most businesses and many applications could run on a single server. The fix isn't going hands-on with everything — impossible — but maintaining a trusted network. He got his generative-AI catch-up as a two-day "full download" from a friend, not from social media, which he considers a poor source.

Second, political capital. Architects have little direct power but high influence — like a court jester, trusted because they have no hidden agenda. You earn capital by delivering and being transparent, then spend it deliberately on the one fight worth having, not in skirmishes everywhere. And you sleep at night accepting that nothing will be perfect.

He closed on judgment itself. Architecture isn't good or bad, it's suitable — even the "big ball of mud" has virtues (quick, cheap, low skill required). A real review examines the thought process and whether trade-offs matched the business need. In the AI era this matters more, not less: executives rarely catch a technical error but instantly smell a gap in reasoning. Paste raw model output into an architecture doc and you can only lose. Use the tool as a starting point you add value on top of — "be on top of the tool," not its substitute.

His final encouragement was for the people doing this work: don't stumble on the finish line. If you cut through the noise and the answer suddenly looks obvious, that's not a failure — that's exactly what success looks like.


Originally published on Beyond Coding. Watch the full episode: https://www.youtube.com/watch?v=F8X9_Dp3ZUk