July 16th, 2024

Devs need system design tools, not diagramming tools

The New Stack website provides resources on software engineering, emphasizing system design tools for developers. It covers various topics like AI, security, and trends in software development, offering insights and resources for the community.

Read original articleLink Icon
SolutionsToolsFrustration
Devs need system design tools, not diagramming tools

The article discusses the need for system design tools over diagramming tools for developers. It emphasizes the importance of tools that can assist in designing complex systems effectively. The New Stack website offers resources and news related to software engineering, aiming to keep developers informed about at-scale software development. The site provides content on various topics such as architecture, engineering, operations, AI, security, and more. It also covers trends like open source, cloud native ecosystem, containers, microservices, and edge computing. Additionally, the website features articles on optimizing PyTorch for faster model training, open source AI, Kubernetes autoscaling, and cloud reliability. Readers can find insights on topics like AI-assisted coding, AI-powered development, and leveraging data in large language models. The platform offers a range of resources including podcasts, ebooks, events, newsletters, and RSS feeds to cater to the software engineering community's diverse interests and needs.

Related

Software Engineering Practices (2022)

Software Engineering Practices (2022)

Gergely Orosz sparked a Twitter discussion on software engineering practices. Simon Willison elaborated on key practices in a blog post, emphasizing documentation, test data creation, database migrations, templates, code formatting, environment setup automation, and preview environments. Willison highlights the productivity and quality benefits of investing in these practices and recommends tools like Docker, Gitpod, and Codespaces for implementation.

Maximizing Terraform modules for platform engineering

Maximizing Terraform modules for platform engineering

The New Stack website focuses on Terraform modules, community engagement, DevSec challenges, software development topics, and industry trends. It offers resources, articles, and newsletters for software engineering leaders and developers.

Bad habits that stop engineering teams from high-performance

Bad habits that stop engineering teams from high-performance

Engineering teams face hindering bad habits affecting performance. Importance of observability in software development stressed, including Elastic's OpenTelemetry role. CI/CD practices, cloud-native tech updates, data management solutions, mobile testing advancements, API tools, DevSecOps, and team culture discussed.

DevOps Isn't Dead, but It's Not in Great Health Either

DevOps Isn't Dead, but It's Not in Great Health Either

DevOps faces challenges but remains relevant. The New Stack provides resources on software engineering, DevSec collaboration, and various tech topics. Subscribers receive tailored content and updates on software development trends.

Java's James Gosling on Fame, Freedom, Failure Modes and Fun (2023)

Java's James Gosling on Fame, Freedom, Failure Modes and Fun (2023)

The article covers software development, technology trends, open-source projects, cloud computing, AI, security, distributed ledgers, containerized apps, edge computing, AI deployments, DevSec challenges, AI transformation, and transparency in AI development.

AI: What people are saying
The comments on the article about system design tools for developers highlight several key points and common themes:
  • Many commenters emphasize the importance of using specialized tools like the C4 model, Structurizr, and PlantUML for effective system design and diagramming.
  • There is a recurring sentiment that current agile methodologies often neglect proper analysis and design, leading to poorly planned projects.
  • Some users express frustration with the lack of proposed solutions in the article, seeking more concrete alternatives and answers.
  • Several comments discuss the need for better communication tools that can bridge the gap between technical and non-technical stakeholders.
  • Historical perspectives on system design methodologies, such as PRIDE, are mentioned as examples of comprehensive approaches that modern tools could learn from.
Link Icon 23 comments
By @bunsenhoneydew - 4 months
As others have said the C4 model is a great way to address a number of these issues.

I can’t find the right video at the moment but Simon Brown (creator of C4) gives a great talk about creating his DSL, Structurizr, for C4, which he developed during COVID lockdown (if memory serves). There are many videos on YouTube of Simon talking about “C4 Models as Code” so I’m sure any one of those will suffice.

The focus is on creating the model of your system architecture, from which the diagrams you extract are a specific projection of that model. Rather than a diagram be the main artifact. It’s a simple but very powerful concept that I’m always surprised isn’t more widely used.

Structurizr models can also be exported to display as ilograph diagrams, mermaid diagrams and more. Also very much worth a mention is icepanel, a lovely tool for architectural model that implements the C4 model heavily.

I saw Simon talk at a conference in Sydney about 10-15 years ago and heard about C4 for the first time in that talk, it’s been one of the most influential talks I’ve been to in my career as it made a lot of fuzzy things in my head all start to come together in a way that just made sense.

https://c4model.com/

https://structurizr.com/

https://www.ilograph.com/

https://mermaid.js.org/

https://icepanel.io/

By @jawns - 4 months
This reminds me of the following:

* Devs: We need a better language than Javascript as the lingua franca of the web!

* Users: Sure, use whatever language you want -- just make sure it compiles to Javascript, which is already the lingua franca of the web.

Keep in mind that the consumers of technical diagrams are often non-technical folks. And they don't care about how they get their diagrams. They just want to be able to understand, at a high level, what's going on in the black box.

You can either convince every single one of them that devs need to focus on better system design tools ... or you can continue to give them the diagrams they want, just using a smarter process to generate them.

Or you can treat them as entirely separate problems, because fundamentally system design tools are building tools, and system diagrams are communication tools. In most cases you can improve them independently.

By @yuliyp - 4 months
It's not so hard to do static and tracing-based analysis to capture all the calls that various systems make between themselves. Similarly, it's not so hard to graph all of the metrics of a system.

That's not really all that useful. Diagrams, like other forms of documentation, are a format for communicating something to the reader. It means that they should spend more space on the important flows rather than the exceptional ones. They'll explain the meaningful parts of a sequence rather than just giving a series of function calls. The various tools we have for doing this (boxes showing what systems talk to what, sequence diagrams, database schema diagrams) provide a rich enough language for that communication.

Death star diagrams are bad because they spend a bunch of time and effort to convey one piece of information: "there are a lot of systems here" rather than anything actually useful for someone attempting to navigate a specific part of the system.

By @steve1977 - 4 months
I think at least part of the problem is that todays "agile" methodologies lure people into almost completely neglecting analysis and design, as if these steps are forbidden in agile. So for many dev teams I have seen, agile basically means "we have no plan".
By @gtirloni - 4 months
I read the whole article and it has great points. Almost nodded the whole time. However, I couldn't identify whether an alternative exists today.
By @RcouF1uZ4gsC - 4 months
>Today, we have the technology and knowledge to create tools that prevent developers from wasting valuable development time deciphering static, outdated diagrams,

One issue is that diagrams in general are pretty universal. As long as your tool can makes shapes and connect them, you can use it for any kind of architecture. For example it will work flow charts for 50 year old Fortran to UML from the 90s to microservices diagrams from now and I bet to whatever is common 50 years from now.

By @tomjohnson3 - 4 months
Thank you everyone for reading my article! I’m the author, Thomas Johnson. This article stems from my frustration with the typical approach of asking, “What diagramming tool should we use?” instead of addressing the root problem: the need for up-to-date, easily accessible system architecture information. That’s why I co-founded Multiplayer. We focus on automating the creation and maintenance of system architecture diagrams and creating a single source of truth for system information. This includes your individual components, APIs, dependencies, and repositories.

We’re language and environment agnostic and you can start with a napkin sketch or a photo of your whiteboard. And this is just the start, we have many plans for how to evolve system design tooling including supporting popular integrations and models like C4.

It’s early days for us. I’d love to hear what you think: https://www.multiplayer.app/ (It’s free!)

By @dennisy - 4 months
Great post but lacking an answer. I guess we are yet to find one!
By @airbreather - 4 months
There is a potentially interesting standard many may not know - IEC 61499 - Standard for Distributed Automation, first ed 2005!!! and related to PLC type controllers.

It was meant to be the next step forward from IEC 61131 that described the five PLC control languages, but far ahead of it's time.

61499 introduced the concept of an executable specification, and went on develop tie ins with XML and OPC. The executable specification is a particularly interesting idea, effectively emerging as no code these days

But two decades on is still only starting to get traction, seemingly because it was so far ahead of it's time, and the target audience was potentially mostly only just branching out into software because they were now programming ladder logic, instead of designing panel boards with hundred of relays and timers.

But, it is worth a look for some ideas in the space, particularly the executable specification concept (you know this can only lead to a DSL of some kind), but also including their diagramming that looks a lot like UML but maybe works better, along with 4Diac software package, consideration of how some of the more esoteric aspects of OPC fit into all this, and more slightly obliquely, TLA+.

By @bitwize - 4 months
In 1971, M. Bryce and Associates marketed PRIDE, the first commercial software methodology for general business use. It was originally an entirely manual process using paper forms, but it was already far more comprehensive than anything called a "methodology" we use today. For example, in PRIDE, every artifact of the systems design and implementation process -- each high-level requirement, each software module, each database table and column, and more -- is assigned a tracking number and extensively documented as to its purpose in a unified knowledge repository. This was decades before Git or JIRA, and at first it was all done by hand, but not for long.

In the 80s, they marketed PRIDE/ASDM, which combines PRIDE with Automated Systems Design Methodology, a suite of system design tools written in COBOL for mainframes. Far from being mere diagramming tools, they assisted in all aspects of an information systems design from initial requirements down through coding and database management. A key component of ASDM was the Information Resource Manager (IRM), a searchable central database of all of the information artifacts described above along with their documentation. Another component was Automated Instructional Materials (AIM), the online documentation facility, which not only provided instructions on how to use the system, it also provided step-by-step directions (called "playscripts" in PRIDE-speak) for each member of the development team to follow, in order to see a business system through from abstract design down to software implementation and deployment. Provided the directions were followed, it was next to impossible to screw up a system or subsystem implemented through PRIDE/ASDM.

This level of comprehensiveness and clarity is the gold standard for business IS development. And it seems to be nearly lost to time.

By @ranger_danger - 4 months
I feel like https://plantuml.com/ gets close to what I want by being able to make diagrams with code, but for system design what I really want is to be able to have diagrams generated directly from the code itself, maybe with some extra comments/annotations that help it along.

Does anything like that exist already?

By @canterburry - 4 months
We have the tools and ways to express architecture. The problem is no one is bothering to actually learn it and do it well.

Everyone seems to look for answers involving not having to spend any time learning anything new.

UML, BPMN, 4+1 view, it can do it all. Just learn it and make sure everyone else in your team does too.

By @danjl - 4 months
Google Slides and Drawings (under + > More...) are great tools. They support the diagramming objects, connectors, shared collaboration, and integration with the other Google Doc tools. They also have great history and diff tools as well as team comments, with actions.
By @agumonkey - 4 months
I wonder if modeling/system design people didn't have new insights since the last 20 years (when Model Driven * started to sink).

Languages changed a bit, more types, more concurrency, more functional idioms. Yet I feel we're not going anywhere.

By @kmerroll - 4 months
To take this a different way, Devs need AI-driven system design tools, not diagramming tools. The work to automate the process to define, code, deploy, and document tech/app solutions using GenAI is arguably well underway and the days of humans producing layers of boxes and arrows documentation is thankfully numbered.

More directly, the need for the special snowflakes and the ensuing complex system design processes will be reduced as we drive towards more automation N(A) frameworks.

By @SrslyJosh - 4 months
This would be more interesting if there was actually a proposed solution.
By @webprofusion - 4 months
If we had a complete and evolving set of requirements for any reasonably complex system, we wouldn't really read them once they no longer match the system we have delivered.

Systems and requirements go hand in hand but the reality is requirements are eventually codified, and after a point only the system matters because the system is the reality and the requirements were just the formal inspiration.

I would love to see automated requirement analysis and verification from code.

By @digger495 - 4 months
This is a useless and insipid editorial. I don't want the problem redeclared. We know this. We want solutions.
By @Veuxdo - 4 months
You need to use diagramming tools that are meant for complex systems. Almost all of the complaints in this article are caused be using generic drag-and-drop diagramming tools.
By @port19 - 4 months
No, I need a diagramming tool. Excalidraw lives on
By @qwerty456127 - 4 months
Also GUI design tools like the WinForms designer but for more modern toolkits please. VB/Delphi/WinForms were such a joy to design and XAMl (let alone web frontent) is such a pain to write.