There’s a widely held belief about progress and innovation that we, as a society, often assume. The story goes that as time moves forward, we find better solutions to common problems, and those new methods supersede the old ones. As humans, we’ve evolved from primitive solutions to more advanced technologies, like transitioning from steam engines to electric trains, or from propeller planes to jets. While I jest about the idea of square wheels, the concept holds true: better solutions replace the old.
So, when something fades into obscurity or is no longer prominently discussed, the natural conclusion is that it’s been superseded by something newer, better. This line of thinking seems logical, but what if it isn’t always true?
The Case of Power Query and Relational Databases
Recently, in a LinkedIn discussion, Andrew Moss and I explored why Power Query, an ETL (Extract, Transform, Load) tool, has dominated social media discussions about Excel, while Excel’s ability to connect with relational databases has been conspicuously absent. Despite the fact that Excel’s synergy with relational databases is far more relevant and practical for enterprise-level processes, it remains underappreciated. So, why the discrepancy?
Andrew’s response was profound: people assume that Power Query has replaced the need for relational database connectivity. But this couldn’t be further from the truth. Power Query serves a different purpose altogether—it’s a tool for extracting, transforming, and loading data, offering convenience for ad hoc tasks but lacking the robustness and efficiency that relational databases provide in real-world enterprise scenarios.
Marketing and the Shift in Excel’s Evolution
In the late 1990s, Microsoft emphasized the limitless potential of Excel. Excel’s ability to connect with databases like Access, SQL Server, and Oracle was a game-changer, offering unparalleled power for enterprise solutions. But fast-forward to the last decade, and the focus has shifted dramatically. A new generation of Excel users has emerged—one that isn’t interested in Excel’s enterprise capabilities but is instead driven by social media engagement and trends.
Microsoft’s marketing teams, aware of this demographic shift, began to cater to this new audience. Features like Power Query, dynamic arrays, XLOOKUP, and others were introduced—not necessarily to solve real-world business problems, but to appeal to a non-technical, social media-savvy audience. This demographic didn’t approach Excel with the intent of building scalable, enterprise-level solutions; instead, they sought flashy, shareable content that could go viral.
This focus on appealing to social media influencers has led to the sidelining of Excel’s more powerful, enterprise-ready features—particularly its ability to synergize with relational databases. Features that require more technical understanding, like ADO (ActiveX Data Objects), which allows Excel to connect with external databases seamlessly, have been pushed aside. They don’t lend themselves to viral content, so they’ve been forgotten.
The Opportunity of “Beyond Power Query”
Here lies the curious case: Power Query has not superseded Excel’s ability to connect with relational databases. Rather, it has been promoted and packaged to appeal to a new audience that is less interested in enterprise solutions and more interested in content creation. This shift doesn’t signal an improvement or replacement; it’s simply a change in focus driven by marketing, not technological progress.
For those of us working at the enterprise level, the real power lies in going beyond Power Query. While Power Query and similar tools have their place, they are limited in scope, particularly for those looking to build scalable, process-driven architectures like the hub-and-spoke model. Relational databases, on the other hand, provide the centralization and bi-directional data flow necessary for real-world business operations. These databases are designed for longevity and scalability, qualities that Power Query lacks by design.
Moving Forward
The future of Excel isn’t about following the shiny new tools designed for social media. It’s about leveraging the full power of what Excel can do—connecting with relational databases, automating processes, and creating scalable solutions that solve real business problems.
For those willing to look beyond the surface, the potential is immense. As I’ve demonstrated in my own career, adopting these methodologies early on—what I now call “beyond Power Query”—can lead to transformative results. I applied these strategies before Power Query even existed, and they have consistently delivered significant value for my clients. In fact, my pay was tripled as a result.
Now, the mission is to evangelize this next step—beyond Power Query—and to show the world what Excel is truly capable of in the enterprise. While the social media narrative will continue to push new, flashy features, the real opportunity lies in going deeper, in understanding that what’s been forgotten or overlooked may still hold the key to real progress.
In the enterprise context, we need robust, centralized solutions. And while Power Query, dynamic arrays, and XLOOKUP have their roles, they are not replacements for the enterprise-level systems that Excel has long been capable of supporting. It’s time to bring these capabilities back into focus and show the world what can be achieved by going beyond Power Query.
This is where the future lies for those willing to take that leap. The rewards are phenomenal for those who embrace it—just as I have experienced firsthand.
This is a podcast by Hiran de Silva. Narrated by Charlie.
Add comment