Declarative Design, Assistance by Convention: Evaluating Multi-Agent Frameworks for AI

We evaluated multi-agent frameworks: Agno leads with 0.55, DSPy only 0.07. Learn why convention, not declarative design, drives AI assistance.

miércoles, 15 de julio de 2026 • 4 min read • Q2BSTUDIO Team

Convention, not declarative design, drives AI assistance

In the fast-paced ecosystem of artificial intelligence development, the emergence of multi-agent frameworks has promised to simplify the creation of complex systems based on language models. However, reality shows that not all frameworks offer the same level of productivity when integrated with AI-based coding assistants. A recent academic study has raised a fundamental question: what makes a framework really 'assistible' by artificial intelligence? The answer, far from obvious, defies the intuition that declarative design automatically ensures better collaboration with generative AI tools.

The research, which analyzes ten different multi-agent frameworks using the same agent logic and a novel reference task (mapping relational database schemas to semantic roles), reveals that the determining factor is not the declarativity of the design, but the alignment with established conventions. Frameworks that follow canonical patterns and APIs familiar to developers score significantly higher on combined metrics of structural alignment and functional correctness. Conversely, those that introduce novel abstractions, even if they are declaratively purer, fail miserably because the underlying language models have not been trained with sufficient examples of that style of coding.

This finding has profound implications for companies looking to adopt AI agents into their workflows. It's not just about choosing a framework with an elegant syntax; the key is to select tools that maximize 'assistibility', i.e. the ability of a human developer supported by AI to generate correct and specific code for the framework efficiently. In this context, Q2BSTUDIO's experience as a company specializing in artificial intelligence for companies has shown us that the real competitive advantage does not lie in the latest technology, but in the one that best integrates with the current capabilities of AI assistants.

To understand the magnitude of this phenomenon, let's imagine a development team that decides to implement a multi-agent system to automate business processes. If the chosen framework uses a syntax far removed from popular standards (e.g., function calls with unintuitive names or unconventional data structures), the AI assistant will have difficulty predicting and suggesting the correct code. This translates into more remediation iterations, lower productivity, and ultimately longer development time. Conversely, a framework that follows patterns that are widely documented in the language model training data will allow the developer to achieve functional correctness in far fewer attempts.

The research quantifies this difference with a composite metric that combines structural alignment (how well the framework conforms to common conventions) with the first-to-first execution success rate (pass@1). The results are eloquent: while the best-positioned framework achieves a score of 0.55, the most declarative obtains only 0.07. This shows that simple declarativity is not enough; familiarity and convention are the real drivers of effective AI assistance.

From a business perspective, this finding suggests that organizations should prioritize evaluating multi-agent frameworks not only for their theoretical capabilities, but for their adaptability to available AI tools. In Q2BSTUDIO, where we develop custom applications and custom software, we have observed that the choice of an AI framework must also consider the maturity of its ecosystem, the number of examples in public repositories, and the consistency with widely accepted design patterns. It's not about giving up on innovation, it's about balancing it with the practicality demanded by deadlines and code quality.

Cybersecurity also plays a role in this analysis. A framework that generates unpredictable code or introduces unnecessary complexities can increase the attack surface, as developers could make subtle mistakes by not fully understanding the underlying abstractions. Therefore, our cybersecurity services always recommend validating the quality of code generated by AI assistants, especially when working with novel frameworks. Convention and predictability are allies of security.

Another relevant aspect is the integration with cloud services. Multi-agent frameworks are typically deployed in environments such as AWS or Azure, and the ability of AI wizards to generate compliant infrastructure code is crucial. Our experience in AWS and Azure cloud services has taught us that standardizing APIs reduces misconfigurations and accelerates continuous deployment. A framework that aligns with common cloud practices will have an additional advantage in terms of attendability.

In the field of business intelligence, where tools such as Power BI are essential, connecting with AI agents that can interpret and generate queries on structured data requires a high level of convention. Our business intelligence and Power BI services benefit from frameworks that follow standard patterns, as this allows AI assistants to suggest data transformations and visualizations more accurately.

The conclusion is clear: declarative design alone is no guarantee of success in the era of assisted AI. Convention, familiarity, and alignment with established practices are the true pillars of efficient development. For companies looking to implement AI agents, the recommendation is to conduct empirical 'assistibility' testing with their equipment and tools before committing to a particular framework. At Q2BSTUDIO, we are prepared to guide organizations through this process, combining our expertise in custom software development, artificial intelligence, and process automation to ensure that investment in technology produces tangible and sustainable results.

The future of AI-assisted programming is not in revolutionary abstractions that no one understands, but in ecosystems that evolve while respecting the conventions that developers already master. Innovation must be incremental, not disruptive, so that AI tools can accompany change. Those who understand this will be better positioned to harness the full potential of multi-agent frameworks, transforming the promise of artificial intelligence into a productive reality.

A BREAK?

Play for a moment before you go

OUR SERVICES

How we can help you

Do you have a project in mind?

Tell us your vision and we'll turn it into a software solution. Whatever the scope, we make your idea real.