Rosetta: Native and Composable Multimodal Training

Discover Rosetta, a new multimodal pretraining framework that avoids catastrophic forgetting by integrating new modalities without losing prior knowledge.

jueves, 2 de julio de 2026 • 2 min read • Q2BSTUDIO Team

Multimodal pretraining without catastrophic forgetting

Artificial intelligence has advanced to the point of needing models that understand and generate content in multiple formats: text, images, audio, and video. However, one of the greatest technical challenges is enabling these systems to incorporate new capabilities without destroying previously acquired knowledge. This phenomenon, known as catastrophic forgetting, has for years limited the development of truly multimodal models. Recent research proposes composable and modular architectures, where fundamental knowledge is preserved in shared global experts and the specific skills of each modality are assigned to interchangeable modules. This non-destructive approach allows the model's capabilities to be expanded progressively, avoiding gradient conflicts and overlapping representations.

For businesses, this evolution opens up transformative possibilities. Having artificial intelligence systems capable of processing heterogeneous data — from financial reports to production images — enables more precise and agile decision-making. In this context, having custom software that integrates these capabilities coherently is essential. Furthermore, the implementation of AI for businesses must be accompanied by a robust and secure cloud infrastructure, whether with AWS and Azure cloud services, ensuring scalability and availability.

At Q2BSTUDIO, as a software and technology development company, we understand that the adoption of artificial intelligence cannot be an isolated process. That is why we offer comprehensive solutions ranging from creating custom applications to deploying AI agents that automate complex processes. Cybersecurity is another critical pillar: any multimodal model handling sensitive data must be protected with pentesting strategies and continuous auditing. Likewise, business intelligence is enhanced with tools like Power BI, which allow visualizing and analyzing the results generated by these advanced systems.

Ultimately, the path toward truly composable multimodal models depends not only on academic advances like the one inspiring this article, but also on a technological ecosystem that integrates business intelligence services, cloud infrastructure, and custom software development. At Q2BSTUDIO, we accompany organizations at every step, transforming innovation into tangible and sustainable results.

A BREAK?

Play for a moment before you go

OUR SERVICES

How we can help you

Do you have a project in mind?

Tell us your vision and we'll turn it into a software solution. Whatever the scope, we make your idea real.