Discovering Early Subnets in Transformers Without Retraining

Specialists in technological development and services with experience in optimizing models such as ViTs and LMs like GPT-2 and RoBERTa. We use masked distance pruning to identify early-bird subnetworks in Transformers.

miércoles, 9 de abril de 2025 • 1 min read • Q2BSTUDIO Team

Artificial-Intelligence-

At Q2BSTUDIO we specialize in technological development and services, with experience in training optimization for models such as ViTs and LMs like GPT-2 and RoBERTa. We use masked distance pruning to identify early-bird subnetworks in Transformers.

A BREAK?

Play for a moment before you go

OUR SERVICES

How we can help you

Do you have a project in mind?

Tell us your vision and we'll turn it into a software solution. Whatever the scope, we make your idea real.