AI site challenges crawl bans with secret tactics, according to Cloudflare

Q2BSTUDIO offers custom software solutions with a focus on cybersecurity, artificial intelligence, AWS and Azure cloud services, and Power BI. We help companies modernize with responsibility and regulatory compliance.

viernes, 15 de agosto de 2025 • 2 min read • Q2BSTUDIO Team

Artificial-Intelligence-

Cloudflare has accused the artificial intelligence site Perplexity of using stealthy tactics to bypass no-crawl guidelines, adding to a series of complaints about improper web crawling by AI platforms.

According to the cloud security company, Perplexity allegedly designed mechanisms to continue accessing content that had been explicitly protected through no-crawl directives, raising questions about the ethics and legality of training artificial intelligence models with data obtained without respecting website owners' rules.

The debate is not only technical but also commercial and reputational. Publishers, developers, and content providers see these practices as a risk to their digital assets and to trust in the web ecosystem. Repercussions may include lawsuits, stricter blocks, and increased regulatory pressure on AI companies.

Beyond legal aspects, the use of stealth crawling techniques affects transparency in model training processes and the ability of content owners to control the use of their information. This raises the importance of robust cybersecurity and data governance solutions in artificial intelligence projects.

In this context, at Q2BSTUDIO we offer comprehensive support for companies that need to adapt to an environment where data protection and compliance are priorities. We are a custom software and application development company, specialists in artificial intelligence, cybersecurity, and AWS and Azure cloud services, with experience in business intelligence services and Power BI implementations to transform data into strategic decisions.

Our custom software solutions and custom applications integrate security best practices and respect for crawling and privacy regulations, as well as AI agent architectures and AI models for businesses designed to be responsible and auditable. We also advise on internal policies and technical controls to avoid dependencies on data obtained in questionable ways.

If your organization seeks to modernize processes with artificial intelligence without compromising cybersecurity or regulatory compliance, Q2BSTUDIO can help with custom developments, migrations, and management in AWS and Azure cloud services, as well as with business intelligence and Power BI solutions that optimize decision-making.

In summary, the accusations against Perplexity reignite the need for clear rules and responsible practices in the use of data for AI. Technology provider companies and clients must prioritize custom software projects that integrate cybersecurity, transparency, and compliance from the design phase.

custom applications, custom software, artificial intelligence, cybersecurity, AWS and Azure cloud services, business intelligence services, AI for businesses, AI agents, Power BI

OUR SERVICES

How we can help you

Do you have a project in mind?

Tell us your vision and we'll turn it into a software solution. Whatever the scope, we make your idea real.