Open-source intelligence, known as OSINT, has undergone a radical transformation with the advent of generative artificial intelligence and autonomous agent systems. The massive volume of public data available today makes manual analysis methods insufficient for cybersecurity and digital investigation tasks. In this context, large language models (LLMs) and AI agents emerge as tools capable of multi-step reasoning, using external tools, and iteratively generating intelligence. However, evaluating their reliability remains a critical challenge.
One of the main identified barriers is the gap between the perception of the hallucination problem and its actual measurement in OSINT environments. While numerous studies acknowledge that LLMs can generate false or unverified information, there are hardly any comprehensive empirical evaluations in specific OSINT systems with retrieval-augmented generation (RAG). This lack of metrics hinders the safe adoption of these technologies in cybersecurity operations where every piece of data must be verified before making decisions.
From a technical perspective, agentic AI systems go beyond simple LLM prompting. They integrate architectures that combine knowledge bases, reasoning engines, and the ability to iterate over multiple sources. At Q2BSTUDIO, as a software development company, we work on creating custom applications with artificial intelligence that allow analysts to deploy specialized agents for collecting and classifying open data, reducing time spent on repetitive tasks and improving analysis accuracy.
The OSINT lifecycle spans from planning to intelligence dissemination. Current studies show strong AI support for the collection and analysis phases but leave gaps in verification, report generation, and decision-making support. To address these shortcomings, our company offers AWS and Azure cloud services that ensure scalability and availability of agent systems, as well as business intelligence solutions with Power BI to visualize results clearly and actionably.
Another crucial aspect is robustness against adversarial attacks and dark web coverage, areas where generative AI still presents vulnerabilities. Custom software development allows implementing additional verification layers and business logic to mitigate these risks. Furthermore, integrating AI agents with multimodal capabilities (text, images, video) opens new possibilities for digital forensic analysis.
The human-AI copilot model is emerging as the most defensible approach for short-term deployment in cybersecurity environments. In this scheme, LLM and agent systems assist in information collection and triage, while the human analyst retains ultimate responsibility for verification and decision-making. At Q2BSTUDIO, we design artificial intelligence solutions for businesses that adapt to this workflow, ensuring transparency and control over generated results.
In conclusion, the convergence of agentic and generative AI with OSINT offers immense potential but requires careful implementation, rigorous evaluations, and an architecture that prioritizes reliability. Organizations seeking to leverage these technologies can benefit from a customized approach, where custom software and cloud services combine to create robust and auditable systems. Investment in well-designed AI agents not only accelerates intelligence processes but also strengthens the cybersecurity posture against increasingly sophisticated threats.

.jpg)



