Research collaboration building public measurement infrastructure for AI training data, model ecosystems and real-world AI use. Its audits of web crawl corpora document how robots.txt and terms-of-service restrictions have changed across the open web, which is core evidence for crawler-policy decisions.
Large-scale audits of AI training corpora and web crawl consent signals
Data Provenance Initiative is a research based in United States. Membership is free.
6 other research, plus others based in United States.
The ACM Special Interest Group on Information Retrieval, which runs the SIGIR conference plus ICTIR and CHIIR and publishes SIGIR Forum. It is the academic venue where ranking, retrieval, evaluation and now retrieval-augmented generation methods are published years before they surface in commercial search behaviour.
Independent web UX research organisation headquartered in Farum, Denmark, with over 200,000 hours of research and 275,000 UX performance scores benchmarking major e-commerce sites. Its findings on product page structure, faceted navigation and checkout are directly applicable to e-commerce SEO decisions about indexation and template design.
Independent nonprofit research institute studying the social implications of data-centric technologies and automation. Its work on algorithmic amplification, search-based information disorder and platform accountability is a standard reference in debates about how search and AI systems shape what people find.
Open-source permanent repository of web performance and technology data, maintained by community contributors and hosted as part of the Internet Archive, a 501(c)(3) nonprofit. Its crawl dataset and the annual Web Almanac are the standard empirical basis for claims about real-world Core Web Vitals, markup and structured data adoption.
Polish state research institute that operates the .pl domain registry and works on national cybersecurity and internet policy. Its registry rules and cybersecurity obligations shape the requirements attached to Polish .pl domain names.
UX research, training and consulting firm founded in 1998 by Jakob Nielsen and Don Norman. Its evidence-based studies of how people scan pages, read search results and evaluate credibility are the empirical foundation behind much of what SEO teams assert about title tags, snippets and content structure.