Organizations

Research

Research institutions produce the studies and datasets the industry argues over.

12 organizations · Global, Europe, North America and Middle East & Africa

ACM SIGIR

United States

The ACM Special Interest Group on Information Retrieval, which runs the SIGIR conference plus ICTIR and CHIIR and publishes SIGIR Forum. It is the academic venue where ranking, retrieval, evaluation and now retrieval-augmented generation methods are published years before they surface in commercial search behaviour.

Paid membershipsigir.org

Baymard Institute

Denmark

Independent web UX research organisation headquartered in Farum, Denmark, with over 200,000 hours of research and 275,000 UX performance scores benchmarking major e-commerce sites. Its findings on product page structure, faceted navigation and checkout are directly applicable to e-commerce SEO decisions about indexation and template design.

Paid membershipbaymard.com

Data & Society Research Institute

United States

Independent nonprofit research institute studying the social implications of data-centric technologies and automation. Its work on algorithmic amplification, search-based information disorder and platform accountability is a standard reference in debates about how search and AI systems shape what people find.

datasociety.net

Data Provenance Initiative

United States

Research collaboration building public measurement infrastructure for AI training data, model ecosystems and real-world AI use. Its audits of web crawl corpora document how robots.txt and terms-of-service restrictions have changed across the open web, which is core evidence for crawler-policy decisions.

Free membershipdataprovenance.org

HTTP Archive

United States

Open-source permanent repository of web performance and technology data, maintained by community contributors and hosted as part of the Internet Archive, a 501(c)(3) nonprofit. Its crawl dataset and the annual Web Almanac are the standard empirical basis for claims about real-world Core Web Vitals, markup and structured data adoption.

Free membershiphttparchive.org

NASK — National Research Institute

Poland

Polish state research institute that operates the .pl domain registry and works on national cybersecurity and internet policy. Its registry rules and cybersecurity obligations shape the requirements attached to Polish .pl domain names.

nask.pl

Nielsen Norman Group

United StatesEst. 1998

UX research, training and consulting firm founded in 1998 by Jakob Nielsen and Don Norman. Its evidence-based studies of how people scan pages, read search results and evaluate credibility are the empirical foundation behind much of what SEO teams assert about title tags, snippets and content structure.

Paid membershipnngroup.com

Open Future Foundation

Netherlands

European think tank developing approaches to an open internet that maximise the societal benefit of shared data, knowledge and culture. Its work on AI training data opt-outs and the public digital commons feeds directly into European debates about machine-readable crawling and reuse preferences.

openfuture.eu

Oxford Internet Institute

United Kingdom

Multidisciplinary research department of the University of Oxford studying the social science of the internet, including information access, platform governance and algorithmic influence. It is one of the leading academic sources for peer-reviewed work on how search and recommendation systems shape public knowledge.

oii.ox.ac.uk

Pew Research Center

United States

Nonpartisan, charitably funded fact tank and subsidiary of The Pew Charitable Trusts that studies public opinion, technology use and information behaviour. Its surveys on how people find news and use search and AI assistants are among the few independent datasets on search behaviour not produced by a search vendor.

pewresearch.org

Research ICT Africa

South Africa

African think tank producing evidence-based research on digital equality, data justice and ICT policy across the continent. Its household and business internet-use surveys are among the few open data sources on African online behaviour, useful for sizing search markets where commercial data is thin.

researchictafrica.net

Similarweb

United States

Publicly traded digital intelligence company (NYSE: SMWB) headquartered in New York, covering over 100 million websites, 10 billion content pages and 5 billion search terms. Its clickstream-derived traffic and search estimates function as the industry's shared, if imperfect, currency for competitive analysis and market sizing.

Paid membershipsimilarweb.com

Other types