Open-source Python library for SEO and SEM workflows, including crawling with Scrapy, robots.txt and sitemap parsing, SERP APIs, log file parsing and text analysis.
Siteliner
Free website scanner from the makers of Copyscape that reports duplicate content, broken links and page structure for small sites.
What it is
Free website scanner from the makers of Copyscape that reports duplicate content, broken links and page structure for small sites.
It sits in the crawler category, and also covers technical seo, free utility. It is built by Indigo Stream Technologies, based in United States.
Alternatives & neighbours
9 tools sharing at least one category with Siteliner.
SEO platform built on its own web crawler and link index, offering Site Explorer, Keywords Explorer, Site Audit, Rank Tracker and Content Explorer. Brand Radar adds AI-answer visibility tracking.
Browser extension showing on-page SEO data, redirect chains and Ahrefs link and traffic metrics for pages and search results.
Chinese webmaster tool site providing composite SEO diagnostics, Baidu weight and keyword ranking analysis, backlink and reciprocal-link checks, keyword mining, dead-link detection and historical site data, plus a paid data API.
High-performance crawler for large websites with a focus on link graph analysis, PageRank-style internal link metrics and reproducible technical audits.
French link intelligence platform with its own crawl index, providing semantic value and induced strength metrics for pages and domains.
Microsoft's free site owner console for Bing, providing search performance data, index and crawl diagnostics, URL submission, IndexNow support and keyword research.
Korean keyword research tool for looking up search volume and analysing keyword demand, widely used for Naver and Google keyword work.
Enterprise SEO platform combining crawling, log analysis, keyword data and an activation layer that renders and submits pages to search engines. Has extended reporting to AI search surfaces.