Using website analytics tools can make your SEO job easier than ever. I want to mention “Screaming Frog SEO Spider.” It can be used to evaluate a website and detect the components that influence website processing on search engines. In this article, you and I will learn about the important functions that the tool offers.
What is Screaming Frog SEO Spider ?
The Screaming Frog SEO Spider lets you quickly crawl, analyze and audit on-site SEO a site. It can be used to crawl both small and very large websites. In which manual checking of each page will be extremely labor intensive (or impossible!) And you can easily miss it. Navigation problems, meta refresh or page duplication. You can view, analyze and filter data collection data when data is collected and updated continuously in the user interface of the program.
SEO Spider allows you to export major onsite SEO elements (URLs, page titles, meta descriptions, titles, etc.) to Excel so that it can be easily used as a basis for SEO proposals. Our video above provides a demonstration of what SEO tools can do.
1. Download and install
First, download the software and install it on your computer at http://www.screamingfrog.co.uk/seo-spider/.
Software support on Windows, Mac, and Ubuntu. The free version has a scanning limit of 500 URLs. Buying a license will not limit you to scanning the number of URLs (useful for large websites), as well as expanding more features.
2. Scan a website
Are you ready to try scanning a site? I will use a website as a model. Enter the website URL into the ‘enter a URL to spider’ field and press ‘Start.’
If you want to scan subdomains (for example, a blog blog.website.com), you need to select Crawl All Subdomains in Configuration> Spider settings.
Depending on website size, the scan process may take several minutes.
3. Check the return code (Responses Codes)
Usually, we check the status of HTTPs in the ‘Response Codes’ tab.
301: Permanent redirect
302: Temporary redirect
404: Not found
500: Server error
Start by checking all URL redirects (301 and 302) and confirm you’ve used them correctly. Remember that 301 is a permanent redirect so that the URL will get authority. But not right with 302 redirects.
We then look at error 404. This error appears when you try to access a non-existent page – perhaps the page has been deleted or renamed (without redirecting to the new URL). Correct this error by performing a 301 redirect to the new page.
Note: don’t forget to cross-check this error in Google Webmaster Tools.
On this page, you can also find errors for internal links. Click a URL with 4xx or 5xx codes and look at the In Links tab. The window will list all the pages that link to the error URL.
With Screaming Frog SEO spider, we can analyze all URL links from a website via the URL tab.
By checking the length of each URL, when you click on the order column. Check for URLs whose titles exceed the allowed characters, when displayed on the search engine. Remember that the URL needs to be shortened to 4 to 5 words with a description, for example, ‘website.com/seo-tutorial’ instead of ‘website.com/p5145’.
Do not filter non-ASCII characters, footprints, capital letters, or duplicate URLs. These factors will encounter errors when doing SEO.
5. Page title
Next, look at the ‘Page Titles’ column. Every page will have a unique title and contain important keywords at the beginning of the title. You can see the following illustration. This website uses the same title on every page. This error will need to be fixed:
Note a title should not exceed 60 characters. Although this can be useful when reporting data, the character length will be calculated in the actual size in the Title 1 Pixel Width column. This column will measure the pixel length instead of the number of characters. It will suggest how many characters you need to display well on search engines.
6. Meta description
The description is used in the search results page below the title. The description content should be 160 characters. The remaining signatures will be cut off.
In the example above, the meta description one field is empty, which means that page set description. You need to add a description of the missing pages.
Screaming Frog has a new feature that lets you preview a snippet and analyze it. You can select a URL from the scan result and click on the SERP snippet tab at the bottom of the screen. Change the title and page description and review.
Page speed is an important factor. It is not only suitable for mobile users but also a plus for search engines. Google evaluates rankings by measuring page speed, optimizing the fast website is vital. One of the causes affecting page speed is images. Using large images will consume a lot of bandwidth, you should optimize images and size below 100kb
In the filter field, you can filter images beyond 100kb, and easily statistic the images that will need to be optimized. Don’t forget to check the ‘alt’ attribute. Make sure each image has an alt text description.
Tip: You can measure the page processing speed in the ‘response codes’ tab in the response time section. Use external tools to test like Yslow or PageSpeed Insights.
In the Directives tab, you can see robots meta information, canonical links, and rel = next / prev. Use filter fields to quickly find pages with directives. The following example website owner should add a few necessary tags to describe the robots.
9. XML Sitemap
You can use the Screaming Frog SEO spider to create an XML Sitemap. Sitemaps are used by search engines to index websites. It is a roadmap to help them gather information on your website.
Access this feature in the menu Sitemaps> Create XML Sitemap. When the sitemap file is created, you can change parameters in the file such as order, frequency.