What is free scrapping and how to use this SEO tool?
Have you ever wanted to review the titles of your site but stopped doing so due to the time consuming process? Or you want to see which of these titles do not have meta descriptions, but because the pages of the site are too many and you have to check one by one, have you mentioned this? Have you ever wanted to have comprehensive information on canonical metatags and singles as soon as possible? Or, for example, want to measure the quality of URLs in the fastest possible time? In fact, how much do you know about the internal SEO and technical SEO of your site?
Screaming Frog SEO Spider software is an almost free SEO tool for website analysis that is mounted on the desktop and you can install it on your computer. This tool simulates the performance of Google crawlers, examines links, images, CSS and بر based on SEO rules and helps you to perform better in search results. This means that the software actually basically tells you what they see when crawlers inspect your site.
Screaming Frog tool helps you to review, review and analyze your site in terms of internal SEO and technical SEO at a glance, and as a result you can take a step to improve the ranking and status of your site SEO. Screaming Frog software is also very effective in managing your time, because we all know how tedious it can be to check a page manually.
This training has three parts, the first part is the general training of tools and the second and third parts are a series of important and more detailed cases.
Part One – Learning how to work with Screaming Frog software
In the following, we will teach you how to work with this free SEO tool to learn a new way to SEO your website for free.
1. Install Screaming Frog.
This software is available for Mac, Ubuntu and Windows for free. But it has limitations and only allows you to check five hundred URLs. However, by purchasing a license from Screaming Frog, you will be able to visit more pages of a site and new features will be available to you.
Click here to download Farag Screening Tool for free. It also allows you to crawl more URLs by paying a fee and purchasing a license.
2 – Crawl with Screaming Frog tool
So are you ready to start browsing the site with Screaming Frog software?
First of all you have to give a URL to the Screaming Frog crawlers. Enter the URL in the software and then click the Start button.
If you want to check Subdomains as well, click Crawl All Subdomains in Configuration> Spider. Depending on the size of your website, crawling can take minutes.
We should also note that you will be able to check only one subdomain or even one folder at a time. Also, this free SEO tool focuses more on internal SEO cases.
3 – Check the answer codes.
You may not know, for example, which pages have a 404 error, or if you do, you do not know which pages are linked to so that you can remove these links. Before doing anything, we suggest you take a look at the HTTP in the Response Codes bar. The most important answer codes are:
- 503: Inaccessible
- 500: Server error
- 404: Not found
- 302: Temporarily moved
- 301: Constantly moved
- 200: ok
4 – URL analysis in Screaming Frog
You can use Screaming Frog Seo tool to analyze all URLs of a site. Start with the URL length. See the category of columns. See if any URL is unreasonably long? Remember that the length of a good URL is short, about four or five descriptive words. Do not forget to check the URLs Duplicate, Under Score, etc. All of these can interfere with the indexing process; So they have to be solved.
Do you really think the English address is better or Persian?
5 – Check the title of the pages in Screaming Frog
Now you can take a look at SEO as well as the titles of the h1 to h6 tags on the pages. Each page should have its own unique title and use the most important keyword in the text. It is usually said that the title should be less than 60 characters. See Title | Pixel Width. This tool measures the length of the title by the number of pixels. The number of pixels should usually be less than 512.
Of course, a professional, practical and free tool has been created on the SEO teaching Tools site to accurately write the title of SEO and meta description, although tools and plugins such as Youast have such a feature, but unfortunately it is not accurate for Persian language. You can see the SEO title tool and meta description for review.
6 – Meta description in Screaming Frog
Meta descriptions are used under the headings and it is better to keep their length below 160 characters.
Screaming Frog has a feature that allows you to analyze snippet and meta descriptions. Click on the URL and find the SERP option at the bottom of the page. Change the title and metascript and see how it is used on the desktop of your phone or tablet.
7- Checking website images in Screaming Frog
Page speed is important, not only for mobile users but also for search engines. Google has said that it considers the page speed in ranking the site. One of the things that slows down pages is the images. High quality images on the site take up more bandwidth, so it is best to keep them below 100 KB at all times. With the Image Over 100Kb filter, you can easily remove photos that are too large.
You can also check Alt images using the Screaming Frog tool. Need more information on SEO SEO? Read photos related to photo SEO.
8. Canonicals tag in Screaming Frog
With the Canonicals tag you can get comprehensive information about canonical links. Canonical links are elements in HTML that help you avoid duplicate and duplicate content.
We suggest that you read the article related to the Canonical tag, there are over 100 comments in this article and various examples that will help you a lot.
9 – Create an XML Sitemap
You can create an XML Site map using Screaming Frog. This type of sitemap is used by search engines to double check and analyze relevant content. Find this method in the following path:
Sitemaps> Create XML sitemap
Part 2 – Find 404 links using the free Screaming Frog SEO Spider tool
Find 404 links using the free Screaming Frog SEO Spider tool Tracking 404 links with Frag SEO Screening Analysis Tool
Using the free SEO tool Screaming Frog SEO Spider, you can easily get broken links on your website (I mean the 404 error) in just a few minutes (or hours (!) Depending on the size of your website) find.
Okay, let’s take a step-by-step look at the steps to find broken links using the free Frag SEO tool:
1- Crawling the desired website
Open the Frag SEO tool and enter the URL of your desired website in the ‘Enter URL to spider’ field. After entering the URL, click Start to crawl your site software. Keep in mind that the crawling process can take from a few minutes to several hours, depending on the size of your website.
2 – View response codes
You can also wait until the crawling process is complete and the green bar fills up, or when scammers are crawling your website, click on Response Codes at the same time and select the ‘Client Error 4XX’ filter. .
There are two ways to do this in the SEO Screaming Frog SEO Spider software. The first way is very simple: click on the Response Codes tab and select the Client Error 4xx filter.
The second way is to click on the Response Codes tree directly from the Overview window on the right side of the software and select the Client Error 4xx directory. Of course, keep in mind that both ways will always give you the same result.
The Overview window is one of the most interesting and special features in the Screaming Frog tool. This window is updated at the same time as crawling, and you can detect 404 errors with just a quick glance while performing crawling.
See the broken links by selecting the Inlink tab
Frag SEO Analysis Tool allows you to see the source and source of broken links so that you can easily fix them. (Corrupt link source refers to URLs that end in corrupt links). To do this, just click on the desired URL and then click on the Inlink tab at the bottom of the page.
By entering the Inlink section, you will see that the Screaming Frog SEO Spider tool gives you relatively complete details of the broken link: what is the inbound link and what is its output, and so on. The From section indicates the source where the broken 404 link can be found. The To section is also the same broken link. You can also see other details such as anchor text, alt text (if it is a photo) and whether the link is a follower or a nouveau riche.
Free Frag SEO Screening Analysis software allows you to export all crawl information. This is perhaps the most brilliant feature of Frag Screaming software. Export or Buck Export means creating a data file. To export the data of broken links and their source, follow the path below:
Bulk Export> Response Codes> Client Error (4XX) Inlinks
You can see the BulkExport tab at the top of the page.
Part 3 – Find and check Redirect with the free Screaming Frog Seo Spider tool
I will try to teach you with the help of the free tool Screaming Frog Seo Spider redirects to your site, or the same HTTP 3XX responses (whether 301, 302,303 or ..) either by crawling or by loading the URL list check it.
First – codes 301, 302, 303 and
Second – Status: permanent or temporal link
And third – the destination of the redirected link
is showing. This unique tool can also follow the chain of redirected links to reach the final destination. A feature that not only makes it one of the top SEO analytics tools, but also emphasizes its effectiveness. (Click here for more information about Frag scrambling software)
Well, with this short introduction, let’s get straight to the point, or the tutorial on checking Redirect using the free Screaming Frog Seo Spider tool:
1. Crawl the desired site.
Open Frag SEO tool and enter the URL of your desired website in the Enter URL to spider field. After entering the URL, click the Start button until the green bar appears. This bar shows the crawling process. Crawling Keep in mind that the crawling process can take from minutes to hours depending on the size of your website. If you are using the free version, this process will take less time due to limited features and access.
2. On the Response Codes tab, then view the Redirection 3XX filter to redirect links.
You can wait until the end of the crawling process and the green bar fills up and appears 100%, or while scrolling Frag is still crawling your website, click on the Response Codes and select the Redirection 3XX filter. .
There are two ways to do this in the SEO Screaming Frog SEO Spider software. The first is very simple: from the overview window on the right
Use and directly click on Redirection 3XX, which is a subcategory of answer codes. The second way is just as easy: click on the Response Codes tab and select the Redirection 3XX filter.
You will see that in front of each status URL and status codes or 3xx codes are written. You will also have access to both internal redirected internal links and external links. The Redirect URL column of destination redirects will show you the links shown in the Address column.
Do not forget that the Overview window embedded in the Frag scramble tool is updated at the same time as the crawling, and you can also crawl to identify redirected links.
3. Select the Inlink tab to see the redirected links.
Frag SEO Screening Analysis tool allows you to easily view the source and source of redirected links so that you can easily update, replace or even delete them. (This means URLs that are linked to redirects.) To do this, just click on the URL and then click on the Inlink tab at the bottom of the page.
The From section represents the source where the redirect link can be found. The To section has also been redirected to the same link. You can also check other details such as anchor text, alt text and whether the link is follow or nouveau riche.
4. Export the information obtained.
Free Frag SEO Screening Analysis software allows you to export all crawling information related to redirect links. Export or Buck Export, as we have already learned, means creating a data file. To export the data of redirect links and their source, follow the path below:
Bulk Export> Response Codes> Client Error (3XX) Inlinks
Also do the following to export redirect chain information (and identify loops):
Reports> Redirects> Redirect Chains
Using the free Screaming Frog Seo Spider tool, you can address your important SEO factors and analyze the site’s internal elements such as page titles, meta descriptions, URL structure, response codes, images, and more. Screaming Frog is a great tool to help you SEO your website and increase your site ranking in search pages. In addition, this tool is completely free.
What is your experience using this tool? Which SEO tool do you think is the most powerful and why? Please comment in the comments.