Whether you do SEO, PPC, or both, you’re going to need keyword research.
Without research, a campaign is basically just guesswork. But with a calculated approach, you can discover your potential customers’ top questions, preferences, and pain points
Semrush analyzes over 20 billion global keywords in our global databases, making it the perfect place to start your keyword research.
Just ask these 84 experts why they love Semrush.
This checklist offers a straightforward process that anyone can use to start building master lists of target keywords in any market or niche.
All you need is:
- A Semrush account
- Microsoft Excel or another similar program
After some practice, you’ll be using our keyword research tool‘s features and generating master lists in less than thirty minutes.
1. Search Your Main Keyword in the Search Bar
First things first. Think about the single word or phrase that you think people would type into Google before visiting your home page.
Maybe it’s a product that your site sells, a common problem that your customers face or a question that your website answers. Decide the keyword that best represents the benefit of going to your website and use it to start this process. Ultimately, a 1-2 word phrase will work best.
Keep in mind that keyword research should be flexible and creative, so you can always start the process over with a different keyword.
When you enter your keyword into the SEMrush search bar, the interface presents a Keyword Overview report.
For the sake of example, let’s pretend we operate a website that offers gardening advice and products. I’ll go through the research process starting with “tomato plant.”
From this dashboard I can locate all of the data Semrush has about the keyword “tomato plant.” Monthly search volume, number of results, cost-per click, and competition level are all shown at the top.
Keyword Variations, Questions, and Related keywords are previewed below, and will give you expanded lists of keyword ideas. If you click through one of these preview widgets you’ll open up the Keyword Magic Tool.
2. Use the Keyword Magic Tool to Find Long Tail Keywords
SEO and PPC professionals classify keywords into three main buckets based on their popularity and specificity; the “head,” the “body,” and the “long tail” of the graph below that measures search volume and conversion rate of keywords.
Head terms, also referred to as “short tail,” are often one or two word search phrases that do not have one clear intent.
Body phrases are slightly more specific and usually contain more words. With more words in the search query, you can start to get a clearer idea of the searcher’s intent.
Long tail keywords generally contain three or more words, have less search volume and illustrate a specific situation or intention from the searcher.
The easiest way to think about these keywords is with the following graph.
long tail keywords can have high conversion rates
In this example, “tomato plant” is the head phrase, “tomato plants for sale” and “when to plant tomatoes” are body phrases, and “why are tomato plants turning yellow” is the long tail.
These are called “long tail keywords” because they’re found in the long “tail” stretching to the right of the graph as search volume is low and potential conversion rate is high.
The conversion rate for long tail keywords can be higher because longer search phrases show more specific intent, allowing marketers to offer more relevant and specific solutions that a searcher will find helpful.
Generally speaking, as search volume decreases, more long tail keywords appear and the conversion rate increases.
The best way to find long tail keywords on Semrush is with the Keyword Magic Tool. This tool generates a list of extended search phrases based on the keyword entered.
For example, let’s look at a Keyword Magic Tool report for the keyword “tomato plant.” If you have an Semrush account, click here to view this report.
From here we can see a long list of keywords based around the phrase “tomato plant,” ranked in order of search volume.
That means that as you scroll down the report, you find the less popular and more specific keywords.
You can also filter your report with the questions filter (1), match type filter (2), the subgroups on the left (3), or filters for metrics like Keyword Difficulty (KD%), CPC, and more (4).
The long tail phrase, “why tomato plants turn yellow,” has less volume (320) compared to the body phrases “when to plant tomatoes” (8,100) and “tomato plants for sale” (5,400) or even the head phrase, “tomato plant” (74,100).
While the long tail phrase has the least volume, it will be an easier keyword to target because of how specific the situation is.
To explain, users that search “why tomato plants turn yellow” have a specific question that they’re looking to answer.
Meanwhile, users that search “tomato plant,” could be looking for all different types of information on tomatoes and be unsatisfied with the SERP, leading them to bounce from the search results page and going with a more specific query.
Maybe some of the “tomato plants for sale” searchers want to buy tomato seeds, and others want to buy a transplant. Some might want tomatoes to plant outside, while others may want to plant tomatoes indoors. The point is that without clearly defined intentions behind a keyword, it gets harder to know what people want.
On the other hand, the keyword “why tomato plants turn yellow,” illustrates a specific issue that can be directly addressed and answered with a web page. To target this keyword with our gardening site, we could write a blog post or landing page listing every possible situation why tomato plants could be turning yellow.
To convert visitors, we’d inform them that one possible reason for yellow plants would be having low levels of nitrogen in the soil. Then, we offer a solution, like a test kit to check the nitrogen levels of your soil.
See how that works? The more clear the user intent, the easier it will be for you to target a keyword, and the easier it will be to offer a relevant solution to the user’s problem. I’ll explain how user intent fits into your marketing funnel in step 8 of this checklist.
3. Apply Filters for Keyword Difficulty (SEO) or Competitive Density (PPC)
Maybe you’re having trouble going through this long list of keywords to find the most realistic targets. Luckily, Semrush provides filters that let you weed out the highly competitive keywords that aren’t worth your time.
In every keyword report, there are two helpful metrics that measure competition: Keyword Difficulty for SEO and Competitive Density for PPC. Keyword Difficulty is measured from 0-100, and Competitive Density is measured from 0-1.00.
A higher Keyword Difficulty score means that there are authoritative domains ranking on the first page of results, and it will be hard to outrank the sites in the organic results. A higher Competitive Density score tells you that there are a high number of domains bidding on the keyword.
To attempt to rank a PPC ad for a keyword with high cost-per-click and high Competitive Density, you would need to place an expensive bid and set up a perfectly optimized landing page. Instead, you should focus on targeting keywords with low Competitive Density to start.
For SEO, you should focus on targeting keywords with low Keyword Difficulty. Oftentimes, there’s a correlation between longer keywords and lower keyword difficulty and competition levels.
See how the competition and difficulty levels compare in our example:
As the phrases become more specific, the Keyword Difficulty and Competitive Density decrease.
Interestingly, “tomato plants for sale” has the lowest organic difficulty score, while also having the highest competitive density. In this case, it would probably be easier to target this keyword through SEO efforts rather than advertising.
To export only the most targetable keywords, apply filters to weed out keywords with high Keyword Difficulty and Competitive Density scores.
Filters for both metrics can be applied at the same time to a report. See the example below where to find the filtering options.
4. Send the Filtered List to Keyword Manager
This step is pretty straightforward, but necessary. Every time you generate a filtered list of terms, make sure you send it to the Keyword Manager.
This lets you combine all of your research into a master file of up to 1,000 keywords. When exporting keywords from the Keyword Magic Tool, you can choose to select all of the keywords, the first 100, the first 500, or on an individual basis using the checkboxes in the far left column.
5. Reference the Related Keywords Filter to Find More Topics
After finding Phrase Matches based on your original keyword, you’re going to want to identify more closely related searches. While keeping your main keyword in the search bar, change the Phrase Match filter to a Related filter.
The keywords in this list are based on their relevance to the queried keyword or how similar the search results of these keywords are to the search results of the queried keyword.
This allows you to find more search phrases related to your topic that may not even contain your main target keyword in the query.
Again, this report can be filtered by Keyword Difficulty and Competitive Density. Pick out every related keyword in this list that sticks out to you and send the list to your Keyword Manager list.
6. Repeat Steps 2-5 for Any Additional Keywords
Repeat the process that you went through with your original keyword but with additional topics that you think your site should target.
Enter your first new topic into the search bar and pull another Phrase Match report with any desired filters.
Once you gather another list of target keywords, export the list and repeat for every related topic you want to target. Send all of your exports to the same list within Keyword Manager.
7. Export Your Master List from Keyword Manager
The next step is to export your master list from Keyword Manager. The great thing about this tool is that you can actually refresh your metrics before exporting to be sure that your exported file has the freshest metrics.
Just hit the “Update metrics” button above your list to get the most recent Semrush data on competition level, KD%, SERP Features, Click Potential and top competitors.
Once your list is updated, the rows will be green and you’ll see up-to-date click potential and other metrics.
Next, export your list to a spreadsheet file.
This spreadsheet will be a valuable reference document as you go through your SEO or PPC campaign.
There will be columns for keyword, search volume, keyword difficulty index, CPC, competition level, number of results, and trend. Number of results and trend won’t matter too much in this process, so you can either ignore those columns or delete them from your spreadsheet.
A simple trick to help organize your spreadsheet is adding Conditional Formatting to colorize the metric columns.
First, add filters to your document and highlight the column you want to format.
Then, make sure you’re under the “Home” tab and select Conditional Formatting to add a color scale to each column that measures value (volume, KW difficulty, CPC, and Competitive density).
Use conditional formatting to add color to your spreadsheet
Volume – green for high, red for low
KW Difficulty – green for low, red for high
CPC – green for low, red for high
Competitive Density – green for low, red for high
Adding color to these metrics will go a long way in helping you visualize and pick out the most realistic and rewarding keywords to target. Now you can scan for the most “green” keywords, signifying the most volume and least competition. The next step will be more tedious if you have a huge amount of keywords, but will prove to be rewarding over time.
8. Classify by Searcher Intent
This last step uses a bit of critical thinking, but will be essential for maximizing the use of your research. In addition to knowing what your audience searches (keywords), you’ll be able to know why they make these searches (intent).
Searcher intent is essentially the goal of the person searching on Google. They could be looking for general information, product research, or a website to make a purchase.
Most experts group keywords into four categories of intent:
- Informational – Questions using who, what, where, why, and how. Single word keywords like “tomatoes” or “gardening” fit in this bucket.
- Navigational – Searches with brand names or the name of a product or service the searcher is looking for. “San marzano tomatoes” would fit in this bucket because the searcher wants to navigate to a specific brand.
- Commercial Investigation – Keywords that include location, “best,” “mens,” “womens” or other common product modifiers fit here. “Where to get tomatoes in yolo county” is an example.
- Transactional – Keywords asking about price, coupons, shipping costs, and the transaction process make up this bucket. “Buy cheap tomatoes,” for example.
The more specific the intent is for a keyword, the easier it is to provide searchers with what they are looking for.
To go one step further, searcher intent can actually be aligned with your marketing funnel.
The easiest way to do this is by mapping the four intent buckets to the AIDA (Awareness, Interest, Desire, Action) model. Like searcher intent buckets, AIDA has four stages.
AIDA marketing conversion funnel
Awareness (general knowledge of information) is the first step of the funnel, leading into Interest (curiosity in the subject), then Desire (wanting something to solve a problem), and finally, Action (buying a product, signing up for a subscription, etc).
Once you identify a keyword’s searcher intent, you can classify where in the conversion funnel it lies. Every keyword in your strategy also has a place in your marketing funnel.
AIDA + User Intent = Strategy
Go back into your spreadsheet and add another column to tag your keywords with these four types of intent to categorize your keywords by where they are in your conversion funnel. After you’ve tagged all of your keywords, you can filter your spreadsheet to show the keywords with each group of intent. Depending on how you format everything, it could look something like this:
Keywords tagged by intent
The four different stages of conversion should be targeted with different areas of your site, and by identifying the keywords that fit each step of the conversion funnel, you can conduct an optimized marketing campaign.