Analytics Reports

Previous analytics page   Next analytics page

This page presents the various search analytics reports that you can view in SearchStax® from Measured Search®.

App Overview

The Analytics Dashboard (App Overview screen) provides an all-in-one display of search behavior during the requested time period.

Overview Data

Screenshot

Relevance Data

Screenshot

The green arrows link to more detailed displays.

Performance/Availability Data

Screenshot

"Latency" is the time required to respond to a query, expressed in milliseconds. The green arrows link to more detailed displays.

Note that the Top Searches table lets you sort queries by latency, so you can find the slow queries and tune the system to speed them up.

Summary Graph and Results Table

This is an Overview chart tracking important metrics: Searches, Clicks, Revenue, and Searches per Session.

Screenshot

At the bottom of this dashboard there are three columns that summarize Top Searches, Top No-Result Searches, and Top Clicked Items. Each item appears as an absolute number and as a percentage of the total.

Screenshot

Time Window

Resolution can be adjusted by selecting a time period:

Top Searches

The Top Searches table reveals what users searched for. It includes all searches, not just the most-popular ones, and can be sorted on any column of data.

Screenshot

Top Searches provides a detailed table view of searches.

Column Name Description
Query The primary search query. The display does not include the settings of facets and filters.
Count Number of times that users submitted this query.
% of total Relative popularity of this query.
Hits Number of results displayed to users in response to this query.
Clicks Number of results that were clicked by users desiring more information.
CTR Click-through rate (Clicks divided by Count)
Latency (avg) Average search latency

You can filter the list either by searching for a keyword, or by setting a numeric limit on CTR or Clicks. For instance, the following example limits the table to queries where the number of click-through events was above 1000 for the requested reporting period:

Screenshot

You can share this display with a third party by using the Share Link button.

Screenshot

This button opens a dialog box containing a sharable URL. Click the copy button to copy the link to the clipboard.

Screenshot

You can email this link to any user, whether they have a Searchstax account or not.

Top No-Results Searches

Search Product Owners are especially interested in user queries that produced zero results. SearchStax summarizes these queries in the following table.

Column Name Description
Query The primary search query. The display does not include the settings of facets and filters, one of which might be the reason the search was unsuccessful.
Count Number of times that this query resulted in zero results during the reporting period.
% of total Percentage of all unsuccessful searches during the reporting period.

Top Clicks

The Top Clicks display shows the most popular click-through items for the designated time interval.

Screenshot

Column Name Description
Clicked Item The result item that garnered the click-through events.
Sum Number of times that this item was clicked as a sum over all the queries.
% of total Percentage of all click-through events in the reporting period.

Similar Searches

The Similar Searches display gathers similar user queries in order to identify patterns in user behavior when discovering a particular result. This allows the product search team to understand which queries people are using to find specific results and allows them to optimize search relevance algorithms or to vet and add additional synonyms to the synonym file. This is a powerful tool to improve the search experience for your users.

Screenshot

Column Name Description
Clicked Item Various queries led users to click-through the same result item. This is how we know that the queries are related.
Queries (Top 50) The most popular queries that led to this result item.
Unique Queries Number of textually-distinct queries that led to a click-through on this item.

Response Time

The Response Time display tracks query response time over a configurable time period.

Screenshot

Response time should be balanced against search accuracy (such as MMR, below) to achieve the best user experience.

MRR

Mean Reciprocal Rank (MRR) is a weighted average of click-through positions resulting in a value between zero and one. Higher values indicate that the "right answer" was often near the top of the search results.

Screenshot

MRR gives us feedback on the quality of our search experience. It helps us tune the system. For instance, did the recent changes in the synonym list improve the search experience? If so, then the MRR value should have risen. An upward trend in the MMR value over time indicates that the search is becoming more focused on the needs of the users.

Average Click Position

When a user selects a search-result item and clicks on it, what was the position of the item in the list?

Average Click Position is a good gauge of the effectiveness of the search results. Low numbers (below 5 or so) mean that the users found the desired items near the top of the search results. Higher numbers indicate that the search was successful, but the user had to scroll down through the search results to find the desired items.

In general, the lower the number the better. Over time you would like to see the Average Click Position trend down.

Screenshot

The data table below the graph lets us dig for more information. It can be filtered by a keyword or by setting a numeric limit on Average Click Position, Clicks, or Search Volume. It can be sorted up or down on any one of the columns.

screenshot

Column Name Description
Query The primary search query. The display does not include the settings of facets and filters.
Average Click Position The average position of the result item when this query resulted in a clickthrough event.
Clicks Number of clickthrough events in the requested time period.
Search Volume Number of searches for this query in the requested time period.

See Also

For more information on SearchStax Analytics, see these linked pages: