Step 1: Create a new study

After clicking on "Create a new study," you can first give your study a name and description that will be useful to you. Next, you need to select the study type. At this stage, you must decide whether you want RAT to only collect the URLs and AI Overviews from the search results (URLs / AI overviews only), or if you also want those results to be evaluated by jurors (Assessment Study). Additionally, you can choose the Classifier Study to use different classifiers (SEO Score, Readability Score) to gain further insights and data about the search results.

In the next step, you can choose the search engines or systems and in which countries you want the RAT to collect results as well as which types of results. For example, you can choose to collect Organic Results from Google in Germany.

Now you can specify the set of search queries. To do this, you can either enter the search queries manually, upload a CSV file containing your search queries, or utilize the Query Sampler.

In the final step, you will indicate how many search results RAT should gather per query, specifying either a single number or a range. You can also specify the assessment options and select the different classifiers based on the study type you previously chose. In the Assessment Options section, you can define the search task that the jurors will work on later. You have the ability to limit the number of results each participant should assess, choose the types of results to be evaluated, and decide whether or not to display URLs in the assessment interface.

Now you will receive a summary of your settings to confirm them.

After creating your study, you will be directed to the overview dashboard. Here, you can begin collecting search results, define evaluation questions, invite participants for evaluation, select the URLs that will be presented to the jurors and analyze as well as export the study results.