Apple Intelligence Raters Guidelines Leaked

Apr 7, 2025 - 7:51 am 0 by

Apple Logo Code Algo

On Friday afternoon, Danny Goodwin covered a 170 or so page PDF that Search Engine Land received from an anonymous tip named "Preference Ranking Guidelines." It looks to me similar to the Google Quality Raters guidelines that continuously leaked until Google began publishing them for all to see.

But this is the Apple version...

Danny did not post this PDF, he just summarized it in great detail. The PDF he summarized is version 3.3 of the PDF, but there is an earlier version of this PDF available on the web, version 3.1 - it has been on the web for some time now.

Version 3.1 was released officially on September 23, 2024, version 3.2 was released internally on November 11, 2024 and version 3.3 was released internally on January 27, 2025. There were not huge changes between 3.1 and 3.2 and 3.3, based on what I am reading.

As Goodwin said, "It lays out the system used by human reviewers to score digital assistant replies. Responses are judged on categories such as truthfulness, harmfulness, conciseness, and overall user satisfaction. The process isn’t just about checking facts. It’s designed to ensure AI-generated responses are helpful, safe, and feel natural to users."

So if you want to see more, read Goodwin's story over here and or with what is available for download on the open web, version 3.1.

Forum discussion at X.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: September 16, 2025

Sep 16, 2025 - 10:00 am
Google Search Engine Optimization

New (But Old) Google Search Console Achievements

Sep 16, 2025 - 7:51 am
Google Search Engine Optimization

What Is Google Question Fringe Score

Sep 16, 2025 - 7:41 am
Bing Ads

Bing Image Search With Ads Mixed Into The Organic Results

Sep 16, 2025 - 7:31 am
Bing Search

Bing Testing Sticky Search Bar Header

Sep 16, 2025 - 7:21 am
Google News

Rolling Stone Publisher (Penske) Sued Google Over AI Overviews

Sep 16, 2025 - 7:11 am
 
Previous Story: Google Search Video Ads