[Meta] SEO Track for the Drupal AI Initiative

Just are some ideas for tools for an agent/agents:

1. Create a tool to run Lighthouse against the page, using lighthouse-php or something similar.
2. SERP API tool integration will be done soon in https://www.drupal.org/project/serpapi → , then you should be able to ask the agent for how your SERP differs from the top 10 competitors for a search word in your region, to figure out what you needs for more CTA.
3. 404 spotter tool - a tool that can do a head request to every page anonymously with the GoogleBot or other agent, to see if you have 404 links.
4. More complex, is to have an LLM look at the content of each of the external pages, to make sure that a link did not get updated with malicious/low ranking content, that harms more then helps.
5. Chromium screenshot tool already exists, you can use that to take a photo of ATF and ask what needs to be improved for lowered bounce rate, lowered exit rate and higher scroll rate. (its indirect SEO, but if you have a high rate of any of those, it helps with asking experts or if you are a beginner - the AI)
6. A lot of things are tools, that could easily have a GUI, but its nice to have one agent that can spot check things like - good urls, missing path aliases, missing canonicals, all meta data available.

Thanks for the ideas Marcus!!!

We are currently doing an AI SEO project with one of our clients. On their side there is an experienced SEO specialist. From his side the main SEO works arises around the "focus keyword".

Currently we are thinking around the lines of adding a field to all content types called "Focus keyword". This will be used in various use cases such as generating title texts, preview texts (meta tags, cards, introductions, etc.), and content. It will also be used for internal linking to make sure the link texts use the focus keyword of the link target pages.

We are currently exploring what more we can do to make an SEO specialists day to day job working with content creators more efficient.

I think conceptually the issue could be split in SEO analysis (figure out what is going on) and SEO content creation (create or optimize content that ranks).

Once we have first versions, I will share the results with you.

Thanks @breidert ! We have this in the SEO Tools recipe already in Drupal CMS from the Real Time SEO for Drupal module. That module analyzes the content of the page and runs it through the yoast,js library. It would be great if we could use that for additional SEO analysis to keep the data architecture what we already have.

For reference: Drupal CMS SEO Tools

If we want to pick up the idea with the focus keyword, it would fit nicely as a new field called field_seo_focus_keyword and use it when generating content for field_seo_title and field_seo_description.

@breidert:

SEO was ranked the 7th most important AI feature for Drupal (out of 34) in the survey (216 AI professionals, business leaders, and technical decision makers from 199 organizations). The main points respondents raised about SEO were:

Positive Feedback:

• SEO Optimizer seen as highly beneficial, automating tasks like generating structured data (JSON-LD) and auditing for best practices.
• Potential for time-saving for developers and content teams.
• Integration with existing SEO modules and multilingual schema support desired.
• Could enhance content discoverability for search engines and AI systems.
• Suggestions for features like title suggestions and auto-tagging.
• Importance for API and MCP server connections highlighted.

Critical Feedback:

• Skepticism about traditional SEO's continued relevance.
• AI for SEO might be unnecessary if data is well-structured.
• Concerns that search engines could perform SEO optimization more effectively.
• Sentiment that SEO is becoming a "zero-sum game."
• Traditional SEO and manual metadata becoming less crucial.
• Content quality, user behavior, and semantic relevance prioritized by AI and search engines.

Adding credit for work

@breidert and I collaborated aggregating feedback from here and the official AI Initiative survey to create a roadmap for the first AI SEO recipe.

Our plan can be found in this Google doc.

Development will happen in the ai_recipe_seo_optimizer → project on Drupal.org

Currently blocked by: ✨ Config action to set a third party setting of a display (form or view) component Active

Work will happen in https://www.drupal.org/project/ai_recipe_seo_optimizer →