Adobe Sensei GenAI & AEM

-

 # How Adobe Sensei GenAI is Transforming AEM — A Practical Guide

## Introduction

Adobe Experience Manager (AEM) has always been a powerful content platform, but with the deep integration of **Adobe Sensei GenAI**, it is evolving from a content management system into an intelligent content engine. Whether you are an AEM Developer, Architect, or DevOps engineer, understanding how Sensei GenAI plugs into AEM will help you build smarter, faster, and more personalized digital experiences.

In this post, we'll walk through what Adobe Sensei GenAI is, how it integrates with AEM Assets and AEM Sites, and look at practical examples of how to leverage it.

---

## What is Adobe Sensei GenAI?

Adobe Sensei is Adobe's AI and machine learning framework. **Sensei GenAI** is its generative AI layer — built on top of large language models (LLMs) and image generation models — and is natively embedded into Adobe's product suite including AEM, Adobe Analytics, and Workfront.

In the context of AEM, Sensei GenAI powers:
- **Smart Tagging** in AEM Assets (DAM)
- **Auto-captioning** for images and videos
- **Content Variations** generation for AEM Sites
- **Smart Crop** for responsive image renditions
- **AI-driven Search** across the DAM

---

## 1. Smart Tagging in AEM Assets

Smart Tags use a machine learning model trained on Adobe's Sensei framework to automatically tag assets uploaded to the DAM.

### How it Works
When an asset is uploaded, AEM sends it to the Sensei Smart Tagging service, which returns a set of predicted tags. These are written back to the asset metadata under `dam:suggestedTags`.

### Enable Smart Tags — OSGi Configuration

Navigate to:
```
/system/console/configMgr → Adobe CQ DAM Smart Tags Workflow Process
```

Ensure the Smart Tag workflow is linked to the **DAM Update Asset** workflow:

```xml
<!-- /apps/your-project/config/com.adobe.cq.dam.smarttagging.impl.SmartTagsManagerImpl.xml -->
<?xml version="1.0" encoding="UTF-8"?>
<jcr:root xmlns:sling="http://sling.apache.org/jcr/sling/1.0"
          xmlns:jcr="http://www.jcp.org/jcr/1.0"
    jcr:primaryType="sling:OsgiConfig"
    trainedTagsEnabled="{Boolean}true"
    assetTagsMaxLength="{Long}25"
    minConfidence="{Double}0.5"/>
```

### Reading Smart Tags via JCR API (Java)

```java
@Component(service = SmartTagReader.class)
public class SmartTagReader {

    @Reference
    private ResourceResolverFactory resolverFactory;

    public List<String> getSmartTags(String assetPath) {
        List<String> tags = new ArrayList<>();
        Map<String, Object> param = new HashMap<>();
        param.put(ResourceResolverFactory.SUBSERVICE, "smartTagService");

        try (ResourceResolver resolver = resolverFactory.getServiceResourceResolver(param)) {
            Resource assetResource = resolver.getResource(assetPath + "/jcr:content/metadata");
            if (assetResource != null) {
                ValueMap vm = assetResource.adaptTo(ValueMap.class);
                String[] smartTags = vm.get("dam:suggestedTags", String[].class);
                if (smartTags != null) {
                    tags = Arrays.asList(smartTags);
                }
            }
        } catch (LoginException e) {
            // handle exception
        }
        return tags;
    }
}
```

---

## 2. Content Variations with Sensei GenAI (AEM Sites)

**Content Variations** is a Sensei GenAI-powered feature in AEM Sites that allows authors to generate multiple versions of copy (headlines, descriptions, CTAs) using AI — directly from the AEM UI.

### How it Works
Authors open the **Content Variations** panel in AEM Sites, provide a prompt or seed content, and Sensei GenAI returns multiple variations. These are powered by an LLM (backed by Azure OpenAI in Adobe's infrastructure).

### Calling Content Variations API Programmatically

Adobe exposes this via the **Adobe IMS + AEM Cloud API**. Here's how to call it from a custom AEM service:

```java
@Component(service = ContentVariationService.class)
public class ContentVariationService {

    private static final String CONTENT_VARIATIONS_ENDPOINT =
        "https://experience.adobe.io/genai/content-variations/v1/generate";

    public String generateVariation(String prompt, String imsToken) throws IOException {
        HttpClient client = HttpClient.newHttpClient();

        String requestBody = "{"
            + "\"prompt\": \"" + prompt + "\","
            + "\"locale\": \"en-US\","
            + "\"count\": 3"
            + "}";

        HttpRequest request = HttpRequest.newBuilder()
            .uri(URI.create(CONTENT_VARIATIONS_ENDPOINT))
            .header("Authorization", "Bearer " + imsToken)
            .header("Content-Type", "application/json")
            .header("x-api-key", "your-api-key")
            .POST(HttpRequest.BodyPublishers.ofString(requestBody))
            .build();

        HttpResponse<String> response = client.send(request,
            HttpResponse.BodyHandlers.ofString());

        return response.body();
    }
}
```

**Sample Response:**
```json
{
  "variations": [
    { "text": "Discover a smarter way to manage your content pipeline." },
    { "text": "Transform your digital experience with AI-powered content." },
    { "text": "Publish faster, personalize better — powered by Adobe Sensei." }
  ]
}
```

---

## 3. Smart Crop — AI-Driven Renditions

Smart Crop uses Sensei to automatically detect the focal point of an image and crop it for different aspect ratios (desktop, tablet, mobile) without losing the subject.

### Configure Smart Crop in Image Profile

```json
{
  "smartCropRenditions": [
    { "name": "Desktop", "width": 1920, "height": 600 },
    { "name": "Tablet",  "width": 768,  "height": 400 },
    { "name": "Mobile",  "width": 375,  "height": 300 }
  ],
  "enableSmartCrop": true
}
```

Apply this Image Profile to a DAM folder via:
```
AEM Assets → Folder Properties → Image Profile → Select your profile
```

### Using Smart Crop Rendition in HTL (Sightly)

```html
<sly data-sly-use.image="core/wcm/components/image/v3/image/image.js"/>
<img src="${image.src @ smartcrop='Desktop'}"
     alt="${image.alt}"
     loading="lazy" />
```

---

## 4. AI-Powered Search in DAM

Sensei enhances AEM's Omnisearch with **visual similarity search** and **semantic search**.

### Enable Visual Search — OSGi Config

```xml
<!-- com.adobe.cq.dam.visual.similarity.impl.VisualSimilaritySearchServiceImpl.xml -->
<?xml version="1.0" encoding="UTF-8"?>
<jcr:root xmlns:sling="http://sling.apache.org/jcr/sling/1.0"
          xmlns:jcr="http://www.jcp.org/jcr/1.0"
    jcr:primaryType="sling:OsgiConfig"
    enabled="{Boolean}true"
    similarityThreshold="{Double}0.75"
    maxResults="{Long}20"/>
```

### Trigger Visual Search via API

```bash
curl -X POST \
  "https://your-aem-instance/bin/dam/visual-search" \
  -H "Authorization: Bearer <token>" \
  -F "asset=@/path/to/reference-image.jpg" \
  -F "limit=10"
```

---

## Architecture Overview

```
Author → Upload Asset to DAM
              ↓
     DAM Update Asset Workflow
              ↓
    Sensei Smart Tagging API  ←→  Adobe IMS Auth
              ↓
    Tags written to JCR metadata
              ↓
    Available in Search / Personalization Engine
```

---

## Key Takeaways

- Adobe Sensei GenAI is **natively embedded** in AEM — no third-party AI setup needed for core features.
- Smart Tags, Smart Crop, and Content Variations are the **three most impactful** AI features for AEM teams today.
- All Sensei services communicate via **Adobe IMS tokens** — ensure your service users and API keys are correctly configured in Cloud Manager environment variables.
- Smart Tag confidence threshold (`minConfidence`) should be tuned based on your content type — `0.5` works well for generic assets, go higher (`0.7+`) for brand-specific content.

---

## What's Next?

In the next post, we'll explore **AEM + AI Content Generation Workflows** — how to connect OpenAI / Claude APIs directly into AEM workflows to automate content creation at scale.

---

*Published on aemrules.com | Tags: AEM, Adobe Sensei, GenAI, AEM Assets, Smart Tags, Content Variations, AEM Sites*

Comments

Post a Comment

Popular Posts

Configure/Decoding AEM AuditLogs

-
Image
AEM Developers, Infrastructure Engineers / Dev-ops teams working in the financial domain regularly come across a challenge for event auditing in AEM. This helps in identifying most of the activities happening in AEM. Audit logs are a very effective way to debug the content issue & to know what all is happening in your environment and by whom. This article addresses in a simple way on how to enable the audit logs, its different ways, and how to understand the audit logs.  This article covers the following - How can we enable Audit logs in AEM. How can we read and understand the Audit logs/ tools to use it. Audit log on file system in crx-quickstart/logs folder.   Audit logs for User creation / Modification. How can you archive/purge the audit logs. How can we enable Audit logs in AEM?            By Default, the Audit logs are pre-configured in AEM, for a few basic operations of DAM and for all other operations of Pages ...
Read more

How to Increase Apache Request Per Second ?

-
Image
How to Increase Apache Request Per Second ? By default, Apache web server is configured to support 160 requests per second. As your website traffic increases, Apache will start dropping additional requests and this will spoil customer experience.  Here’s how to increase Apache requests per second. 1. Install MPM module We need to install MPM Apache module to be able to increase Apache requests per second. You can use mpm_worker or mpm_event module for this, instead of mpm_prefork module which consumes a lot of memory. You can easily install MPM module in Apache with following command For CentOS7/RHEL7 : Adjust /etc/httpd/conf.modules.d/00-mpm.conf Comment the line LoadModule mpm_prefork_module modules/mod_mpm_prefork.so by adding # in front of it. Uncomment the line LoadModule mpm_worker_module modules/mod_mpm_worker.so by removing # in front of it. For Ubuntu/Debian :  Use a2dismod / a2enmod to disable mpm_prefork and enable mpm_worker 2. Increase Max Connections in Apach...
Read more

AdobeDispatcherHacks ".statfile"

-
Image
AEM DISPATCHER STATFILE UNDERSTANDING & CACHE INVALIDATION:- AEM Developers, Infrastructure Engineers regularly come across a challenge on decoding the statfile and using it efficiently especially statfile becomes highly relevant in a multi-tenanted environment with different project teams controlling different sites. The article addresses in a simple way on how to understand the mechanisms of stat file and gives a detailed explanation of how it can be used in a multi-tenant environment model.  The image for your reference as a quick overview of the data flow, before we take a deep dive.  This article covers - 1 - When dispatcher serves the old version of the content. How to avoid it. 2- Cache invalidation mechanism. Assumption - If you are reading this article, I believe you would have a basic understanding of Dispatcher and it's configuration. Firstly let’s set the initial configuration for the cache invalidation section ...
Read more

how to clear dispatcher cache in aem ?

-
Image
How to clear dispatcher cache in aem ? As you may know, the Dispatcher cache in Adobe Experience Manager (AEM) is used to improve the performance of your website by caching static resources and pages. However, sometimes you may need to clear the cache to ensure that the latest content and changes are displayed on your website. In this blog post, we'll show you how to clear the Dispatcher cache in AEM.   This method will clear the entire Dispatcher cache, including all cached pages and resources. Keep in mind that clearing the cache may affect the performance of your website, as it may take some time to rebuild the cache. Clear Cache using the Dispatcher Flush Agent You can use the Dispatcher Flush Agent. Follow these steps:   Log in to your AEM instance and navigate to http://localhost:4502/etc/replication/agents.author.html . Click on the "Dispatcher Flush" agent to open the agent's configuration page. Clic...
Read more

How Does S3 works with AEM ?

-
Image
How Does S3 works with AEM  ? Accommodating a huge amount of assets in any content management platform is challenging. Adobe Experience Manager offers an integration with the Amazon S3 storage solution, allowing binary data for images, documents and videos to be stored in an S3 bucket. Amazon S3 is highly performant and offers nearly infinite storage capacity.   When talking about terabyte storage, performance is everything. The choices made during the planning and architecting phase can literally make or break the performance of a CMS system and the websites running on it.  Adobe Experience Manager offers a number of storage methods, each offering a different way of storing data. Each of these options has its strengths and weaknesses. In AEM storage the mechanisms are called Micro Kernels, or MK for short.  In this article we will look at the AEM with S3 data store. For the detailed steps for S3 configuration you can refer -  https://www.aemrules.com/...
Read more

AEM Security Headers

-
Image
Added Security in AEM via Headers:-  In design a robust architecture AEM Architects, Developers, Infrastructure Engineers regularly come across a challenge for adding the additional security in AEM.  In this article, we will understand the key security headers which can be used in webserver and give an additional layer of security for your Publish server and content.  I have used Apache webserver for all the examples.  This article covers -  1 - X-XSS protection  2 - HTTP Strick Transport Security 3 - X-Frame Option  4 - Content Security  1- X-XSS Protection:-  X-XSS-Protection header can prevent some level of XSS (cross-site-scripting ) attacks.  Configure the x-xss-protection header to 1 in your apache httpd.conf file or Vhost file if you have for all domains as applicable.   <IfModule mod_headers.c>   <FilesMatch "\.(htm|html)$">               ...
Read more

How to Sync HMAC in AEM ?

-
Image
Crypto Support in AEM (Syncing HMAC among AEM instances) AEM OOTB provides a feature where we can encrypt the secured and confidential data through OOTB AEM Crypto Support and store it in a code repository in the form of OSGi configuration. Crypto Support is based on keys (hmac and master files) which are unique for each AEM instance. Encrypted text generated for the same plain-text string on one AEM instance will be different from another instance. This can raise alarms in cases where we have the same OSGi configuration values shared among Author and Publish instances under the same topology. For e.g. /apps/project/config.prod/com.day.cq.db.dbservice.xml Here DB password for Default DB Service will be same across all Prod AEM instances. So, in order to make sure that the same encrypted value works on all Prod instances, we will have to sync hmac and master files among Prod Author and Publish instances. Vital Points to know before HMAC SYNC  Sync of HMAC/keys will break the AEM SSL...
Read more

OakAccess0000: Access denied

-
Image
ERROR :-   OakAccess0000: Access denied We often observe while doing the AEM development or in live running environment we get the error code  OakAccess0000 , especially while running a workflow or any asset upload. This issue disrupts normal operation. As content authors are unable to perform essential task like uploading or managing content, leading to business impact.   This impact the business as content author are unable to upload any content.  Error stack trace :- Javax.jcr.AccessDeniedException: OakAccess0000: Access denied  at org.apache.jackrabbit.oak.api.CommitFailedException.asRepositoryException(CommitFailedException.java:232) [org.apache.jackrabbit.oak-api:1.10.6]  at org.apache.jackrabbit.oak.api.CommitFailedException.asRepositoryException(CommitFailedException.java:213) [org.apache.jackrabbit.oak-api:1.10.6]  at org.apache.jackrabbit.oak.jcr.delegate.SessionDelegate.newRepositoryException(SessionDelegate.java:669) [org.apache...
Read more

AEM ACL and how they are evaluated

-
Image
ACL's and how they are evaluated ? AEM Developers, Infrastructure Engineers / Dev-ops teams working in any domain regularly come across a challenge for understanding the ACL & its evaluation mechanism.  Adobe Experience Manager is designed to cater for content authoring of multiple sites by multiple content authors. Naturally, this process needs to be controlled by strict Access Control Lists (ACLs) to manage. AEM WCM uses Access Control Lists (ACLs) to organise the permissions being applied to the various pages. This article addresses in a simple way on how to understand the ACL's , its different ways,  This article covers the following - How can we read and understand the ACL.  Evaluation of user permissions.  Concurrent Permission on ACL Access Control Lists are made up of the individual permissions and are used to determine the order in which these permissions are actually applied. The list is formed according to the hierarchy of the pages under consideration...
Read more

Dispatcher flush from AEM UI

-
Image
How to Delete Dispatcher cache without logging into the Dispatcher servers? Our Authoring team faces day to day challenges while deleting/flush the dispatcher cache. when the changes are not visible on server. They have to be depended on the IT operations/Dev ops teams to do the same. Which some time get very much time consuming for a small work.  In this article we will see it can be configure and used by Author UI itself.  This will allow  AEM authors (or “super authors”) to flush parts of the dispatcher cache manually without the involvement of IT Operations. How to Use 1. Log in to AEM Author 2. Download the ACS commons tool from  ACS Commons Official page 3. Install the downloaded package via aem package manager.   4. Make sure you create the dispatcher flush agents on Author for all Dispatchers. from http://<<host:port>>/miscadmin#/etc/replication/agents.author, check the NOTE's part at the end of page. 5. Navigate to Tools 6. Under the ac...
Read more