What you can do
- Run test searches and review results in one place.
- Switch between demo profiles to simulate different shoppers.
- Use the Search Workbench to tune search parameters and bypass features.
- View Query Understanding to see how your search was processed.
- Get AI-powered explanations of the search pipeline.
Create a demo profile (persona)
- Go to Evaluate → Text Search.
- Open Demo Profiles and click Create.
- Add a nickname (e.g., “US returning customer”).
- (Optional) Add location, past purchases, items in cart, and prior searches.
- Save.
Use a demo profile in testing
- In Evaluate → Text Search, pick a profile from the dropdown.
- Enter a few search terms and browse the results.
- Try another profile to compare behavior.
Search Workbench
The Search Workbench panel lets you fine-tune search parameters, configure relevancy sort order, and selectively bypass features to understand their impact on results. Changes can be saved permanently or used temporarily for testing.Relevancy Sort Order
The Relevancy Sort Order section allows you to configure how search results are ranked by dragging and dropping sorting attributes.- Drag-and-drop reordering: Click and drag the grip icon to reorder sorting attributes. The order determines ranking priority, with attributes at the top having the highest influence.
- Direction toggle: Click the arrow icon to switch between ascending (↑) and descending (↓) sort order for each attribute.
- Remove attributes: Click the trash icon to remove an attribute from the sort order (except Relevance Score, which is required).
- Real-time preview: Changes update search results immediately so you can see the impact.
Quick Add Recipes
Use the Quick Add dropdown to quickly add pre-configured relevancy factors to your sort order:- Boost In-Stock Products: Prioritize products with higher SKU coverage (more variants in stock)
- Boost New Products: Prioritize recently published products
- Demote Clearance Items: Push products with high discounts lower in results
- Boost Popular Products: Prioritize products with higher sales in the last 7 days
- Boost Trending: Prioritize products with more views in the last 7 days
Saving Relevancy Changes
Click the Save button in the Relevancy Sort Order section header to save your changes permanently. The Save button only appears when you’ve made changes to the sort order.Tuning Parameters
Adjust these parameters to see how they affect search results:- Textual Weight: Controls the influence of text-based matching (0-1). Higher values prioritize keyword and semantic text matches.
- Visual Weight: Controls the influence of image similarity (0-1). Higher values prioritize visual similarity in results.
- Minimum Match: Sets the minimum similarity threshold for results to be included (0-1).
- Top K: Limits the number of vector matches considered during search.
- Multiple Factor: Adjusts how multiple query terms are weighted together.
Saving Tuning Parameters
Click the Save button in the Tuning Parameters section header to save your changes permanently. The Save button only appears when you’ve made changes to the parameters. You can also click Reset to restore default values.Bypass Options
Toggle these options to isolate specific features:- Bypass Cache: Forces a fresh search without using cached results.
- Bypass Query Expansion: Disables AI-powered query expansion to see results for the exact query only.
- Bypass Intent Modifiers: Disables automatic intent detection that may boost or filter results.
Query Understanding
The Query Understanding panel visualizes how your search query was processed through the search pipeline. Each step in the pipeline is displayed with its effect on the query:- Query Expansion: Shows synonyms and related terms added to broaden the search.
- Query Replacement: Displays any typo corrections or query rewrites applied.
- Query Cleanup: Shows preprocessing steps that cleaned or normalized the query.
- Metadata Filtering: Indicates any automatic filters applied based on query context.
- Intent Modifiers: Shows detected shopping intent and resulting boosts or filters.
- Experiment Applied: Indicates if an A/B test variant affected the search.
- Rule Applied: Shows any Search Rules that matched and modified the request.
AI Explain
Click the Explain button to generate an AI-powered explanation of why the search pipeline processed your query the way it did. This provides a natural language summary of each step and helps you understand the reasoning behind query transformations and result ranking.Flagging Problematic Outputs
When you notice a query expansion or intent modifier that produces poor results, you can flag it to improve future searches. Flagged items are automatically excluded from subsequent searches.How to flag an output
- In the Query Understanding panel, locate the problematic query expansion or intent modifier.
- Click the Flag button next to the item.
- In the flag modal, select a reason from the dropdown:
- Irrelevant to query
- Factually incorrect
- Offensive or inappropriate
- Too broad / generic
- Too narrow / specific
- Other
- Choose the flag type:
- Generally bad: Excludes this output from all searches (recommended for most cases)
- Context-specific: Only excludes this output when it appears in similar query contexts
- (Optional) Add feedback to provide additional context about the issue.
- Click Flag Output to submit.
What happens after flagging
- The flagged item is immediately added to a blacklist and excluded from future searches.
- Similar outputs are also filtered using similarity matching (90% threshold for content, 70% for query context).
Flag types explained
Generally bad flags apply globally across all searches. Use this when an output is always problematic regardless of context (e.g., offensive content, factually wrong expansions). Context-specific flags only apply when both the output content and the original query are similar to what you flagged. Use this when an output is only problematic in certain situations (e.g., a query expansion that’s helpful for some queries but misleading for others). You can select both checkboxes if the output is problematic in multiple ways.Notes
- Demo profiles are for testing only and don’t use real customer data.
- If results look off, confirm your catalog is synced and search settings are saved.
- Workbench changes can be saved permanently using the Save buttons in each section, or used temporarily for testing without saving.
- Query Understanding data is available after each search execution.