4 Comments
User's avatar
Sam Mor's avatar

Fanning out into several searches and then re-ranking explains why classic keyword work still matters underneath. Search first, then context, is a useful order to remember.

Andrew Bell's avatar

Yes, in-context that makes sense. Keep in mind too, Amazon has a method called hint-augmented search which which will develop the query plans from context too.

Pritam Roy's avatar

The fan-out into 40-50 search hits before the re-rank is the part I'd sit with. If use cases and the first bullet drive that re-rank, a quick check is to ask Alexa the same mission three ways and see whether your opening line still matches what gets pulled. Search demand stays the pool; the agent just reorders it.

Andrew Bell's avatar

Yes, true. However, even searches are LLM ranked before execution.