Unsupervised Head-Modifier Detection in Search Queries

Interpreting the user intent in search queries is a key task in query understanding. Query intent classification has been widely studied. In this paper, we go one step further to understand the query from the view of head-modifier analysis. For example, given the query “popular iphone 5 smart cover,” instead of using coarse-grained semantic classes (e.g., find electronic product), we interpret that “smart cover” is the head or the intent of the query and “iphone 5” is its modifier. Query head-modifier detection can help search engines to obtain particularly relevant content, which is also important for applications such as ads matching and query recommendation. We introduce an unsupervised semantic approach for query head-modifier detection. First, we mine a large number of instance level head-modifier pairs from search log. Then, we develop a conceptualization mechanism to generalize the instance level pairs to concept level. Finally, we derive weighted concept patterns that are concise, accurate, and have strong generalization power in head-modifier detection. The developed mechanism has been used in production for search relevance and ads matching. We use extensive experiment results to demonstrate the effectiveness of our approach.

Thanks for your interests in this paper. Please also pay attentions to our ACL 2016 short text understanding tutorial: Understanding Short Texts – ACL 2016 Tutorial (opens in new tab), presented by Zhongyuan Wang (opens in new tab).