US2022391464A1PendingUtilityA1

Query entity-experience classification

Assignee: MICROSOFT TECHNOLOGY LICENSING LLCPriority: Aug 9, 2019Filed: Aug 15, 2022Published: Dec 8, 2022
Est. expiryAug 9, 2039(~13 yrs left)· nominal 20-yr term from priority
G06V 10/776G06V 10/82G06V 10/774G06V 10/764G06F 16/9538G06F 16/9032G06N 3/044G06F 18/24G06N 3/045G06F 16/90332G06F 16/953G06N 20/00G06N 3/084G06N 20/10G06F 16/9532G06K 9/6267G06N 3/09G06N 3/0464G06N 3/0442
66
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

The technology described herein makes improved use of limited screen space on a search results page by determining whether to present a question-and-answer experience and/or an entity details experience. This determination effects the amount of information presented and the format in which it is presented. In general, the question-and-answer experience provides less information and is more targeted to a question and query terms other than the entity. In contrast, the entity details experience provides more information about the entity that is not tailored to the query beyond the entity being included in the query. In one aspect, the determination of whether to show a question-and-answer experience and/or an entity details experience is based, at least in part, on an entity-details intent classification score (“intent classification score”) generated by a machine classification system. The classification score may be processed in combination with other criteria to make a final determination.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . A method for providing relevant search result content in an experience format that is optimized to a query, comprising:
 receiving, at a search engine, a query from a user, the query including an entity;   determining an entity-details intent classification score for the query using a machine classifier;   identifying a type for a question-and-answer experience that would be presented by the search engine in response to the query;   determining that an entity-details intent is associated with the query when the entity-details intent classification score is above a threshold score;   determining that the type for the question-and-answer experience satisfies a type criteria; and   causing the question-and-answer experience to be output to the user, rather than an entity-details experience, because the question-and-answer experience satisfies the type criteria.   
     
     
         2 . The method of  claim 1 , wherein the type criteria is the question-and-answer experience matching a plurality of question-and-answer types. 
     
     
         3 . The method of  claim 2 , wherein the plurality of question-and-answer types include a healthcare response and a list response. 
     
     
         4 . The method of  claim 1 , wherein the type criteria is the question-and-answer experience being generated from a source on a curated source list. 
     
     
         5 . The method of  claim 4 , wherein the curated source list includes educational reference documents. 
     
     
         6 . The method of  claim 1 , wherein the method further comprises training the machine classifier using labeled edge case training queries that are identified using a preliminary classifier trained using a small set of labeled training queries, wherein the small set comprises less than 1/10 a number of total training queries used to train the machine classifier. 
     
     
         7 . The method of  claim 1 , wherein the method further comprises determining that the query matches a specific query within a hotfix list, wherein the hotfix list includes one or more specific queries that should not be assigned an entity-experience intent. 
     
     
         8 . A method for providing relevant search result content in an experience format that is optimized to a query comprising:
 receiving, at a search engine, a query from a user, the query including an entity;   determining an entity-details intent classification score for the query using a machine classifier;   identifying a type for a question-and-answer experience that would be presented by the search engine in response to the query;   determining that an entity-details intent is not associated with the query when the entity-details intent classification score is below a threshold score;   determining that the type for the question-and-answer experience satisfies a type criteria; and   causing the question-and-answer experience to be output to the user, rather than an entity-details experience, because the entity-details intent is not associated with the query.   
     
     
         9 . The method of  claim 8 , wherein the type criteria is the entity not exactly matching a title of the entity-details experience. 
     
     
         10 . The method of  claim 8 , further comprising identifying information about the question-and-answer experience that would be presented by the search engine in response to the query, wherein the type criteria is a similarity score between content in the question-and-answer experience having greater than a threshold similarity to content in the entity-details experience. 
     
     
         8 . The method of  claim 8 , further comprising:
 identifying information about the question-and-answer experience that would be presented by the search engine in response to the query,   wherein the type criteria comprises the question-and-answer experience matching a plurality of question-and-answer types on a list.   
     
     
         9 . The method of  claim 8 , further comprising:
 identifying information about the question-and-answer experience that would be presented by the search engine in response to the query,   wherein the type criteria comprises the question-and-answer experience being generated from a source on a curated source list.   
     
     
         10 . The method of  claim 8 , wherein the machine classifier is a support vector machine. 
     
     
         11 . The method of  claim 12 , wherein the question-and-answer experience includes a subset of content about the entity that is selected from a full set of content about the entity based on terms in the query different from terms that identify the entity. 
     
     
         12 . The method of  claim 8 , wherein the method further comprises determining that the query matches a specific query within a hotfix list, wherein the hotfix list includes one or more specific queries that should not be associated with an entity-experience intent. 
     
     
         13 . One or more computer storage media that, when executed by a computing device, causes the computing device to providing a relevant search result content in an experience format that is optimized to a query, the method comprising:
 receiving, at a search engine, a query from a user, the query including an entity;   determining an entity-details intent classification score for the query using a machine classifier;   identifying information about a question-and-answer experience that would be presented by the search engine in response to the query;   identifying information about an entity-details experience that would be presented by the search engine in response to the query;   determining that an entity-details intent is not associated with the query using a plurality of rules that take the entity-details intent classification score, the information about the question-and-answer experience, and the information about the entity-details experience as input; and   outputting the question-and-answer experience to the user.   
     
     
         14 . The media of  claim 13 , wherein one of the plurality of rules comprises the entity-details intent classification score being above a threshold score and the question-and-answer experience matching a plurality of question-and-answer types on a curated source list. 
     
     
         15 . The media of  claim 16 , wherein one of the plurality of rules comprises the entity-details intent classification score being below a threshold score. 
     
     
         16 . The media of  claim 13 , wherein one of the plurality of rules comprises the entity not exactly matching a title of the entity-details experience. 
     
     
         17 . The media of  claim 16 , wherein one of the plurality of rules comprises a similarity score between content in the question-and-answer experience not having greater than a threshold similarity to content in the entity-details experience.

Join the waitlist — get patent alerts

Track US2022391464A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.