Annotation and retrieval of personal bookmarks

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a first input associated with a bookmark and, in response to receiving the first input, obtaining context data for deriving annotations for the bookmark. An annotation engine of a system obtains multiple annotations that are derived using information included in the context data and a transcription of the first input associated with the bookmark. The annotation engine generates an importance value for each annotation. The importance value characterizes a relationship between each annotation and at least one of: the information included in the context data; or the transcription of the first input. The annotation engine generates a set of annotations for retrieving the bookmark. Each annotation in the set of annotations is generated from the obtained multiple annotations and each annotation has an importance value that exceeds a threshold value.

What is claimed is: 
     
         1 . A method implemented by a computing system, comprising:
 generating a bookmark associated with a particular message exchanged between a first user and a second user via a messaging application;   obtaining, by the computing system, context data for deriving annotations for the bookmark;   obtaining, by an annotation engine of the computing system, multiple annotations that are derived using information included in the context data and a transcription of the message associated with the bookmark;   generating, by the annotation engine, an importance value for each annotation, the importance value characterizing a relationship between each annotation and at least one of:
 i) the information included in the context data; or 
 ii) the transcription of the message; 
   generating, by the annotation engine, a set of annotations for retrieving the bookmark, each annotation in the set of annotations being generated from the obtained multiple annotations and each annotation having an importance value that exceeds a threshold value; and   using, by the computing system, a particular annotation in the set of annotations to retrieve the bookmark for subsequently accessing the particular communication in the messaging application.   
     
     
         2 . The method of  claim 1 , wherein using the particular annotation comprises:
 receiving, by the computing system, a input; and   selecting, by the annotation engine and based on the input, the particular annotation from the set of annotations to cause retrieval of the bookmark; and   using, by the computing system, the particular annotation to retrieve the bookmark for accessing the particular communication in the messaging application.   
     
     
         3 . The method of  claim 2 , wherein selecting comprises:
 analyzing a transcription of the input;   obtaining one or more terms from the transcription of the input;   for each annotation in the set of annotations:
 determining a similarity score that indicates an extent to which terms in the transcription of the input matches terms in the annotation for retrieving the bookmark; and 
   selecting the particular annotation based on the similarity score for the annotation exceeding a threshold similarity score.   
     
     
         4 . The method of  claim 1 , wherein the particular annotation is configured as a trigger to cause retrieval of the bookmark and the method further comprises:
 determining, by the computing system, that a trigger condition is satisfied based on analysis of a transcription of a input;   retrieving, by the computing system, the bookmark from a bookmark index in response to determining that the trigger condition is satisfied; and   providing, by the computing system, the bookmark for display at a client device in response to retrieving the bookmark from the bookmark index.   
     
     
         5 . The method of  claim 1 , wherein the context data for deriving the annotations further comprises at least one of:
 i) an identifier for the bookmark;   ii) a resource identifier stored as the bookmark;   iii) a resource page that is accessed using the resource identifier; or   iv) text of the resource page.   
     
     
         6 . The method of  claim 5 , wherein the context data for deriving the annotations comprises an N-gram and data describing an entity, each of the N-gram and the data describing the entity being obtained from a data source with reference to the transcription of the particular message. 
     
     
         7 . The method of  claim 5 , wherein:
 i) the resource page is generated by a web-browser application, and   ii) the resource identifier is a uniform resource locator (URL) that provides a resource address for accessing the resource page.   
     
     
         8 . The method of  claim 5 , wherein:
 i) the resource page is generated by an application accessed using a client device, the application being configured to store one or more deep-links in an application index, and   ii) the resource identifier is a uniform resource locator (URL) for the resource page and is obtained from the application index comprising address data about the application.   
     
     
         9 . The method of  claim 5 , wherein the resource identifier is at least one of:
 a) data identifying a screen image of the resource page generated by an application accessed using a client device, or   b) a deep-link that provides a resource address for accessing the resource page of the application.   
     
     
         10 . An electronic system comprising:
 one or more processing devices;   one or more machine-readable storage devices for storing instructions that are executable by the one or more processing devices to:   generate a bookmark associated with a particular message exchanged between a first user and a second user via a messaging application;   obtain, by the electronic system, context data for deriving annotations for the bookmark;   obtain, by an annotation engine of the electronic system, multiple annotations that are derived using information included in the context data and a transcription of the message associated with the bookmark;   generate, by the annotation engine, an importance value for each annotation, the importance value characterizing a relationship between each annotation and at least one of:
 i) the information included in the context data; or 
 ii) the transcription of the message; 
   generate, by the annotation engine, a set of annotations for retrieving the bookmark, each annotation in the set of annotations being generated from the obtained multiple annotations and each annotation having an importance value that exceeds a threshold value; and   use, by the electronic system, a particular annotation in the set of annotations to retrieve the bookmark for subsequently accessing the particular communication in the messaging application.   
     
     
         11 . The electronic system of  claim 10 , wherein the instructions to use the particular annotation comprise instructions to:
 receive, by the electronic system, a input; and   select, by the annotation engine and based on the input, the particular annotation from the set of annotations to cause retrieval of the bookmark; and   use, by the electronic system, the particular annotation to retrieve the bookmark for accessing the particular communication in the messaging application.   
     
     
         12 . The electronic system of  claim 11 , wherein the instructions to select comprise instructions to:
 analyze a transcription of the input;   obtain one or more terms from the transcription of the input;   for each annotation in the set of annotations:
 determine a similarity score that indicates an extent to which terms in the transcription of the input matches terms in the annotation for retrieving the bookmark; and 
   select the particular annotation based on the similarity score for the annotation exceeding a threshold similarity score.   
     
     
         13 . The electronic system of  claim 10 , wherein the particular annotation is configured as a trigger to cause retrieval of the bookmark and the instructions further comprise instructions to:
 determine, by the electronic system, that a trigger condition is satisfied based on analysis of a transcription of a input;   retrieve, by the electronic system, the bookmark from a bookmark index in response to determining that the trigger condition is satisfied; and   provide, by the electronic system, the bookmark for display at a client device in response to retrieving the bookmark from the bookmark index.   
     
     
         14 . The electronic system of  claim 10 , wherein the context data for deriving the annotations further comprises at least one of:
 i) an identifier for the bookmark;   ii) a resource identifier stored as the bookmark;   iii) a resource page that is accessed using the resource identifier; or   iv) text of the resource page.   
     
     
         15 . The electronic system of  claim 14 , wherein the context data for deriving the annotations comprises an N-gram and data describing an entity, each of the N-gram and the data describing the entity being obtained from a data source with reference to the transcription of the particular message. 
     
     
         16 . The electronic system of  claim 14 , wherein:
 i) the resource page is generated by a web-browser application, and   ii) the resource identifier is a uniform resource locator (URL) that provides a resource address for accessing the resource page.   
     
     
         17 . The electronic system of  claim 14 , wherein:
 i) the resource page is generated by an application accessed using a client device, the application being configured to store one or more deep-links in an application index, and   ii) the resource identifier is a uniform resource locator (URL) for the resource page and is obtained from the application index comprising address data about the application.   
     
     
         18 . The electronic system of  claim 14 , wherein the resource identifier is at least one of:
 a) data identifying a screen image of the resource page generated by an application accessed using a client device, or   b) a deep-link that provides a resource address for accessing the resource page of the application.   
     
     
         19 . One or more non-transitory machine-readable storage devices storing instructions that are executable by one or more processing devices to:
 generate a bookmark associated with a particular message exchanged between a first user and a second user via a messaging application;   obtain context data for deriving annotations for the bookmark;   obtain, by an annotation engine operated by one or more of the processing devices, multiple annotations that are derived using information included in the context data and a transcription of the message associated with the bookmark;   generate, by the annotation engine, an importance value for each annotation, the importance value characterizing a relationship between each annotation and at least one of:
 i) the information included in the context data; or 
 ii) the transcription of the message; 
   generate, by the annotation engine, a set of annotations for retrieving the bookmark, each annotation in the set of annotations being generated from the obtained multiple annotations and each annotation having an importance value that exceeds a threshold value; and   use a particular annotation in the set of annotations to retrieve the bookmark for subsequently accessing the particular communication in the messaging application.   
     
     
         20 . The machine readable storage devices of  claim 19 , wherein the instructions to use the particular annotation comprise instructions to:
 receive a input; and   select, by the annotation engine and based on the input, the particular annotation from the set of annotations to cause retrieval of the bookmark; and   use the particular annotation to retrieve the bookmark for accessing the particular communication in the messaging application.