US2021136388A1PendingUtilityA1

Image processing method and device

Assignee: SZ DJI TECHNOLOGY CO LTDPriority: Dec 30, 2016Filed: Dec 14, 2020Published: May 6, 2021
Est. expiryDec 30, 2036(~10.4 yrs left)· nominal 20-yr term from priority
H04N 19/65H04N 19/17H04N 19/107H04L 1/1607H04N 19/166H04N 19/172H04N 19/89H04N 19/159
55
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

An image processing method includes sending, by a receiving terminal to a transmitting terminal according to a feedback time interval, a feedback message indicating a reception state of a received image frame sent by the transmitting terminal and received by the receiving terminal before the feedback message is sent; upon detecting a reception error of a target image frame before a first time point, sending a first feedback message indicating the reception error to the transmitting terminal at the first time point; and upon receiving, after the first time point and before a second time point, encoded data of the target image frame obtained according to an error correction mechanism from the transmitting terminal, sending a second feedback message indicating a correct reception to the transmitting terminal at the second time point. A time period between the first and second time points equals the feedback time interval.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . An image processing method comprising:
 sending, by a receiving terminal, a feedback message to a transmitting terminal according to a feedback time interval, the feedback message indicating a reception state of a received image frame sent by the transmitting terminal and received by the receiving terminal before the receiving terminal sends the feedback message, including:
 in response to detecting a reception error of a target image frame before a first time point, setting the feedback message as a first feedback message indicating the reception error, and sending the first feedback message to the transmitting terminal at the first time point; and 
 in response to receiving, after the first time point and before a second time point, from the transmitting terminal encoded data of the target image frame obtained according to an error correction mechanism, setting the feedback message as a second feedback message indicating a correct reception, and sending the second feedback message to the transmitting terminal at the second time point, the second time point being after the first time point and a time period between the first time point and the second time point equaling the feedback time interval. 
   
     
     
         2 . The method according to  claim 1 , further comprising:
 determining the feedback time interval according to a quality of a communication channel between the receiving terminal and the transmitting terminal, different qualities of the communication channel corresponding to different feedback time intervals.   
     
     
         3 . The method according to  claim 1 , further comprising:
 determining the feedback time interval as a first value during a first period of time and determining the feedback time interval as a second value different from the first value during a second period of time after the first period of time.   
     
     
         4 . The method according to  claim 1 , further comprising:
 dynamically determining the feedback time interval according to at least one of feedback channel load, instant requirements for error correction at application scenarios, or transmission status of historical data.   
     
     
         5 . The method according to  claim 4 , wherein dynamically determining the feedback time interval includes:
 increasing the feedback time interval in response to the feedback channel load reaching a threshold.   
     
     
         6 . The method according to  claim 4 , wherein dynamically determining the feedback time interval includes:
 decreasing the feedback time interval in response to a transmission accuracy being lower than a threshold.   
     
     
         7 . The method according to  claim 4 , wherein dynamically determining the feedback time interval includes:
 decreasing the feedback time interval in response to:
 a number of the feedback messages that consecutively appear and indicate the reception error is less than a first threshold; or 
 a total number of the feedback messages in a preset period of time that indicate the reception error is less than a second threshold. 
   
     
     
         8 . The method according to  claim 1 ,
 wherein the transmitting terminal is a movable device;   the method further comprising:
 determining the feedback time interval according to attitude information of transmitting terminal. 
   
     
     
         9 . The method according to  claim 8 , wherein the attitude information includes at least one of a position, an angle, a velocity, an acceleration, or an angular velocity of the transmitting terminal. 
     
     
         10 . The method according to  claim 8 , wherein:
 determining the feedback time interval according to the attitude information of transmitting terminal includes determining the feedback time interval according to the attitude information measured by a sensing system of the transmitting terminal including at least one of a gyroscope, an electronic compass, an inertial measurement unit (IMU), a visual sensor, a global positioning system (GPS), or a barometer.   
     
     
         11 . The method according to  claim 1 , further comprising:
 determining the feedback time interval by negotiation between the transmitting terminal and the receiving terminal.   
     
     
         12 . The method according to  claim 11 , wherein determining the feedback time interval by negotiation between the transmitting terminal and the receiving terminal includes:
 determining a first time interval according to at least one of feedback channel load, instant requirements for error correction at application scenarios, or transmission status of historical data;   receiving a second time interval determined by the transmitting terminal; and   determining the feedback time interval according to the first time interval and the second time interval.   
     
     
         13 . The method according to  claim 12 , wherein:
 the transmitting terminal is a movable device; and   the second time interval is determined according to attitude information of transmitting terminal.   
     
     
         14 . The method according to  claim 12 , wherein determining the feedback time interval according to the first time interval and the second time interval includes:
 determining a shorter one of the first time interval and the second time interval as the feedback time interval.   
     
     
         15 . The method according to  claim 1 , further comprising:
 receiving, from the transmitting terminal, two adjacent image frames encoded according to the error correction mechanism at an interval that is longer than the feedback time interval.   
     
     
         16 . An image processing method comprising:
 receiving, by a transmitting terminal, a first feedback message sent by a receiving terminal according to a feedback time interval and indicating a reception state of a target image frame sent by the transmitting terminal and received by the receiving terminal before the receiving terminal sends the first feedback message, the first feedback message containing a first indication indicating that a reception error of the target image frame is detected before a first time point, and the first feedback message being sent by the receiving terminal at the first time point;   obtaining encoded data of the target image frame according to an error correction mechanism;   sending the encoded data of the target image frame to the receiving terminal; and   receiving a second feedback message containing a second indication from the receiving terminal, the second indication indicating a correct reception, the second feedback message being sent by the receiving terminal at a second time point after the first time point in response to receiving the encoded data before the second time point, and a time period between the first time point and the second time point equaling the feedback time interval.   
     
     
         17 . The method according to  claim 16 , further comprising:
 determining the feedback time interval; and   sending the feedback time interval to the receiving terminal.   
     
     
         18 . The method according to  claim 17 , further comprising:
 dynamically determining the feedback time interval according to at least one of feedback channel load, instant requirements for error correction at application scenarios, or transmission status of historical data.   
     
     
         19 . The method according to  claim 17 , further comprising:
 dynamically determining the feedback time interval according to attitude information of transmitting terminal.   
     
     
         20 . The method according to  claim 16 , further comprising:
 negotiating with the receiving terminal to determine the feedback time interval.

Join the waitlist — get patent alerts

Track US2021136388A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.