US2023204769A1PendingUtilityA1

Ranging device, electronic device, sensor system, and control method

Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPPriority: Jun 4, 2020Filed: May 28, 2021Published: Jun 29, 2023
Est. expiryJun 4, 2040(~13.8 yrs left)· nominal 20-yr term from priority
Inventors:Shoji Seta
G01S 17/08G01S 7/4816G01S 17/894G01S 17/88G01S 7/497G01S 17/10G01S 17/931G01S 17/86G01S 7/4813G01S 7/4865G01S 17/93G02B 7/40G03B 13/36G01C 3/06G01C 3/00
53
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

Accurate information is acquired even in a case where a sensor is deteriorated. A ranging device according to an embodiment includes: a sensor (11) that acquires ranging information; a field-programmable gate array (FPGA) (131) that executes predetermined processing on the ranging information acquired by the sensor; and a memory (15) that stores data for causing the FPGA to execute the predetermined processing.

Claims

exact text as granted — not AI-modified
1 . A ranging device comprising:
 a sensor that acquires ranging information;   a field-programmable gate array (FPGA) that executes predetermined processing on the ranging information acquired by the sensor; and   a memory that stores data for causing the FPGA to execute the predetermined processing.   
     
     
         2 . The ranging device according to  claim 1 , wherein the data in the memory is updated depending on an analysis result of the ranging information. 
     
     
         3 . The ranging device according to  claim 1 , further comprising:
 a transmission section that transmits the ranging information on which the predetermined processing has been executed to a predetermined network; and   a reception section that receives update data for updating the FPGA, the update data generated depending on an analysis result of the ranging information transmitted to the predetermined network,   wherein the data in the memory is updated with the update data.   
     
     
         4 . The ranging device according to  claim 3 ,
 wherein the transmission section wirelessly transmits the ranging information to the predetermined network, and   the reception section wirelessly receives the update data from the predetermined network.   
     
     
         5 . The ranging device according to  claim 4 , further comprising:
 an encryption section that encrypts the ranging information; and   a decryption section that decrypts the update data.   
     
     
         6 . The ranging device according to  claim 1 , further comprising a processor that analyzes the ranging information, generates update data for updating the FPGA depending on a result of the analysis, and updates the data in the memory with the update data that has been generated. 
     
     
         7 . The ranging device according to  claim 6 , further comprising
 an analysis circuit that analyzes the ranging information by machine learning using at least one of a deep neural network (DNN) or a convolutional neural network (CNN),   wherein the processor analyzes the ranging information on a basis of a result of the machine learning by the analysis circuit.   
     
     
         8 . The ranging device according to  claim 6 ,
 wherein the FPGA comprises an analysis circuit that analyzes the ranging information by machine learning using at least one of a deep neural network (DNN) or a convolutional neural network (CNN), and   the processor analyzes the ranging information on a basis of a result of the machine learning by the analysis circuit.   
     
     
         9 . The ranging device according to  claim 1 , further comprising:
 a transmission section that transmits the ranging information on which the predetermined processing has been executed to a predetermined network;   a reception section that receives update data for updating the FPGA, the update data generated depending on an analysis result of the ranging information transmitted to the predetermined network;   a processor that analyzes the ranging information and generates the update data for updating the FPGA depending on a result of the analysis; and   a switching section that switches between whether to transmit the ranging information to the predetermined network via the transmission section or to input the ranging information to the processor,   wherein the data in the memory is updated with the update data received by the reception section or the update data generated by the processor.   
     
     
         10 . The ranging device according to  claim 1 ,
 wherein the ranging information is ranging data, and   the sensor comprises a light receiving section comprising a plurality of photoelectric conversion elements and a signal processing circuit that reads the ranging data from the light receiving section.   
     
     
         11 . The ranging device according to  claim 1 , wherein the predetermined processing includes at least one of CDS, AD conversion, black level processing, phase component calculation, phase data processing, luminance data processing, cycle error correction, temperature correction, distortion correction, parallax correction, correction of a control system that controls the sensor, automatic exposure, automatic focus, flaw correction, noise correction, flying pixel correction, or depth calculation. 
     
     
         12 . The ranging device according to  claim 1 , wherein the data includes circuit data for incorporating a circuit configuration for executing the predetermined processing in the FPGA and setting data including a parameter to be set in the circuit configuration. 
     
     
         13 . The ranging device according to  claim 1 , further comprising a processor that executes the predetermined processing in cooperation with the FPGA. 
     
     
         14 . The ranging device according to  claim 1 , further comprising:
 a first chip comprising the sensor;   a second chip comprising the FPGA; and   a third chip including the memory,   wherein the ranging device has a stack structure in which the first to third chips are stacked.   
     
     
         15 . The ranging device according to  claim 1 , further comprising:
 a first chip comprising the sensor; and   a second chip comprising the FPGA and the memory,   wherein the ranging device has a stack structure in which the first to second chips are stacked.   
     
     
         16 . The ranging device according to  claim 13 , further comprising:
 a first chip comprising the sensor; and   a second chip comprising the FPGA, the memory, and the processor,   wherein the ranging device has a stack structure in which the first to second chips are stacked.   
     
     
         17 . The ranging device according to  claim 14 ,
 wherein the ranging information is depth data,   the sensor comprises a light receiving section comprising a plurality of photoelectric conversion elements and a signal processing circuit that reads image data from the light receiving section, and   the first chip comprises a fifth chip comprising the light receiving section and a sixth chip comprising the signal processing circuit.   
     
     
         18 . An electronic device comprising:
 a sensor that acquires ranging information;   an FPGA that executes predetermined processing on the ranging information acquired by the sensor; and   a memory that stores data for causing the FPGA to execute the predetermined processing.   
     
     
         19 . A sensor system in which an electronic device and a server are connected via a predetermined network,
 wherein the electronic device comprises:   a sensor that acquires ranging information;   an FPGA that executes predetermined processing on the ranging information acquired by the sensor;   a memory that stores data for causing the FPGA to execute the predetermined processing;   a transmission section that transmits the ranging information on which the predetermined processing has been executed to a predetermined network; and   a reception section that receives update data for updating the FPGA, the update data generated depending on an analysis result of the ranging information transmitted to the predetermined network,   the server analyzes the ranging information received from the electronic device via the predetermined network, generates the update data for updating the FPGA depending on a result of the analysis, and transmits the update data that has been generated to the predetermined network, and   the data in the memory is updated with the update data received by the reception section via the predetermined network.   
     
     
         20 . A control method comprising the steps of:
 analyzing ranging information acquired by a sensor; and   changing at least one of a circuit configuration of an FPGA that executes predetermined processing on the ranging information or a setting value of the circuit configuration depending on an analysis result of the ranging information.

Join the waitlist — get patent alerts

Track US2023204769A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.