Frame Synchronization Controller, Controlling Method, Multi-Camera Device and Storage Medium

Abstract

The disclosure provides a frame synchronization controller, controlling method, multi-camera device, and storage medium. The frame synchronization controller is coupled to a plurality of cameras. The plurality of cameras have a plurality of shooting frame rates, polarities, pulse widths, and/or phases. The frame synchronization controller is configured to implement operations including: obtaining a frame synchronization signal; separately determining a synchronization driving signal, adapted to the shooting frame rate, the polarity, the pulse width, and/or the phase of each camera, according to the frame synchronization signal; and transmitting each synchronization driving signal to a corresponding camera, to drive the plurality of cameras to perform synchronous shooting with a plurality of frame rates, a plurality of polarities, a plurality of pulse widths, and/or a plurality of phases.

What is claimed is: 
     
         1 . An electronic device, comprising:
 one or more processors; and   memory coupled to the one or more processors, the memory storing one or more programs configured for execution by the one or more processors, the one or more programs including instructions for:
 obtaining a frame synchronization signal associated with a plurality of cameras, wherein the plurality of cameras have a plurality of shooting parameters, and the plurality of shooting parameters include at least one of a frame rate, a polarity, a pulse width, and a phase; 
 separately determining a synchronization driving signal, adapted to a shooting parameter of each camera, according to the frame synchronization signal; and 
 transmitting each synchronization driving signal to a corresponding camera, to drive the plurality of cameras to perform synchronous shooting, according to the plurality of shooting parameters. 
   
     
     
         2 . The electronic device of  claim 1 , wherein the plurality of cameras comprise at least one master camera, and obtaining the frame synchronization signal further comprises:
 obtaining the frame synchronization signal with a first shooting parameter through the master camera, wherein the first shooting parameter comprises at least one of a first frame rate, a first polarity, a first pulse width and a first phase.   
     
     
         3 . The electronic device of  claim 2 , wherein the plurality of cameras further comprise at least one slave camera, and separately determining the synchronization driving signal, adapted to the shooting parameter of each camera, according to the frame synchronization signal further comprises:
 determining a second shooting parameter of the slave camera, wherein the second shooting parameter correspondingly comprises at least one of a second frame rate, a second polarity, a second pulse width and a second phase; and   modulating the frame synchronization signal according to the second shooting parameter, to generate the synchronization driving signal adapted to shooting parameters of the master camera and the slave camera.   
     
     
         4 . The electronic device of  claim 3 , wherein:
 the plurality of cameras are divided into a plurality of camera groups;   the plurality of cameras in each of the camera groups have same shooting parameter;   the plurality of cameras between different camera groups have different shooting parameters; and   separately determining the synchronization driving signal, adapted to the shooting parameter of each camera, according to the frame synchronization signal further comprises:
 determining a shooting parameter that need to be modulated according to camera group which the master camera and the slave camera belong, wherein the master camera and the slave camera belong to same camera group or different camera groups; and 
 modulating the frame synchronization signal according to the shooting parameter that need to be modulated, to generate a synchronization driving signal with the second shooting parameter. 
   
     
     
         5 . The electronic device of  claim 1 , wherein the electronic device further comprises at least one subsystem, and obtaining the frame synchronization signal further comprises:
 obtaining a subsystem operating signal with a third shooting parameter through the subsystem, wherein the third shooting parameter comprises at least one of a third frame rate, a third polarity, a third pulse width and a third phase; and   determining the frame synchronization signal according to the subsystem operating signal.   
     
     
         6 . The electronic device of  claim 5 , wherein the subsystem further comprises a communicator coupled to an application processor of an extended reality display device, and obtaining the frame synchronization signal further comprises:
 obtaining a vertical synchronization signal with the third shooting parameter from the application processor through the communicator; and   determining the frame synchronization signal according to the vertical synchronization signal.   
     
     
         7 . The electronic device of  claim 6 , wherein the application processor further generates a virtual image to be synthesized along with the vertical synchronization signal, the virtual image has a first distortion, a real image to be synthesized that is captured by the plurality of cameras has a second distortion, and determining the frame synchronization signal according to the vertical synchronization signal further comprises:
 obtaining a first accumulation duration of a first accumulation data amount required for correcting the virtual image, and a second accumulation duration of a second accumulation data amount required for correcting the real image, to determine a synchronization delay; and   determining a triggering time of the frame synchronization signal, according to a triggering time of the vertical synchronization signal and the synchronization delay.   
     
     
         8 . The electronic device of  claim 7 , further comprises an internal memory, wherein the one or more programs further comprise instructions for:
 retrieving and caching the virtual image from the application processor at a first transmission speed; and   retrieving and caching the real image from the plurality of cameras at a second transmission speed;   wherein the first accumulation duration is determined according to a ratio of the first accumulation data amount to the first transmission speed, and the second accumulation duration is determined according to a ratio of the second accumulation data amount to the second transmission speed.   
     
     
         9 . The electronic device of  claim 8 , wherein the electronic device further comprises a data processor, and the one or more programs further comprise instructions for:
 in response to a trigger signal generated by the data processor at regular intervals, transmitting the virtual image of the first accumulation data amount and the real image of the second accumulation data amount, cached in the internal memory, to the data processor to perform distortion removal and image synthesis; and   transferring a synthesized image obtained from the image synthesis to an external display screen to perform image display.   
     
     
         10 . The electronic device of  claim 5 , wherein the subsystem comprises a communicator coupled to an external display screen, and obtaining the frame synchronization signal further comprises:
 obtaining a display channel refresh signal with the third shooting parameter from the external display screen through the communicator; and   determining the frame synchronization signal according to the display channel refresh signal.   
     
     
         11 . The electronic device of  claim 10 , wherein separately determining the synchronization driving signal, adapted to the shooting parameter of each camera, according to the frame synchronization signal further comprises:
 determining the synchronization driving signal, indicating frame rate and phase, to drive each of the plurality of cameras to capture images, according to the third frame rate and the third phase of the display channel refresh signal.   
     
     
         12 . The electronic device of  claim 1 , wherein the electronic device is further coupled to an external display screen, and the one or more programs further comprise instructions for:
 determining a synchronization driving signal adapted to a display parameter of the external display screen, according to the frame synchronization signal, wherein the display parameter comprises at least one of a refresh rate, the polarity, a duty cycle, and the phase; and   transmitting the synchronization driving signal to the external display screen, to drive the external display screen to perform synchronous displaying that is corresponding to the display parameter.   
     
     
         13 . The electronic device of  claim 1 , wherein separately determining the synchronization driving signal, adapted to the shooting parameter of each camera, according to the frame synchronization signal further comprises:
 obtaining at least one of system power consumption parameter and system bandwidth load parameter of the electronic device;   determining the shooting parameter of each camera, according to the at least one of system power consumption parameter and system bandwidth load parameter; and   modulating the frame synchronization signal according to the shooting parameter, to generate the synchronization driving signal adapted to the shooting parameter of each camera.   
     
     
         14 . The electronic device of  claim 13 , wherein the electronic device further comprises a bus monitor coupled to an extended reality display device to obtain the system power consumption parameter thereof, and determining the shooting parameter of each camera, according to the system power consumption parameter further comprises:
 in response to the system power consumption parameter reaching a preset first threshold, transmitting a frame rate reduction request to a signal generator that generates a vertical synchronization signal, to reduce a third frame rate of at least one non-real-time camera among the plurality of cameras; and   in response to the system power consumption parameter decreasing to a preset second threshold, transmitting a frame rate recovery request to the signal generator to recover the third frame rate of the at least one non-real-time camera, wherein the preset second threshold is not greater than the preset first threshold.   
     
     
         15 . The electronic device of  claim 13 , wherein the electronic device further comprises a bus monitor coupled to an extended reality display device to obtain the system bandwidth load parameter thereof, and determining the shooting parameter of each camera according to the system bandwidth load parameter further comprises:
 in response to the system bandwidth load parameter reaching a preset third threshold, transmitting a frame rate reduction request to a signal generator that generates a vertical synchronization signal, to reduce a third frame rate of at least one non-real-time camera among the plurality of cameras; and   in response to the system bandwidth load parameter decreasing to a preset fourth threshold, transmitting a frame rate recovery request to the signal generator to recover the third frame rate of the at least one non-real-time camera, wherein the preset fourth threshold is not greater than the preset third threshold.   
     
     
         16 . The electronic device of  claim 1 , wherein the electronic device further comprises the plurality of cameras. 
     
     
         17 . A method for controlling frame synchronization, comprising:
 obtaining a frame synchronization signal associated with a plurality of cameras, wherein the plurality of cameras have a plurality of shooting parameters, and the plurality of shooting parameters include at least one of a frame rate, a polarity, a pulse width, and a phase;   separately determining a synchronization driving signal, adapted to a shooting parameter of each camera, according to the frame synchronization signal; and   transmitting each synchronization driving signal to a corresponding camera, to drive the plurality of cameras to perform synchronous shooting, according to the plurality of shooting parameters.   
     
     
         18 . The method of  claim 17 , wherein the plurality of cameras comprise at least one master camera, and obtaining the frame synchronization signal further comprises:
 obtaining the frame synchronization signal with a first shooting parameter through the master camera, wherein the first shooting parameter comprises at least one of a first frame rate, a first polarity, a first pulse width and a first phase.   
     
     
         19 . A non-transitory computer-readable storage medium storing one or more programs configured for execution by one or more processors, the one or more programs comprising instructions for:
 obtaining a frame synchronization signal associated with a plurality of cameras, wherein the plurality of cameras have a plurality of shooting parameters, and the plurality of shooting parameters include at least one of a frame rate, a polarity, a pulse width, and a phase;   separately determining a synchronization driving signal, adapted to a shooting parameter of each camera, according to the frame synchronization signal; and   transmitting each synchronization driving signal to a corresponding camera, to drive the plurality of cameras to perform synchronous shooting, according to the plurality of shooting parameters.   
     
     
         20 . The non-transitory computer-readable storage medium of  claim 19 , wherein the one or more programs further comprise instructions for:
 determining a synchronization driving signal adapted to a display parameter of an external display screen, according to the frame synchronization signal, wherein the display parameter comprises at least one of a refresh rate, the polarity, a duty cycle, and the phase; and   transmitting the synchronization driving signal to the external display screen, to drive the external display screen to perform synchronous displaying that is corresponding to the display parameter.