Systems and methods for object detection in the interior of a motor vehicle

Abstract

An object detection device for detecting at least one object (e.g. moving), in form of a vehicle occupant or in form of at least a part of the vehicle occupant, in the interior of a motor vehicle, includes a camera system comprising at least one sensor for converting electromagnetic radiation into electrical signals and a lighting device with at least one light source and an optic system, and a control or regulating device which is designed to receive one or more of the electrical signals from the camera system or data from at least one sensor, at least one further device or at least one device of the motor vehicle, to generate control commands and to transmit them to the camera system, the at least one further device or the at least one device of the motor vehicle.

1 . An object detection device for detecting at least one moving object, in form of a vehicle occupant or in form of at least a part of the vehicle occupant, in the interior of a motor vehicle, comprising:
 a camera system comprising at least one sensor for converting electromagnetic radiation into electrical signals and a lighting device with at least one light source and an optic system; and   a control or regulating device which is designed to receive the electrical signals from the camera system to generate control commands and to transmit them to the camera system and/or a further device,   wherein the lighting device is suited to illuminate specific areas, including a near field (N) and a far field (F), in the motor vehicle using at least one optical element of the optic system, positioned in the vicinity of the object, in such a way that at least one distance information contained in the electrical signals can be detected via the camera system for a plurality of object points in the areas,   wherein the object detection is determined by a state of the motor vehicle, and/or by a state of the environment of the motor vehicle.   
     
     
         2 . The object detecting device of  claim 1 , wherein the control or regulating device is designed to further receive data from at least one further sensor, the at least one further device and/or at least one device of the motor vehicle. 
     
     
         3 . The object detecting device of  claim 2 , wherein the control or regulating device is designed to transmit control commands to the device of the motor vehicle. 
     
     
         4 . The object detecting device of  claim 1 , wherein the lighting device is suited to illuminate further using at least one additional lighting device and/or an additional camera system. 
     
     
         5 . The object detecting device of  claim 4 , wherein further the illumination, the object localization and/or the activation of at least one of the lighting devices and/or camera systems is/are determined by a state of the motor vehicle. 
     
     
         6 . The object detecting device of  claim 1 , wherein the state of the motor vehicle is determined by speed, acceleration, vehicle seat occupancy, vehicle seat position, vehicle seat orientation and/or lighting including the lighting of the vehicle interior. 
     
     
         7 . The object detecting device of  claim 1 , wherein the state of the environment of the motor vehicle is determined by weather, day, night, roadway, traffic sign and/or a traffic situation. 
     
     
         8 . The object detection device according to  claim 2 , wherein the lighting device of the camera system, the additional lighting device and/or the lighting device of the additional camera system comprises or comprise more than one light source, wherein each light source can be activated independently from each another depending on the state of the object, the motor vehicle and/or the surroundings of the motor vehicle and/or the distance of the object to the camera system including the sensor of the camera system, and/or to the additional camera system including the sensor of the additional camera system. 
     
     
         9 . The object detection device according to  claim 1 , wherein the control or regulating device changes the illumination of different areas in the interior of the motor vehicle based on the state of the object, the motor vehicle and/or the environment of the motor vehicle and/or the distance of the object to the camera system including the sensor of the camera system, and/or to the additional camera system including the sensor of the additional camera system. 
     
     
         10 . The object detection device according to  claim 1 , wherein the illumination, the object localization and/or the object detection and/or the activation of at least one of the lighting devices and/or camera systems is determined by the state of the object, determined by the size, weight, breathing, heartbeat, temperature, acceleration, movement and/or physical fitness of the vehicle occupant. 
     
     
         11 . The object detection device according to  claim 1 , wherein the lighting device of the camera system, the lighting device of the additional camera system, the additional lighting device, the camera system and/or the additional camera system is located in a dashboard, a center console including a retractable or movable center console, a windshield, a roof, a headliner, a handle, an A-pillar, a B-pillar, a C-pillar, a door component, above a door, a housing including a dome-shaped housing in the region of the vehicle center on the roof or headliner, a display device, a vehicle occupant seat including a head part, a foot part and/or an armrest of the vehicle occupant seat, a restraint system for the vehicle occupant, a positioning mechanism including a motor-driven positioning mechanism, a trim and/or the device including in a form of a mobile device of the object, is attached or integrated therein. 
     
     
         12 . The object detection device according to  claim 11 , wherein the light device being integrated in the display device comprises light sources distributed over a display area of the display device, wherein the light sources of the display device comprise groups of emitters and/or regions with different spectral emission areas, which are designed to be able to provide light in at least a part of a spectral range used for object detection, and/or additionally comprise spectral emitters for the spectral range of object detection. 
     
     
         13 . The object detection device according to  claim 1 , wherein the optic system comprises guides and/or rotating wheels for exchanging and/or displacing the optical element and/or actuator means for inducing movements, and/or the optical element of the optic system comprises lenses, filters, adaptive optics, active optical elements and/or mirrors 
     
     
         14 . The object detection apparatus according to  claim 1 , further comprising a computer or control unit designed to evaluate the electrical signals and/or the data by an object localization algorithm and/or an object detection algorithm. 
     
     
         15 . The object detection device according to  claim 1 , wherein the control or regulating device is designed to control and/or coordinate the camera system, the additional camera system, the lighting device of the camera system, the additional lighting device, the lighting device of the additional camera system, at least one further sensor, the device and/or the apparatus comprising the mobile device. 
     
     
         16 . The object detection device according to  claim 1 , wherein the illumination can be determined via the spectral frequency, amplitude, duration including determined by pulse frequency and/or pulse length, polarization and/or intensity of the illumination, and wherein the spectral frequency lies above and/or below the visible light. 
     
     
         17 . An object detection device for detecting at least one object behind a first seat row of a vehicle in the interior of the motor vehicle, comprising:
 a camera system comprising at least one sensor for converting electromagnetic radiation into electrical signals and a lighting device with at least one light source and an optic system; and   a control or regulating device which is designed to receive the electrical signals from the camera system to generate control commands and to transmit them to the camera system and/or a further device,   wherein the lighting device is suited to illuminate specific areas, including a near field and a far field, in the motor vehicle using at least one optical element of the optic system, positioned in the vicinity of the object, in such a way that at least one information about objects or occupants contained in the electrical signals can be detected via the camera system for a plurality of object points in the areas,   wherein the optic system comprises at least one optical element reflecting infrared light from at least one second or more seat row and/or at least one foot well area of the vehicle to the sensor.   
     
     
         18 . The object detection device of  claim 17 , wherein the control or regulating device is designed to further receive data from at least one further sensor, the at least one further device and/or at least one device of the motor vehicle. 
     
     
         19 . The object detection device of  claim 18 , wherein the control or regulating device is designed to transmit control commands to the device of the motor vehicle. 
     
     
         20 . The object detecting device of  claim 17 , wherein the lighting device is suited to illuminate further using at least one additional lighting device and/or an additional camera system. 
     
     
         21 . The object detection device according to  claim 17 , wherein the at least one optical element is hide behind a cover layer transparent to infrared light. 
     
     
         22 . The object detection device according to  claim 17 , wherein the cover layer is adapted to absorb, reflect or scatter visible light. 
     
     
         23 . The object detection device according to  claim 17 , wherein the at least one optical element has an elliptical or free form shaped mirror element and/or the optical element directs the infrared light from the light source to the at least one second or more seat row and/or the at least one foot well area, optionally a foot well area of the second or more seat row, and/or to the sensor, optionally from the at least one second or more seat row and/or from the at least one foot well area, especially a foot well area of the second or more seat row. 
     
     
         24 . The object detection device according to  claim 17 , wherein the at least one optical element is integrated into a C-pillar or a roof of the vehicle. 
     
     
         25 . The object detection device according to  claim 24 , wherein the optic system comprises a plurality of optical elements, preferably at least three optical elements, where preferably two optical elements, like mirrors, are integrated into the C-pillars of each side of the vehicle and/or the third optical element, like a third mirror, is integrated into the roof of the vehicle extending from the C-pillar of one side of the vehicle to the C-pillar of the other side of the vehicle. 
     
     
         26 . The object detection device according to  claim 17 , wherein the sensor is located in a center rearview mirror of the vehicle. 
     
     
         27 . The object detection device according to  claim 17 , wherein the object is an occupant. 
     
     
         28 . The object detection device according to  claim 17 , wherein illumination, the object localization and/or the object detection and/or the activation of at least one of the lighting devices and/or camera systems is determined by a vehicle seat occupancy, vehicle seat position, vehicle seat orientation and/or lighting including the lighting of the vehicle interior, and/or by a state of the environment of the motor vehicle determined by weather, day, night, roadway, traffic sign and/or a traffic situation. 
     
     
         29 . An object detection device for detecting at least one object, in form of a vehicle occupant or in form of at least a part of the vehicle occupant, in the interior of a motor vehicle, comprising:
 a camera system comprising at least one sensor for converting electromagnetic radiation into electrical signals and a lighting device with at least one light source and an optic system; and   a control or regulating device which is designed to receive the electrical signals from the camera system to generate control commands and to transmit them to the camera system and/or a further device,   wherein the lighting device is suited to illuminate specific areas, including a near field and a far field, in the motor vehicle using at least one optical element of the optic system, positioned in the vicinity of the object, in such a way that at least one distance information contained in the electrical signals can be detected via the camera system for a plurality of object points in the areas,   wherein the lighting device in integrated into a central rearview mirror and comprises an extended light emitting area larger than light emitting components of the lighting device.   
     
     
         30 . The object detection device according to  claim 29 , wherein the light emitting area surrounds the rearview mirror. 
     
     
         31 . The object detection device according to  claim 29 , wherein a light pipe guiding light from the light emitting component through the light pipe, where the light pipe is adapted to extract a certain proportion of light per length of the light pipe from the light pipe and emit it through the light emitting area. 
     
     
         32 . The object detection device according to  claim 31 , wherein the light emitting component, the light emitting area and/or the light pipe is/are at least partly arranged behind a, preferably for visible light opaque and/or reflective and/or for light in the infrared area at least partly transparent, mirror element of the rearview mirror and/or the mirror element emits light vertically to the mirror element towards the light pipe. 
     
     
         33 . The object detection device according to  claim 29 , wherein at least the sensor of the camera system is integrated into the rearview mirror for receiving electromagnetic radiation through a mirror element of the rearview mirror. 
     
     
         34 . The object detection device according to  claim 29 , wherein the illumination, the object localization and/or the object detection and/or the activation of at least one of the lighting devices and/or camera systems is determined by a state of the motor vehicle, determined by speed, acceleration, vehicle seat occupancy, vehicle seat position, vehicle seat orientation and/or lighting including the lighting of the vehicle interior, and/or by a state of the environment of the motor vehicle determined by weather, day, night, roadway, traffic sign and/or a traffic situation. 
     
     
         35 . A method for operating an object detection device, the method comprising:
 acquiring a signal and/or data;   localizing an object;   adapting the illumination of the object; and   detecting the object and/or generating a control command.   
     
     
         36 . The method according to  claim 35 , wherein prior to signal and/or data acquisition, background data acquisition and/or connection to the device, sensor and/or device is performed. 
     
     
         37 . A motor vehicle, including an autonomous driving motor vehicle, that includes an object detection device which is configured to perform a method comprising:
 acquiring a signal and/or data;   localizing an object;   adapting the illumination of the object; and   detecting the object and/or generating a control command.   
     
     
         38 . The motor vehicle according to  claim 37 , wherein the object detection device is designed for autonomous driving, and/or the control or regulating device is designed for adjusting the position of the vehicle occupant in the vehicle interior, including via the vehicle occupant seat, the display device, the dashboard, the center console including a retractable or movable center console, a vehicle opening, a warning device, a heating device, an air conditioning device, a navigation system, an audio system, a telephone system, a video system, a hologram system and/or the positioning mechanism. 
     
     
         39 . The motor vehicle according to  claim 37 , wherein the positioning mechanism is or is configured to be brought into operative connection with the vehicle occupant seat, the display device, the dashboard, the center console, the vehicle opening, the warning device, the heating device, the air conditioning device, the navigation system, the audio system, the telephone system, the video system and/or the hologram system. 
     
     
         40 . An object detection device for detecting at least one moving object, in form of a vehicle occupant or in form of at least a part of the vehicle occupant, in the interior of a motor vehicle, comprising:
 a camera system comprising at least one sensor for converting electromagnetic radiation into electrical signals and a lighting device with at least one light source and an optic system;   a control or regulating device which is designed to receive the electrical signals from the camera system to generate control commands and to transmit them to the camera system and/or a further device; and   a computer or control unit designed to evaluate the electrical signals and/or the data, in particular by an object localization algorithm and/or an object detection algorithm,   wherein the lighting device is suited to illuminate specific areas, including a near field (N) and a far field (F), in the motor vehicle using at least one optical element of the optic system positioned in the vicinity of the object, in such a way that at least one distance information contained in the electrical signals can be detected via the camera system for a plurality of object points in the areas,   wherein the object detection is determined by a state of the motor vehicle, and/or by a state of the environment of the motor vehicle.