Cameras are increasingly becoming the central sensory organs of automobiles. Surround view systems consisting of several satellite cameras provide an all-around view of the vehicle environment from a bird’s eye perspective. Cameras look forward to identify traffic signs, traffic lights or lane markings. And they look back and to the side, for example to make objects in the blind spot visible. The technology company Continental is bundling these components, which were previously deployed separately, to form a complete system: several satellite cameras provide high-precision image data that is processed and evaluated by a central control unit. The system is modular, scalable and connected – and it comes from a one-stop shop. Above all, however, the combination of several satellite cameras enables numerous new functions that make driving safer, more comfortable and – if desired – increasingly automated.
Continental ensures transparency
The “transparent hood” function developed by Continental and awarded a CES 2020 Innovation Award highlights what an intelligently integrated camera system is capable of. This function went into series production for the first time at the end of 2018 in a SUV of an European car manufacturer. When driving slowly – such as when parking or off-roading – the ground beneath the engine compartment is displayed on the screen in the vehicle. With the help of the new optical information, a vehicle can be maneuvered precisely and in a controlled manner in narrow parking spaces with high curbs, over speed bumps and potholes, or when off-roading over rocks and rough terrain. To the driver it looks as though the hood and the engine compartment beneath it are transparent. “The image of the terrain around the vehicle is provided by the satellite cameras already installed in many vehicles. They are located at the front of the radiator grill, at the rear and there is one at the bottom of each of the side mirrors. However, the satellite cameras themselves cannot depict the space underneath the car. An intelligent Image Processing Algorithm developed by Continental, which also includes different vehicle sensor data, is reconstructing the image under the vehicle and inserts this image exactly into the surround view displayed to the driver”, said Markus Friebe, Head of Visualization Functions at Continental.
The “transparent hood” is a further extension of what experts call “human vision” systems, which are based on camera displays and support the driver. Basically, this extends the surround-view system to include a view under the car. “We now combine this ‘human vision’ with so-called ‘computer vision’. This term encompasses all camera assistance systems that go beyond mere display to provide a warning or intervention function, such as accelerating, steering and braking,” said Sascha Semmler, Head of Program Management Camera at Continental.
“Computer vision” systems include, for example, intelligent front cameras that not only detect traffic signs, traffic lights, lanes or obstacles, but can also recognize and evaluate them. The driver then receives the appropriate acoustic, visual or haptic information or warnings – for example, if the car threatens to leave its lane. The camera can also be used as an emergency brake assist: If the system detects another road user in front of the vehicle, it automatically initiates emergency braking in order to avoid a collision as far as possible. “In the future, this intelligence will no longer be linked to the front camera alone, but to several satellite cameras,” remarked Sascha Semmler.“Functions where the vehicle will automatically brake in the future when reversing if, for example, it comes too close to a person behind the car, are going into series production.”