DESCRIPTION
General
The Road Sign Assist (RSA) system has been adopted. The system recognizes traffic signs using the forward recognition camera and provides information to the driver via the multi-information display.
The RSA system can recognize various traffic signs* of different countries. By informing the driver of the speed limit as it changes while driving within or across borders, it makes it easier for the driver to be aware of different speed limits, assisting safe driving.
*: Signs that comply with the Vienna Convention on Road Signs and Signals (including electronic signs and blinking signs)
| *1 | Forward Recognition Camera (Camera Sensor) | *2 | Multi-information Display |
| *a | Traffic Sign | *b | Traffic Sign Display |
| *c | The illustration shown is an example only. | - | - |
Precaution of Road Sign Assist System
General Headline Precautions
RSA is a system which supports the driver by providing information from traffic signs to the driver. The RSA system does not serve as a replacement for a driver's vision or awareness. It is necessary for the driver to always pay attention to the traffic conditions and applicable rules while driving.
The RSA system may not detect or correctly recognize speed limit signs if they are dirty, bent or blocked by an object. It is necessary for the driver to confirm all speed limit signs while driving.
When the unit of speed being used or the direction of traffic changes, it may take some time for the system to learn of the changes. Until the learning is complete, the system may not detect the correct unit of speed or the direction of traffic and may subsequently display incorrect information. It is necessary for the driver to always pay attention to the traffic conditions and applicable rules while driving.
The system may not detect traffic signs under the following conditions:
| Number | Condition |
|---|---|
| (1) | The orientation of the forward recognition camera is deviate. |
| (2) | The vehicle passes the sign too quickly after the sign comes into view. |
| (3) | Dirt, snow, ice or a sticker is on the windshield glass in front of the forward recognition camera. |
| (4) | Driving in bad weather (heavy rain or snow, or dense fog). |
| (5) | The headlights of an oncoming vehicle or sunlight are shining directly on the forward recognition camera. |
| (6) | The sign is dirty, faded or tilted, or the contrast of an electronic sign is poor. |
| (7) | Whole or part of the sign is blocked by an object such as a pole, tree or a tall truck passing the sign. |
The system may incorrectly recognize traffic signs under the following conditions:
| Number | Condition |
|---|---|
| (1) | A sticker or graphic is on the rear of a preceding vehicle. |
| (2) | A sign is on an adjacent lane or side road, or immediately after traffic lanes merge or diverge. |
| (3) | An object which is not a traffic sign is similar in appearance. |
| (4) |
|
*: When the unit of speed or the direction of traffic changes, the system may not display the correct speed or overtaking lane.
Precautions for Forward Recognition Camera
Keep the windshield glass clean. If dirt, snow or ice is on the windshield glass, the forward recognition camera may not operate correctly.
Do not apply a sticker, etc. to the area of the windshield glass around the forward recognition camera.
Do not splash liquid on the forward recognition camera.
Do not flash a strong light source, such as an LED flashlight, on the forward recognition camera.
Do not apply film to the windshield glass.
Do not install an antenna in front of the forward recognition camera.
If the windshield glass fogs up, turn on the defogger to clear condensation. The windshield glass easily fogs up when the heater is set to foot mode and this may affect the performance of the forward recognition camera.
Do not damage the monocular camera lens or allow it become dirty. When cleaning the inner surface of the windshield glass, do not allow cleaning agent to contact the camera lens. Do not touch the camera lens.
The orientation of the forward recognition camera is precisely adjusted. Do not remove, or change the position or orientation of the forward recognition camera.
Do not subject the forward recognition camera to a strong impact, and do not disassemble it.
Only replace the windshield glass with a genuine part.
Do not place reflective items on the dashboard.
SYSTEM DIAGRAM
LAYOUT OF MAIN COMPONENTS
| *1 | Forward Recognition Camera (Camera Sensor) | *2 | ECM |
| *3 | Millimeter Wave Radar Sensor Assembly | *4 | Ambient Temperature Sensor (Thermistor Assembly) |
| *5 | Front Speed Sensor RH | *6 | Front Speed Sensor LH |
| *7 | Skid Control ECU | *8 | Rear Speed Sensor LH |
| *9 | Rear Speed Sensor RH | *10 | Driving Support ECU Assembly |
| *11 | Air Conditioning Amplifier Assembly | *12 | Combination Meter Assembly |
| *13 | Main Body ECU (Multiplex Network Body ECU) | *14 | Steering Pad Switch Assembly |
| *15 | Steering Sensor | *16 | Airbag Sensor Assembly |
| *17 | Central Gateway ECU | - | - |
FUNCTION OF MAIN COMPONENTS
| Component | Function | |
|---|---|---|
| Forward Recognition Camera (Camera Sensor) | Monocular Camera | Captures road signs. |
| Forward Recognition Camera ECU | Performs RSA system control based on information of road signs captured by the monocular camera. | |
| Millimeter Wave Radar Sensor | Radiates millimeter radar waves forward, uses the reflected waves to detect the presence of an object, and then transmits this information to the driving support ECU assembly. | |
| Driving Support ECU Assembly | Sends an object signal from the millimeter wave radar sensor assembly to the forward recognition camera. | |
| ECM | Transmits the reverse signal to the forward recognition camera. | |
| Skid Control ECU | Sends a vehicle speed signal from the speed sensor to the forward recognition camera. | |
| Steering Pad Switch Assembly | Meter Control Switches | Sends a multi-information operating signal to the forward recognition camera. |
| Combination Meter Assembly | Buzzer | Sounds for speed limit exceeded and no overtaking notifications.* |
| Multi-information Display |
|
|
| Main Body ECU (Multiplex Network Body ECU) | Outputs turn signal commands, which are sent from the headlight dimmer switch assembly, to the forward recognition camera. | |
| Air Conditioning Amplifier Assembly | Sends an ambient temperature signal to the forward recognition camera. | |
| ECM | Sends a shift position signal to the forward recognition camera. | |
| Steering Sensor | Detects the steering angle position and sends it to the forward recognition camera. | |
| Airbag Sensor Assembly | Detects the yaw rate and sends it to the forward recognition camera. | |
| Ambient Temperature Sensor (Thermistor Assembly) | Detects ambient temperature and sends it to the air conditioning amplifier assembly. | |
| Central Gateway ECU | Relays the data between the each CAN buses. | |
| Speed Sensors | Detect the wheel speed of each of the 4 wheels and sends it to the skid control ECU. | |
*: The threshold can be adjusted to 1 of 3 levels through the customization function
CONSTRUCTION AND OPERATION
Function
The RSA system recognizes the following traffic signals using the forward recognition camera.
| Category | Sign Type | Example of recognizable traffic sign | |
|---|---|---|---|
| Speed Limit | Round maximum speed limit/End of speed limit | |
|
| No Overtaking | No overtaking/End of no overtaking | |
|
| Supplemental Signs | Road condition signs | Ramp Way | |
| Rain | |
||
| Ice | |
||
| Wet | |
||
| End of Prohibition | |
||
The RSA system recognizes the following traffic signals using the forward recognition camera.
| Category | Display Example | Details | |
|---|---|---|---|
| Speed Limit Related | |
|
|
| No Overtaking Related | |
Informs the driver when they are in a no overtaking zone on the currently driven road. | |
| All Canceled (All restrictions canceled. Return to default road regulations.) | |
Informs the driver when all applicable prohibitions, such as speed limit and no overtaking, have ended. | |
| Speed Limit with Supplemental Sign Related | Ramp Way | |
Informs the driver of the ramp way direction. However, this item is not displayed when making a lane change without operating the turn signal light. |
| Rain | |
Informs the driver of the maximum speed limit on the currently driven road when it is raining or the road surface is wet. | |
| Ice | |
Informs the driver of the maximum speed limit on the currently driven road when there is accumulated snow or ice. | |
| Blank | |
The display is blank when the system is unable to recognize a supplemental sign. | |
Notification functions are used in the RSA system which inverts the colors of displayed signs, flash signs, etc. to notify the driver.
Speed Limit Exceeded Notification
While a speed limit sign is displayed, if the actual vehicle speed exceeds the speed limit plus a designated threshold*, the colors of the displayed sign are inverted. For example, if the threshold is set to 5 km/h and the speed limit sign is 60 km/h, the colors of the displayed sign are inverted when the actual vehicle speed exceeds 65 km/h. Furthermore, the system also inverts a speed limit sign with supplemental sign in the same way. However, the system does not invert the colors of the supplemental sign.
The buzzer may be set to sound during notifications through the customization function. However, if a speed limit recognized from a speed limit with supplemental sign is exceeded, the buzzer does not sound.
This notification is judged according to the speed units estimated by the forward recognition camera. When moving to a region with different speed units, notifications may be incorrectly issued until learning is complete. (The user can change speed units of the meter for the given region, therefore displays and notifications can be correctly issued directly after moving to a region with different speed units.)
*: The threshold can be adjusted to 1 of 3 levels through the customization function.
| Notification Method | Display Example |
|---|---|
| Inverted Display | |
No Overtaking Notification
While a no overtaking sign is displayed, if the system detects that the vehicle is attempting to overtake another vehicle, the system flashes the displayed sign.
The buzzer may be set to sound during notifications through the customization function.
| Notification Method | Display Example |
|---|---|
| Inverted Display | |
System Control
The RSA can be turned on or off through the settings tab of the multi-information display.
A customization function is used for the RSA, which allows settings such as the notification method and level for exceeding the speed limit to be changed. Setting changes are made through the customization tab of the multi-information display. Refer to the Repair Manual for details.
RSA Control Pattern 1
After a road sign is recognized by the forward recognition camera and the vehicle passes by, the sign is displayed on the multi-information display.
While a sign is displayed on the multi-information display, if a new road sign is not recognized within a specified distance, display of the current sign is turned off.
| *1 | Specified Distance Driven |
| *2 | Road Sign Recognized |
| *3 | Sign display off |
| *4 | Sign display on |
RSA Control Pattern 2
When the engine switch is turned off while a sign is displayed on the multi-information display, the same sign is displayed when the engine switch is turned on (IG) again.
| *1 | Engine Switch is Off |
| *2 | Engine Switch is Turned On (IG) |
| *3 | Sign display on |
RSA Control Pattern 3
While a sign is displayed on the multi-information display, the sign is turned off when turning left or right onto a new road.
| *1 | Road Sign Recognized |
| *2 | Sign display off |
| *3 | Sign display on |
Construction
Forward Recognition Camera
The forward recognition camera (camera sensor) is composed of a monocular camera and camera sensor ECU.
The RSA is controlled by the monocular camera and camera sensor ECU.
| *1 | Forward Recognition Camera (Camera Sensor) | - | - |
| *a | Monocular Camera | *b | Camera Sensor ECU |
| *c | Camera Sensor Recognition Area | *d | Camera Sensor Recognition Range: |
| *e | The illustration shown is an example only. | - | - |
Road signs captured by the monocular camera are output to the camera sensor ECU.
The camera sensor ECU judges road signs recognized by the monocular camera and displays information based on these judgments on the multi-information display.
When one of the following operations is conducted, the forward recognition camera angle must be adjusted. For details, refer to the Repair Manual.
The forward recognition camera is removed and reinstalled or replaced.
Parts relating to the tire or suspension are replaced or adjusted.
Strong force is applied onto the forward recognition camera.
Operation
Combination Meter
The combination meter assembly displays recognized signs on the multi-information display based on information of road signs recognized by the forward recognition camera.
The RSA system display mode can be selected by switching the display mode of the multi-information display through operation of the multi-information switch in the steering pad switch assembly.
When the driving assist system information tab is selected for display on the multi-information display, road signs recognized by the forward recognition camera are displayed on the upper portion of the multi-information display.
A maximum of 3 signs can be displayed simultaneously. When 3 signs are displayed, the signs are displayed in the following order from left to right: speed limit related, speed limit with supplemental sign related and no overtaking related.
| *a | Speed Limit Related | *b | Speed Limit with Supplemental Sign Related |
| *c | No Overtaking Related | *d | The illustration shown is an example only. The illustration may differ from the actual vehicle screen. |
When an information tab other than the driving assist system information tab is selected for display on the multi-information display, road signs recognized by the forward recognition camera are displayed as pop-ups on the lower center portion of the multi-information display. Furthermore, the pop-up display is only for speed limit signs. It is not displayed for any overtaking signs and speed limit with supplemental signs.
| *a | Speed Limit Related | *b | Multiple Road Sign Recognized |
| *c | The illustration shown is an example only. The illustration may differ from the actual vehicle screen. | - | - |
When there is a malfunction in the RSA system or the system is temporarily unusable, a warning message is displayed on the multi-information display, the master warning light illuminates and the multi buzzer sounds.
| Condition | Multi-information Display | Master Warning Light | Buzzer |
|---|---|---|---|
| System Malfunction | Check RSA system | Illuminates | Sounds |
| Forward Recognition Camera Temperature High | Front Camera Systems Unavailable Wait a Moment | - | - |
| Windshield Glass Dirty | Front Camera Systems Unavailable Clean Windshield. | - | - |
DIAGNOSIS
If a malfunction is detected in the RSA the forward recognition camera cancels the RSA, sounds the multi buzzer in the combination meter assembly, and displays a message on the multi-information display to inform the driver of the malfunction.
At the same time, the malfunction is stored in memory as a Diagnostic Trouble Code (DTC). For details, refer to the Repair Manual.