Integration Insights: IEEE1588 simplifies camera synchronization

Satoshi Eikawa

Traditionally clocks built into cameras are reset when the power is switched on, and the time stamps asynchronously commence a count-up. For networked cameras, these time stamps gradually go out of synchronization as time passes owing to discrepancies in the clocks' frequencies.

IEEE1588 is a protocol stipulated by the Precision Time Protocol (PTP) and is in effect for equipment connected together by Ethernet. It synchronizes the time with extremely high levels of precision in cameras that are connected via an Ethernet cable to a "Grand Master" standard time clock.

Cameras that support IEEE1588 exchange synchronized messages with the Grand Master at predetermined cycles, with the internal counter recalibrated in accordance with the time stamp information at the time of sending and receiving (Figure 1).

Figure 1: Using IEEE1588 it is possibly to schedule regular synchronization, bringing cameras with faster / slower clock speeds back in line with the master. By shortening the synchronization interval time lag is minimized; and therefore jitter too.

The IEEE1588 time stamp is an epoch time counter with 00:00, January 01, 1970 set as [0], and it provides a resolution of 1ns (1GHz). Contrary to the mechanism of the PLL (phase-locked loop), free-running counters are updated every time a synchronization message is exchanged. And reducing the cycle interval with the Grand Master improves precision even further.

Trigger and GPO links

Prior to IEEE1588 it was impossible to guarantee truly-accurate simultaneous capture in a multi-camera system.

Previous generations of GigE Vision cameras-upto and including GigE v1.2-contained action commands that were designed to operate simultaneously with a single command for multiple cameras. However, there were still some inconclusive elements, such as delays in network propagation and delays in firmware processing.

To overcome these issues, a combination of IEEE1588 and the Action Command added to GigE Vision 2.0 enabled each individual camera to specify a time for executing actions.

The new Sony XCG-CG camera series has been equipped with a function that begins exposure in synchronization with this absolute time, including functions defined as IEEE1588 applications conforming to GigE Vision standards that are known as Scheduled Action Commands.

The new cameras have been equipped with a Scheduled Action Command that presets the time for starting synchronization for the software trigger and IEEE1588, for example it's possible to set synchronization to 'once every second,' with all cameras in a network synchronized to the Grand Master at this interval.

Reducing the interval between synchronization enables it to be carried out while time discrepancies are still small, which helps to minimize jitter. With regards to free-running, the timing for starting camera exposure is aligned with the time that has been synchronized with the Grand Master. Although this is affected by the network environment, it is ideally possible for exposure synchronous control to be performed within 1μs (Figure 2).

Figure 2: Adjusting the exposure timing of the camera in free run, based on the grand master. Note, while it can be affected by the network environment, it is possible to drive exposure synchronization to within ±1μs.

It is generally necessary to prepare separate equipment that acts as the Grand Master-either special equipment available on the open market, or a PC with a Linux OS and running the free Grand Master software.

However, one area we're investigating is the mounting of an IEEE1588 master function on the XCG-CG series in a future upgrade. Doing this would turn the camera itself into the master and eradicate the need for preparing a separate Grand Master Clock, simplifying the mechanism for synchronization between cameras; and between cameras and peripheral equipment.

Usage scenarios and advantages

Simplification of Post-Event Analysis: Mounting IEEE1588 onto GigE Vision cameras enables the camera to synchronize its time settings with the Grand Master Clock, and the time stamps attached to image packets enable absolute time to be displayed.

One of the scenarios for use with ITS (Intelligent Transportation Systems) is the more accurate detection of vehicles in violation of the speed limit, without the need for radar. The time stamps obtained from two different points will allow decisions as to whether vehicles are exceeding the speed limit or not to be made, and accurate times of images obtained from both points will simplify high-precision speed analysis.

IEEE1588 time stamps will also prove effective for industrial robots and all types of inspection devices used in assembly work. Adding absolute times to images showing inspection processing and results will enable the items in question to be easily identified.

Figure 3: Sony's XCG-CG camera series has been equipped with a function that begins exposure in synchronization with this absolute time, including functions defined as IEEE1588 applications conforming to GigE Vision standards that are known as Scheduled Action Commands.

Improved Image Processing System Reliability: One of the issues with installing vision systems for industrial assembly and inspection robots and devices is the layout of the wiring. Cables are subject to wearing and severing when used for long-term operations, and this causes a drop in system operability. The chance of this increases in line with the number of cameras in a system-the number of cables must also be increased if each one is to be synchronized. The XCG-CG Series enables multiple cameras to be synchronized with IEEE1588 and Scheduled Action Commands. They also support PoE (power over Ethernet), which means that only one cable is required for exposure synchronization, image output and the power supply.

Curtailment of Tact Time: One issue for system developers and manufacturers using such systems that still remains is the time between image capture and peripheral equipment-not supporting IEEE1588-taking action. As such, Sony is planning to link the new camera series to GPO (General Purpose Output) in the future, which will enable such peripheral equipment to be operated based on time synchronicity.

Doing this you can see that, for example, by connecting the camera's GPO to robots during the period-from the camera capturing images to the robot performing work picking operations-will enable the image capturing and robot operations to be synchronized.

Another example is in bottle inspection, here devices require multiple cameras to be synchronized and for which inspection samples are conveyed at a predetermined speed, taking this approach will have an extremely high affinity with systems that use the high-precision time synchronization capabilities of IEEE1588.

Satoshi Eikawa, Sony Image Sensing Solutions, Weybridge, UK (www.image-sensing-solutions.eu)