The automated recognition and geo-referencing of objects in the vincinity of rail/road infrastructure.

The accurate and reliable detection and localization of objects on rail areas is challenging, due to the large area to be covered, the potentially small object size and the limited measurement time available in between regular train operation. In this project we propose a measurement system capable of continuously monitoring the railway cross-section beneath a train, geo-referencing the data and performing object classification and unusual object detection. &nb We rely on high-speed Laser and multi-camera systems to continuously scan the entire railway cross-section beneath a train. Measurement speed is designed for a continuous operation at 25m/s. Data is acquired on the train, and fused to a continuous image and 3D model during post-processing. By fusing the captured image data with GNSS, odometry and IMU data we are able to geo-reference the acquired image data itself, as well as object detections automatically performed on the data. The acquired image data provides metric 3D information at millimeter-resolution. With this data stream, we perform automated detection of specific objects of interest, as well as a continuous search for unexpected objects which may interfere with railway operations. Contact: Matthias Rüther

Knowledge of the exact geo-location of individual elements within a traffic infrastructure system helps in routine maintenance and inventarization. In this project we developed a multi-camera system which is mounted on a locomotive and able to detect specific objects around the railway system. In combination with GNSS receivers, odometer and IMU system, we are able to geo-localize detected objects with mm accuracy. The sensor system is scalable and consists of two or four cameras mounted in an overlapping stereo configuration. The weather-proof design and active illumination allow for continuous 24-hour operation. High-dynamic range imaging allows to cope with specular highlights and very dark objects as well. An object resolution of 0.3mm / pixel at a framerate of 70fps allow for precise object recognition and localization, even at a travel speed of 25m/s.
The camera setup is complemented by powerful onboard compute capacity and sensors for precise geo-referncing. Multiple GNSS antennas combined with an aerial inertial measurement unit and odometer system precisely locate the sensor carrier in space. Masts beside the railway are automatically identified. If requested, objects mounted on the mast like reference markers are also automatically detected, segmented and triangulated for a millimeter-accurate location. Posteriuor data fusion with GNSS information allow us to transfer these local coordinates into a geographic coordinate frame. Writings and kilometer-markings on the mast are automatically detected and recorded.