Navlab

Quality 0.50 · 2 views · Updated 2 months ago

Autonomous car program developed by Carnegie Mellon

title: "Navlab" type: doc version: 1 created: 2026-02-28 author: "Wikipedia contributors" status: active scope: public tags: ["experimental-self-driving-cars", "carnegie-mellon-vehicles-and-rovers", "robots-of-the-united-states", "1986-robots", "1990-robots", "2007-robots"] description: "Autonomous car program developed by Carnegie Mellon" topic_path: "geography/united-states" source: "https://en.wikipedia.org/wiki/Navlab" license: "CC BY-SA 4.0" wikipedia_page_id: 0 wikipedia_revision_id: 0

::summary Autonomous car program developed by Carnegie Mellon ::

::figure[src="https://upload.wikimedia.org/wikipedia/commons/4/41/Navlab-1-5-autonomous-vehicles.jpg" caption="Navlab models 1 (farthest) through 5 (front). Navlab 5 completed the first coast-to-coast drive with 98.2% autonomy. All five vehicles were developed at Carnegie Mellon University, from 1984 through 1995."] ::

Navlab is a series of autonomous and semi-autonomous vehicles developed by teams from The Robotics Institute at the School of Computer Science, Carnegie Mellon University. Later models were produced under a new department created specifically for the research called "The Carnegie Mellon University Navigation Laboratory". Navlab 5 notably steered itself almost all the way from Pittsburgh to San Diego.

History

Research on computer controlled vehicles began at Carnegie Mellon in 1984 and production of the first vehicle, Navlab 1, began in 1986. Navlab 1 burned in 1989 when conditioning system leaked liquid onto the computers.

Applications

The vehicles in the Navlab series have been designed for varying purposes, "... off-road scouting; automated highways; run-off-road collision prevention; and driver assistance for maneuvering in crowded city environments. Our current work involves pedestrian detection, surround sensing, and short range sensing for vehicle control."

Several types of vehicles have been developed, including "... robot cars, vans, SUVs, and buses."

Vehicles

The institute has made vehicles with the designations Navlab 1 through 11. The vehicles were mainly semi-autonomous, though some were fully autonomous and required no human input.

Navlab 1 was built in 1986 using a Chevrolet panel van. The vehicle suffered from software limitations and was not fully functional until the late 80s, when it achieved its top speed of 20 mph.

Navlab 2 was built in 1990 using a US Army HMMWV. Computer power was uprated for this new vehicle with three Sparc 10 computers, "for high level data processing", and two 68000-based computers "used for low level control". The Hummer was capable of driving both off- or on-road. When driving over rough terrain, its speed was limited with a top speed of 6 mph. When Navlab 2 was driven on-road it could achieve as high as 70 mph

Navlab 1 and 2 were semi-autonomous and used "... steering wheel and drive shaft encoders and an expensive inertial navigation system for position estimation."

Navlab 5 used a 1990 Pontiac Trans Sport minivan. In July 1995, the team took it from Pittsburgh to San Diego on a proof-of-concept trip, dubbed "No Hands Across America", with the system navigating for all but 50 of the 2850 miles, averaging over 60 MPH. In 2007, Navlab 5 was added to the Class of 2008 inductees of the Robot Hall of Fame.

Navlabs 6 and 7 were both built with Pontiac Bonnevilles. Navlab 8 was built with an Oldsmobile Silhouette van. Navlabs 9 and 10 were both built out of Houston transit buses.

ALVINN

The ALVINN (An Autonomous Land Vehicle in a Neural Network) was developed in 1988. Detailed information is found in Dean A. Pomerleau's PhD thesis (1992). It was an early demonstration of representation learning, sensor fusion, and data augmentation.

Architecture

ALVINN was a 3-layer fully connected feedforward network trained by backpropagation, with 1217-29-46 neurons and thus 36,627 weights. It had 3 types of inputs:

  • A 30x32 grid representing grayscale values from the blue channel of a video camera pointing forward.

  • An 8x32 grid containing depth information from a laser rangefinder (30 by 80 degree field of view).

  • 1 feedback unit. It is directly connected to the one in the output layer, with one-step delay in the style of the Jordan network. It was designed to provide rudimentary processing of time

The output layer consisted of 46 units:

  • 45 units represent a linear range of steering angles. The most activated unit within this range determined the vehicle's steering direction.
  • 1 feedback unit. By inspecting the network weights, Pomerleau noticed that the feedback unit learned to measure the relative lightness of the road areas vs the non-road areas.

Training

ALVINN was trained by supervised learning on a dataset of 1200 simulated road images paired with corresponding range finder data. These images encompassed diverse road curvatures, retinal orientations, lighting conditions, and noise levels. Generating these images took 6 hours of Sun-4 CPU time.

The network was trained for 40 epochs using backpropagation on Warp (taking 45 minutes). For each training example, the steering output units were trained to produce a Gaussian distribution of activations, centered on the unit representing the correct steering angle.

At the end of training, the network achieved 90% accuracy in predicting the correct steering angle within two units of the true value on unseen simulated road images.

In live experiments, it ran on Navlab 1, with a video camera and a laser rangefinder. It could drive it at 0.5 m/s along a 400-meter wooded path under a variety of weathers: snowy, rainy, sunny and cloudy. This was competitive with traditional computer-vision-based algorithms at the time.

Later, they applied on-line imitation learning with real data by a person driving the Navlab 1. They noticed that because a human driver never strays far from the path, the network would never be trained on what action to take if it ever finds itself straying far from the path. To deal with this problem, they applied data augmentation, where each real image is shifted to the left by 5 different amounts and to the right by 5 different amounts, and the real human steering angle is shifted accordingly. In this way, each example is augmented to 11 examples.

It was found that with a short sequence of ~100 of images, the network could be online-trained to follow the road. This took just ~10 minutes of driving.

The first ALVINN was trained in February 1989, trained off-line on purely simulated images of the road, in an eight-hour run on the Warp machine. After training, it would be put on a Sun 3 computer on the Navlab -- the Warp machine was unnecessary, since neural networks are fast at inference time. It takes 0.75 seconds to process one image. On March 16, 1989, a new Navlab record of 1.3 m/s was set. They discovered in June 1989 that online training works.

References

References

  1. "Navlab: The Carnegie Mellon University Navigation Laboratory". The Robotics Institute.
  2. (17 April 2015). "Robotics History: Narratives and Networks Oral Histories: Chuck Thorpe".
  3. (1995). "PANS: A Portable Navigation Platform". The Robotics Institute.
  4. (May 1988). "Vision and navigation for the Carnegie-Mellon Navlab". IEEE Transactions on Pattern Analysis and Machine Intelligence.
  5. (August 1998). "25 years of the international symposia on Computer architecture (Selected papers)". ACM.
  6. "Overview". The Robotics Institute.
  7. Hawkins, Andrew J.. (2016-11-27). "Meet ALVINN, the self-driving car from 1989".
  8. (31 December 2017). "Look, Ma, No Hands".
  9. (3 April 2017). "Connected Cars: The long road to autonomous vehicles".
  10. (3 April 2015). "Back to the Future: Autonomous Driving in 1995 - Robotics Trends".
  11. "THE 2008 INDUCTEES". The Robot Institute.
  12. (2012). "Attention and Custom for Safe Behavior". Springer Science & Business Media.
  13. Pomerleau, Dean A.. (1988). "ALVINN: An Autonomous Land Vehicle in a Neural Network". Morgan-Kaufmann.
  14. Pomerleau, Dean. (1990). "Rapidly Adapting Artificial Neural Networks for Autonomous Navigation". Morgan-Kaufmann.
  15. Pomerleau, Dean A.. (1990). "Vision and Navigation". Springer US.
  16. Pomerleau, Dean A.. (1993). "Neural Network Perception for Mobile Robot Guidance". Springer US.
  17. (1990). "The Warp Machine on Navlab". Springer US.

::callout[type=info title="Wikipedia Source"] This article was imported from Wikipedia and is available under the Creative Commons Attribution-ShareAlike 4.0 License. Content has been adapted to SurfDoc format. Original contributors can be found on the article history page. ::

experimental-self-driving-carscarnegie-mellon-vehicles-and-roversrobots-of-the-united-states1986-robots1990-robots2007-robots