Automotive

Google self driving car now recognizes cyclists' hand signals

Google self driving car now recognizes cyclists' hand signals
Google's self driving car waits for a cyclist who is making a hand signal
Google's self driving car waits for a cyclist who is making a hand signal
View 16 Images
Google's self driving car - interior
1/16
Google's self driving car - interior
Google's self driving car - interior
2/16
Google's self driving car - interior
Google's self driving car
3/16
Google's self driving car
Google's self driving car sees a clear path ahead.
4/16
Google's self driving car sees a clear path ahead.
Google's self driving car waits for cyclists and pedestrians at an intersection
5/16
Google's self driving car waits for cyclists and pedestrians at an intersection
Google's self driving car waits for cyclists and pedestrians at an intersection
6/16
Google's self driving car waits for cyclists and pedestrians at an intersection
Google's self driving car waits for cyclists and pedestrians at an intersection
7/16
Google's self driving car waits for cyclists and pedestrians at an intersection
Google's self driving car waits for a cyclist who is making a hand signal
8/16
Google's self driving car waits for a cyclist who is making a hand signal
Google's self driving car waits for a cyclist who has made a hand signal
9/16
Google's self driving car waits for a cyclist who has made a hand signal
Google's self driving car waits for a cyclist who is making a hand signal
10/16
Google's self driving car waits for a cyclist who is making a hand signal
Google's self driving car waits for a level crossing to clear before moving onto the train tracks
11/16
Google's self driving car waits for a level crossing to clear before moving onto the train tracks
Google's self driving car waits for a level crossing to clear before moving onto the train tracks
12/16
Google's self driving car waits for a level crossing to clear before moving onto the train tracks
Google's self driving car gives a wide berth to a parked car
13/16
Google's self driving car gives a wide berth to a parked car
Google's self driving car negotiates a roadworks scenario
14/16
Google's self driving car negotiates a roadworks scenario
Google's self driving car notices a roadworks sign
15/16
Google's self driving car notices a roadworks sign
Google's self driving car waits for a cyclist who is making a hand signal
16/16
Google's self driving car waits for a cyclist who is making a hand signal
View gallery - 16 images

There are an extraordinary number of companies converging on the idea of self-driving cars from all sorts of different angles, but the undisputed leader of the pack is Google, whose self-driving vehicles have logged a total of nearly 700,000 development miles. In a video released today, Google shows some fantastic visualizations to demonstrate what the car is seeing in complex traffic situations. You can watch how the car handles roadworks, level crossings, complex intersections and a range of interactions with cyclists – including recognizing their hand signals.

The images in the gallery show what Google’s Self Driving Car is seeing in a range of traffic conditions through its 360-degree cameras. Let’s take a look at some of them in closer detail:

Google's self driving car negotiates a roadworks scenario
Google's self driving car negotiates a roadworks scenario

In this image, the car has spotted a roadworks scenario blocking the road. It sees the signage in yellow, plus a bunch of cars in purple, and a group of witches hats in orange. It’s approaching the scene with caution and has not yet made a decision to proceed – the red line indicates a barrier the car will not cross.

Google's self driving car gives a wide berth to a parked car
Google's self driving car gives a wide berth to a parked car

In this image, the car is adjusting its lane position to give a wide margin to a parked car.

Google's self driving car waits for a level crossing to clear before moving onto the train tracks
Google's self driving car waits for a level crossing to clear before moving onto the train tracks

In this image, the car has recognized a rail crossing, and the red bar shows that it won’t begin to cross the train tracks until the traffic is clear on the other side.

Google's self driving car waits for a cyclist who is making a hand signal
Google's self driving car waits for a cyclist who is making a hand signal

This image shows the car recognizing a cyclist’s hand signal indicating that he’s coming out into the center of the road. The green bar shows that the car won’t pass the cyclist under these conditions, and the other red object is another cyclist traveling behind the car.

Google's self driving car waits for cyclists and pedestrians at an intersection
Google's self driving car waits for cyclists and pedestrians at an intersection

This image shows the car dealing with a typically complex city traffic situation. As the lights have gone green, a number of pedestrians and cyclists have all started to move through the intersection. The car sees and tracks each of them individually, stopping at the intersection until all cyclists and pedestrians have moved through, and even waiting for a cyclist behind the car to come through rather than impede its path.

Google Self-Driving Car on City Streets

With 360-degree vision and non-stop eagle-eyed attention, the Google car is already proving a far safer driver than most humans – at least, under the conditions it’s currently being tested under.

But don’t hold your breath – it’s still a long way from being a product you can buy, and there’s a range of issues such as localization, licensing and liability, regulatory approval and general public opinion to get past before self-driving cars become a commercial reality on our roads.

Still, this is some seriously amazing technology, and driverless cars are more or less an inevitability in the coming decades. Safe, cautious and courteous to a fault, they won’t be the fastest way to get from A to B, and they’ll probably be as annoying to be stuck behind as an overly cautious octogenarian - but they will certainly save lives. At least, until somebody develops a way to jailbreak the software and install some Ken Block drifting firmware.

Source: Google

View gallery - 16 images
6 comments
6 comments
Daishi
Self driving cars are really a vast array of multiple technologies working seamlessly in one platform.
Before self driving cars are ready to be let loose on the roads the individual components like this that make up the platform need to creep their way into human controlled automobiles.
I am far less convinced than most other people that the technology is ready to be let loose on the roads without direct human control or someone perpetually ready to override it.
Maybe its just because I see regular failures in much simpler technologies that I have very little faith that such a platform could be made mature in the near future. The Google cars have a very good driving record so far but engineers ride along with override controls and the company doesn't (or didn't) publicly disclose how often those controls are used.
I think the "hybrid" approach has far more potential. Simple actions like if a driver is still accelerating and the car in front of them stops and they appear not to notice, the car and switch from gas to gently braking and provide an audible alert to the driver to observe the situation.
Another useful situation in rural areas would be using Infrared to identify animals near the side of the road I may not be able to see on my own or giving me a birds eye view of my lane position and surrounding cars for checking blind spots.
Once these augmentations become established as reliable it would then make sense to remove the human and allow them to operate independently but not before then.
There are some other rare situations which I am not sure self driving cars could avoid entirely as well. I remember one time I was in my car and a kid was driving really fast on the sidewalk coming off a hill and I wasn't sure if he was going to make the turn. I backed off and moved over just in case, he hit a bump and flew over his handlebars into what would have been my path. I am not even sure where you would start in attempting to program the car to figure out "this kid looks like he might dump it".
I realize circumstances of human error are almost certainly more common than the one offs like that automation would judge poorly but at least for my personal record there are at least 2-3 times the machines would have done worse than me and just one where autopilot would have avoided an accident I didn't (I was driving way too fast on a slippery road I didn't know).
JPAR
Surely the car is only half the answer? The road design, signage, who uses the roads, potential hazards etc all need to be developed into a more systematic & uniform landscape. At the moment, roads and its users have developed over the last 100 years or so, with little standardisation - time to reverse that trend.
Scott in California
I agree with JPAR, as far as addressing the travel environment. But our system of roadbuilding with concrete and asphalt, all the signage, all the repairs, it's simply unsustainable in much of low-income Africa, South America, and Asia. Even in California, it is the number-one major expense in local county budgets. We have to replace it (in my humble opinion) with an elevated grid (six meters off the ground) of monorails built with the modern "supermaterials", (e.g. nanocellulose) and constructed with light weight and made visually bearable. The density of the grid would mimic the existing four-lanes-or-greater roadways we have, but with 2X the "lanes". The grid would be interconnected and track-switched at towers, where the lightweight, battery-powered driverless vehicles would be stored. Just as the wireless grid replaced "no phone service" in Africa, an elevated grid would initially replace "no road access, no vehicles" in similar areas. Driverless vehicles would be important, because the mass carried per meter on a lightweight grid must be limited; otherwise, massive amounts of materials must be employed. So everyone, even children (above age five) would get their own, one-person vehicle. All that the "smarts" that the system would need, would be simple: no collisions with the vehicle in front or behind, and redirection (just like packets on the internet) from node to node (tower to tower). For long distances, individual vehicles could be "proximity joined" in long trains, to lower power requirements. But this elevated grid would obviate the need to have complex signal processing, and AI to negotiate stop lights, stop signs, pedestrians, other vehicles at intersections, road construction, bouncing balls and kids chasing them, animals crossing the road, on and on and on. At ground level, bicycles and golf-cart-type vehicles would provide travel for two-to-five miles. And, there would be "driverless robots" even at ground level, to pick up your groceries, laundry, prescriptions, 2x4s, plywood, bricks, shingles, library books, lattes, etc. But they would be slow (under five miles an hour) but could operate when most people are asleep.
steve rose
When was the last time you witnessed a cyclist giving hand signals??
Daishi
My ideas for public transportation are actually pretty similar to yours.
The problem with large container subway type transports is they must stop frequently and they are limited in reach. I think they need to be broken down into a much smaller "packet" type of system so there is no need for the whole system to stop for individual "small containers" that need to get on and off the system.
The small containers could reach smaller access roads instead of just large main transport lines so they could get closer to the destination than a subway could. This same principle eliminates the need to travel in a car to a subway station.
When you get to the destination you don't have to worry about finding a place to park the small container as you can just send it back through the system for someone else to use (sort of like a ski lift).
Because each of the cars has sensors and the grid itself has intelligence its easy to measure delivery times, reroute pods around congestion etc.
In theory because the pods are likely electric and the grid provides power its probably possible for them to travel short distances off the designated "track" on just battery power. If they meet standard spec/protocols etc. they could even be personally owned like vehicles.
Because of efficiencies and being able to travel much closer together while synchronized on the track and not needing to fully stop I think you could achieve much greater throughput than is possible with either public transport or conventional cars.
Now that we have detailed urban environments in sandbox type video games I would really like to see this concept built virtually inside of one.
Rann Xeroxx
I have seen quite a few hand signals from cyclist, I wonder if Google will recognize those as well.