Skip to main content

Caterpillar uses facial recognition software to identify sleepy equipment operators

When it comes to heavy equipment, Caterpillar is a household name. If it is big and moves earth and rocks, there’s a good chance it has “Caterpillar” stamped on its side. This is especially true when it comes to mining equipment, where dump trucks (known in this context as haul trucks), can sport 12-foot-tall tires. These are some of the largest vehicles on earth, and operators require built-in stairs and ladders to reach the cab.

Even with the most alert driver, incidents are scaled up along with vehicle size. These trucks can roll right over a normal sized passenger vehicle and flatten it, and operators would feel like they hit a small bump. In the past, these trucks have rolled down embankments that were not perceived from the height of the cab, killing the occupants. These rolling behemoths also pose a constant risk to the lives of others on the site, even from the slightest mistake. Absolute concentration and situational awareness is vital for the operators.

Recommended Videos

Mines operate around the clock, so they have employees who work long shifts through the night, running the risk of nodding off at the wheel. Operator fatigue is a potentially fatal problem, and Caterpillar recognized this and is working on a solution. Caterpillar Safety Services joined forces with tech company Seeing Machines to create and install fatigue detection software into thousands of mine trucks across the world, according to The Huffington Post.

The technology monitors head position and eye closure as signs of fatigue via a camera integrated with a speaker and light system. Rather than identifying a particular individual, facial recognition software looks for predetermined signs of exhaustion. If detected, an alarm goes off inside the truck, and a video clip of the driver is immediately sent to Caterpillar headquarters’ sleep fatigue center. A safety adviser then contacts the operator over radio and notifies the site supervisor. A sleep intervention may be recommended, requiring the driver to take a nap.

Caterpillar is at the early stages of implementation for this solution, and hopes to expand it further into its 38,000 trucks deployed across the globe.

Dave Palmer
Dave’s technology geek-fest began with the classic Commodore 64 computer, which started a lifelong passion for all things…
Many hybrids rank as most reliable of all vehicles, Consumer Reports finds
many hybrids rank as most reliable of all vehicles evs progress consumer reports cr tout cars 0224

For the U.S. auto industry, if not the global one, 2024 kicked off with media headlines celebrating the "renaissance" of hybrid vehicles. This came as many drivers embraced a practical, midway approach rather than completely abandoning gas-powered vehicles in favor of fully electric ones.

Now that the year is about to end, and the future of tax incentives supporting electric vehicle (EV) purchases is highly uncertain, it seems the hybrid renaissance still has many bright days ahead. Automakers have heard consumer demands and worked on improving the quality and reliability of hybrid vehicles, according to the Consumer Reports (CR) year-end survey.

Read more
U.S. EVs will get universal plug and charge access in 2025
u s evs will get universal plug charge access in 2025 ev car to charging station power cable plugged shutterstock 1650839656

And then, it all came together.

Finding an adequate, accessible, and available charging station; charging up; and paying for the service before hitting the road have all been far from a seamless experience for many drivers of electric vehicles (EVs) in the U.S.

Read more
Rivian tops owner satisfaction survey, ahead of BMW and Tesla
The front three-quarter view of a 2022 Rivian against a rocky backdrop.

Can the same vehicle brand sit both at the bottom of owner ratings in terms of reliability and at the top in terms of overall owner satisfaction? When that brand is Rivian, the answer is a resonant yes.

Rivian ranked number one in satisfaction for the second year in a row, with owners especially giving their R1S and R1T electric vehicle (EV) high marks in terms of comfort, speed, drivability, and ease of use, according to the latest Consumer Reports (CR) owner satisfaction survey.

Read more