Member Info for terrym

Sure eye tracking will be in the mix...

What is the metaverse? In broad terms, it’s a virtual world where users can interact digitally as they would in the real world. Augmented and virtual reality are part of the metaverse. The most common application for now is gaming. But the potential uses span a range of fields and interests.

Using virtual reality, consumers could take lifelike virtual tours of homes for sale or wander through hotels virtually before booking. They could get multiple camera angles at sporting events. Augmented reality glasses could translate signs and menus as overseas travelers stroll through town, or they could overlay instructions on glasses for repair crews fixing equipment.

Qualcomm supplies core technologies crucial to the metaverse, including 5G connectivity, artificial intelligence and virtual/augmented reality processors and software. It has supplied chips and software to top virtual reality headset makers for quite a while.

Expansion of this technology is a key piece of Qualcomm’s efforts to diversify its business beyond smartphones. At January’s CES consumer electronics trade show in Las Vegas, Qualcomm showcased its efforts to expand mobile technologies beyond smartphones and deeper into cars.

https://www.latimes.com/business/story/2022-03-21/qualcomm-metaverse-100-million-snapdragon-investment-fund

Wonder if we will be next?

Germany’s competition regulator, the Bundeskartellamt, has cleared plans by the US chip manufacturer Qualcomm Inc. to take over the software division of Swedish automotive supplier Veoneer Inc, in a long-awaited deal that continues the auto industry’s decades-long move to improve drivers’ experiences through better technological assistance tools and features.

In early 2021, Qualcomm and Veoneer agreed to cooperate in the area of automated driving with the aim of offering an integrated driver assistance system based on, among other things a chip system developed by Qualcomm (Snapdragon Ride) and software from Veoneer under the Arriver brand. The acquired Arriver business will provide an adequate structure for this cooperation.

Andreas Mundt, President of the Bundeskartellamt, declared that “Integrated perception software solutions and the necessary chips play an important role in the future of driver assistance systems in the area of automated driving. Our assessment focused, among other things, on the question as to whether competitors that rely on purchasing chips or software from third parties could be squeezed out of the market following Qualcomm’s acquisition of the Arriver business.

“After having carried out extensive investigations, we have no competition concerns. In the course of our investigations, we also took into account that in addition to the market leader Mobileye, a subsidiary of the chip manufacturer Intel, an alternative provider of integrated solutions is now entering the market.”

https://www.competitionpolicyinternational.com/germanys-bundeskartellamt-clears-qualcomms-take-over-of-swedish-veoneer/

Alexander Robinson will be presenting at @PACDEFF 2022 on #eyetracking in a military aviation training context, today in Sydney. PACDEFF is the largest CRM, NTS and Aviation #humanfactors conference of its type in the world.

https://twitter.com/seeingmachines/status/1506118563656093704

Working on with who i wonder?

Driver monitoring cameras
To help address intoxication and distraction in traffic, we are working on new in-car solutions. Driver monitoring cameras, together with other sensors, will allow the car to intervene when a clearly intoxicated or distracted driver risks serious injury or death.

https://www.volvocars.com/tt/v/car-safety

Production is officially underway for the most important Cadillac vehicle in years. The first 2023 Cadillac LYRIQ EVs rolled off the line in Spring Hill, Tennessee. The LYRIQ EV SUV represents the future of Cadillac. Executives have promised that Cadillac will go all-electric by 2030.

“The Cadillac LYRIQ sets the standard for the future of Cadillac and marks another major milestone in GM’s commitment to an all-electric future,” said Reuss. “This is a monumental day for the entire GM team. We retooled Spring Hill Assembly with the best, most advanced technology in the world and the team worked tirelessly to complete the preparations nine months ahead of the original schedule.”

https://www.torquenews.com/3768/all-new-2023-lyriq-ev-critical-future-cadillac

Fisker claims digital radar will make its system safer on the highway, in the city, and in bad weather.

In addition to digital radar and cameras, FI Pilot will rely on ultrasonic sensors, and will have a driver-monitoring camera, Fisker said. However, there was no mention of lidar, which many automakers consider critical for driver-assist systems. Fisker previously indicated it would skip lidar, following the approach of Tesla and Toyota.

Granted, Fisker hasn't offered much detail on the capabilities of FI Pilot. Given that it has a driver monitor, it may land at Level 2 on the SAE autonomy scale, similar to General Motors' Super Cruise or Ford's BlueCruise systems that can control the brake, throttle, and steering in some limited situations, but require the driver to take over in case the system can't keep up. In that case. lidar may not be as important. But automakers like Mercedes-Benz are aiming for higher levels of automation, and matching that may be difficult without lidar. Fisker does say the system will have automatic emergency braking for front and rear cross-path situations and when turning against traffic.

https://www.motorauthority.com/news/1135377_fisker-ocean-ev-gets-intelligent-pilot-driver-assist-system-utilizing-digital-radar

Cool feature.
One last thing ...
Drive Pilot won't cost as much as Tesla's $12,000 so-called Full Self-Driving system. It was hinted that pricing will be comparable to a premium audio option, so we expect it to cost somewhere between $5,000 and $7,000.

In a separate demonstration, Mercedes-Benz showed us the Intelligent Park Pilot system that pushes into Level 4 driverless automation. This system allows the driver to park the vehicle in a specific area in commercial spaces (hotels, malls, airports, etc.) and exit the vehicle and the car will find a spot on its own and park itself. The driver can then summon the vehicle to the drop-off location or other designated area and depart.

Intelligent Park Pilot is being tested at the Stuttgart airport in Germany and has strong potential to make it to the U.S. The system leans heavily on lidar or stereo camera sensors installed throughout the parking facility rather than relying solely on the sensors built into the vehicle. As a result, it may be easier to predict if a pedestrian or other vehicle may cross the intended path. The demonstration went off without a hitch, but it's worth mentioning that the EQS sedan demonstrator vehicle moved at a very slow pace. Baby steps, right?

Edmunds says
The Mercedes-Benz Drive Pilot system is still very far from realizing the fully autonomous future, but it's a significant step in the right direction. It may not be able to drive you across the country, but it will make bumper-to-bumper traffic much more bearable.

https://www.edmunds.com/car-news/mercedes-benz-inches-closer-to-autonomous-driving.html

The 2023 Cadillac Lyriq electric crossover is now in production at General Motors’ Spring Hill, Tennessee factory, the automaker announced Monday. The EV is the luxury brand’s first electric vehicle.

The Lyriq is officially ahead of schedule after GM initially said that production was not slated to begin until late 2022. Facing criticism that its new EVs were taking too long to reach customers, the automaker put the Lyriq on an accelerated development schedule that resulted in an early 2022 start date.

“This is bringing Cadillac back to leadership, back to tier one luxury, and really getting an American luxury brand recognized and highly desirable, both from a design technology and engineering standpoint,” said Mark Reuss, president of GM, in a briefing with reporters on Monday.

https://www.theverge.com/2022/3/21/22988872/cadillac-lyriq-production-ev-spring-hill-delivery

That shows great confidence in the tech.

This distinction puts Mercedes' semi-autonomous system miles ahead of Tesla's AutoPilot or General Motors' SuperCruise. And it's not just a concept system. Drive Pilot has already been approved for use on all German highways. Mercedes is hoping to deploy it in the U.S. by the end of 2022.

Mercedes' willingness to accept liability for its semi-autonomous vehicles will surely help its chance of satisfying various regulators. While the distinction may sound like legal hair-splitting, removing driver responsibility required massive technological improvement over existing Level 2 systems. (As a reminder, the most advanced semi-autonomous systems available in the U.S., including Tesla Autopilot and GM SuperCruise, still fall under Level 2, where the driver is expected to actively supervise the system and be ready to take over instantly whenever the system disengages.) Drive Pilot has more redundancies, with additional power supplies to critical systems. It uses higher quality image processing and LiDAR scanners, and collates positioning data from GPS, Galileo, and GLONASS satellites for guidance. Unlike all currently available driver-assist systems, Drive Pilot is designed to give drivers a 10-second warning before switching off; engineers had to make sure that, in every situation, the system would safely and faultlessly hand over control.

If it seems like Europe gets all of the cool auto stuff, that’s because it’s kind of true. More wagons, more diesel powertrains, and in recent history, better safety technology. But that may be changing in the U.S., as Mercedes-Benz demonstrated in a series of technical demonstrations in Los Angeles last week.

The demonstrated systems will push Mercedes-Benz beyond its current Level 2 autonomous driving aids to Level 3 and Level 4, meaning that in both cases the car will be driving itself and will not require human intervention. This also means that if a crash were to occur in either case, the company would bear the liability and not the driver—a key area of distinction between these new systems and similar technologies that are on the road today.
Having found traffic on the reliably crowded interstate 10, it was time to turn the system on. It is activated by one of two buttons on the steering wheel that light up white when the system’s conditions are met. After activating the system, those lights turn turquoise and another turquoise indicator on top of the steering column lights up as the car takes over.

For the 15 minutes or so that we rode in traffic with the car, there was little to no drama, save for when an emergency vehicle was passing us in the other direction and the system shut off and asked the driver to take over. It tracked dead straight in our lane and worked smoothly to start and stop. The system does not yet have the capability to change lanes as some Level 2 systems will do automatically, but Mercedes says that will come eventually. If road markings can’t be detected, the car will continue along for six to seven seconds until it can reacquire its positioning before shutting off.

There are some conditions the driver has to meet to keep the car in its automated driving mode. You can’t climb in the backseat and if you try to scoot the seat back and lie down, a message pops up telling you that you must remain in reach of the pedals/wheels or the system will turn off. And the driver’s attention must remain fixed in what the vehicle considers “driver attention zones,” an area that includes the infotainment screen (on which Michael put on a YouTube video during our drive) and most of the dashboard. It does not include speaking to passengers: if the driver facing camera detects the driver speaking to the passenger or looking into the backseat for 30 seconds, a prompt warns the driver to turn back around, and after another 30 seconds it will shut off.

https://www.motorauthority.com/news/1135370_mercedes-benz-tests-automated-valet-parking-and-drive-pilot-hands-free-driving-in-us

On March 19, 2022, BYD’s super-hybrid flagship sedan Han DM series officially opened for pre-sale.

In terms of active safety, the newly added W-HUD head-up display supports the display of vehicle speed, navigation (navigation icons, intersection information), ADAS (cruise control, lane assist, blind spot warning), and incoming call indicator information, allowing drivers to view vehicle information more easily. convenient;

At the same time, DMS driver monitoring can monitor driver fatigue and attention, and remind drivers of fatigue and distraction through multimedia, instrument icon text and language, making travel more assured.

https://gamingsym.in/loss-of-electricity-and-fuel-consumption-of-5-2l-the-power-is-comparable-to-the-v10-enginebyd-han-dmi-p-official-pre-sale-216800-starts/

Due to Qualcomm's dominance in the Android field and the resulting friendly ****pit ecological development environment, both the Snapdragon 820A and SA8155 have achieved great success in the smart car market.

The penetration of SA8155 is even stronger. New cars to be launched in 2022 include NIO ET7, Zhiji L7, Xiaopeng P5, while GAC Aion LX and Weimar W6 have already achieved mass production and loading. Qualcomm's statistics show that 20 of the world's largest 25 car companies have adopted the third-generation Snapdragon digital ****pit platform, the 8155 series.

Under such an offensive, it is almost predictable that the Snapdragon 888, which has achieved a dominant position in the flagship smartphone market, that is, the SA8295 series, will make greater progress in the automotive market.

From the perspective of the chip itself, industry sources revealed that SA8295 is built on a 5 nm process technology, with a CPU computing power of more than 200K DMIPS, a GPU computing power of more than 3000 GFLOPS, support for WiFi 6 and Bluetooth 5.2, of which the NPU's AI computing power has reached 30 Tops.

The AI ??computing power of 30 Tops here has equaled that of Nvidia's previous generation smart driving chip Xavier, which was once mounted on Xiaopeng P7, driving Xiaopeng's XPILOT 3.0 architecture to make high-speed navigation assisted driving NGP and parking lot memory parking. The vehicle VPA has achieved the staged best experience in China's intelligent driving market.

But now, just inside the ****pit, the concentration is piled up with 30 Tops of fierce material. There is no doubt that Jidu has made a big bet in the ****pit area.
Back to the field of smart ****pit, Baidu has accumulated a lot of basic capabilities and rich experience in front-loading mass production in the field of digital ****pit. Including voice engine, scene engine, extensive content and service capabilities, etc.

Although sitting on such a big tree, the work Jidu has to do is not simple. After several years of development, Baidu Apollo's basic capabilities are large and comprehensive, and copying is obviously not a desirable method. If what Jidu is to do is a Lego toy, Baidu Apollo's role is more like a Lego model toy library. What kind of model is useful, easy to use, and vital to Jidu. This is the key question Jidu is going to answer.

Perhaps this is also an important reason why Jidu first started the development of the software integration simulation prototype SIMUCar ( Software Integration Mule Car ) and the development of the front digital ****pit.

https://inf.news/en/auto/62332f2f67aa85017429ec9ef19025f7.html

ZF continuously investigates ways that can help to monitor the health and wellbeing of vehicle passengers and driver engagement levels. One approach utilizes sensors directly integrated into the vehicle HMI (e.g. the steering wheel) to measure vital health statistics like heart rate and heart rate variability. Beyond direct sensing of the hands on a steering wheel, camera-based interior monitoring of eye gaze allows ZF to determine different states of driver awareness.

In future, camera- or radar-based occupant monitoring systems will be able to indirectly monitor the health and attention level of the driver and also other vehicle occupants. The detection of micromovements of the body and evaluating the overall body pose offers valuable insights to determine the in-cabin situation and enable adaptive safety strategies. Another interesting application field for such sensors is that autonomously driven passengers may be more prone to motion sickness, and its detection may lead to countermeasures by the vehicle controllers. These are just a few examples of potential in-cabin health vital sensing and we expect to see this expand in the future.

https://www.just-auto.com/interview/zfs-vision-of-sustainable-next-generation-mobility/

Only 3 months to wait...

Update: ‘Ultra Cruise’ sub-section of the ‘Design & Features’ section, ‘Production & Price,’ and ‘Release Date’ section updated.

General Motors teased the Cadillac Celestiq at CES 2021, showing the flagship car’s glass roof, which can transition between transparency and opaqueness at a push of a button, as well as the full-width digital panel for instruments and AVN. The teaser was enough to get the internet’s attention, and it is seen as an effort by Cadillac to restore the former glory of the American luxury brand with its new sedan, offering a high level of luxury, features, and design.

Compute architecture, which GM co-developed with Qualcomm, will power Ultra Cruise. It’s quite compact, only about the size of two laptops placed on top of each other, yet it possesses the processing capability of several hundred PCs.

The Ultra Cruise compute consists of two SA8540P SoCs and one SA9000P AI accelerator, which together deliver low-latency control functions on 16-core CPUs and high-performance AI compute of more than 300 TOPS for the processing of the camera, radar, and LiDAR. Qualcomm Technologies has designed the Snapdragon SOCs with the new 5-nanometer process technology, which means superior performance and power efficiency. The two SA8540P SOCs will give the required bandwidth for the autonomous driving system’s sensing, perception, planning, localization, mapping, and driver monitoring.

https://topelectricsuv.com/news/cadillac/cadillac-celestiq-update/

Innovation continues in the automotive industry with the unveiling of our 4th-gen Qualcomm Snapdragon Automotive ****pit platforms. These digital ****pit platforms are designed to transform in-vehicle experiences, and support higher levels of compute and computing intelligence needed for advanced capabilities like improved safety and awareness, advanced navigation, and immersive infotainment.

The 4th-gen Qualcomm Snapdragon Automotive ****pit platforms signal a shift in the automotive industry — an evolution in automotive architecture to address growing compute and cost reduction needs. We’re moving from mechanical hardware-centric vehicles to software devices on wheels.

The 4th-gen Qualcomm Snapdragon Automotive ****pit platforms are built on a zonal EE compute architecture. This software-based architecture is both modular and scalable. The main building block of this automotive architecture is the central computer that provides the consolidation of components, including ****pit, ADAS, gateway, body controller, telematics, and more.

The new digital ****pit platforms utilize 5nm processing technology, providing OEMs with one of the highest performance system-on-chip (SoC). They’re equipped to meet the user experiences of the next-generation digital ****pit, with support for Qualcomm Car-to-Cloud with Soft SKU capabilities, so consumers get the latest features and capabilities through OTA updates.

Snapdragon Automotive ****pit platforms support various building blocks that contribute to best-in-class in-vehicle experiences. They include the 6th generation Kryo CPU for high-performance compute capabilities, the latest generation Adreno GPU for rich graphics and multimedia support, a cutting-edge AI Engine for driver and passenger personalization and in-car virtual assistance, contextual awareness and safety enhancements, immersive audio, Wi-Fi 6 and Bluetooth 5.2 connectivity, and telematics and C-V2X support.

The 4th-gen Qualcomm Snapdragon Automotive ****pit platforms will help OEMs deliver a unique, differentiated experience for drivers and passengers, with the industry’s most advanced digital cabin solutions.

Learn more about Qualcomm Snapdragon Automotive ****pit deep dive with Qualcomm Technologies Senior Director, Automotive Product Management Vasanth Waran: https://youtu.be/Bj6jsi2KDRQ

https://www.youtube.com/watch?v=xJod6TQDGCI

Lewbo
Thats an understatement. Like to see the famous Lewbo chart 2017 v 2022 version and none of them contracts since been changed still.

We deserve an update on all contracts.

GM 1 model to ?
BMW 1 model to?
Ford 1 model to ?
Mercedes 1 model to ?
FCA 1 model to ?

How many upgrade RNS have we had? Is it just the $25m BMW one?

Still cant believe we not even announced a model from Ford after 15 months of being in a showroom for the Mustang.

Grrrrrr.........Wish they pull their finger out on these elements.

When Qualcomm entered the market for ADAS and autonomous vehicle systems with its Snapdragon Ride platform in 2020, the company indicated a desire to build an open and scalable platform that automotive suppliers and OEMs could customize for future ADAS and autonomous vehicle systems. Snapdragon Ride is built on the company’s power-efficient heterogenous processing and connectivity technology and leverages software developed by both Qualcomm and its partner Arriver, which is in the process of being acquired by Qualcomm. The platform has been adopted by several leading global OEMs, including BMW, GM, and Ferrari. Now the company is taking the platform a step further with a strategic development partnership with BMW.

According to the announcement, Arriver, BMW, and Qualcomm will be jointly developing a software stack designed for level 2 ADAS and level 3 Autonomous Driving (AD). The effort combines BMW’s level 2 AD stack, Arriver’s Vision Perception and NCAP (New Car Assessment Program) Drive Policy, and Qualcomm’s Snapdragon Ride platform. The joint development effort will combine decades of R&D by the three companies and more than 1,400 engineers located in China, the Czech Republic, Germany, Romania, Sweden, and the U.S. The goal is to provide a scalable and customizable AD software stack. Included in the development are the toolchain and support infrastructure, such as a data center for storage and tools for reprocessing and simulation.
The joint development agreement stipulates each company will have the right to use, modify, and/or market the solution as a product. BMW plans to use a version of the product in its upcoming vehicles. Note that in November 2021, BMW announced plans to use the Snapdragon Ride platform, including the Snapdragon Ride vision system SoC, the Snapdragon Ride compute SoC, and the Snapdragon Car-to-Cloud services, in future BMW models. Qualcomm/Arriver will work with Tier 1 automotive suppliers and OEMs to provide versions of the platform suited to each customer’s specific requirements.

There are three noteworthy points about the announcement. The first is Qualcomm’s continued commitment to the automotive segment. Although Snapdragon Ride was only introduced in 2020, the company has been providing connectivity solutions for several decades, has developed four generations of ****pit/infotainment platforms, and the Ride platform has been in development for over a decade. Although Qualcomm is leveraging some of the same technologies that were initially developed for the smartphone market as part of the company’s “One Technology Roadmap,” the company did not enter this segment as simply an adjacent market for its technology. As with the wireless and mobile segments, Qualcomm has invested in the R&D and partnerships necessary to build a complete ecosystem around an open platform.

https://www.forbes.com/sites/tiriasresearch/2022/03/16/bmw--qualcomm-drive-an-open-autonomous-auto-ecosystem/?utm_campaign=forbes&utm_sour

NICe find Lewbo

As well as bigger yacht you will need a bigger sheet of paper for your infamous chart.

Must be a few cheap superyachts out there atm

Such systems, often relying on a driver-facing camera that monitors eye and head movements, have already been deployed in thousands of long-haul trucks, mining trucks. and heavy construction vehicles, especially to identify drowsiness, alcohol or drug use, and general distraction.
The eye tracking market leader, Seeing Machines of Australia, has begun testing its system on giant mining trucks. A driver who falls asleep and crashes can cost the mining company $ 15,000 per hour while the truck waits for repair.

Heavy equipment company Caterpillar later licensed the Seeing Machines technology for its own vehicles. Today, the company operates an extensive safety network for its customers, who want to reduce crashes and liability costs associated with driver fatigue and disruption, which cause more crashes than alcohol and other drugs combined, according to the company.

If the system detects a driver appearing to be drowsy, the information will be sent to the safety section of Caterpillar’s ??fleet monitoring center in Peoria, Ill. Supervisors were notified. Caterpillar has also released a wristband for drivers called the Cat Smartband to predict drowsiness before the driver can ride the wheel by tracking sleep patterns and waking up when the driver is in bed. The company keeps its employees on a “fatigue risk dashboard.”

Seeing Machines is also aggressively chasing the long-haul truck market, with its system installed on more than 30,000 trucks, according to the company. The data is sent back to Seeing Machines and used to repair the system.

The possibilities for eye tracking monitors in cars started at the same time that companies like Google started making driverless cars. The same factors are driving both: dramatic advances in machine learning, a type of artificial intelligence, combined with more powerful computers and new chip designs.

The Seeing Machines camera uses infrared light to detect head pose, eye position and eyelid movement. The infrared sensor operates at night and through most sunglasses. If a person looks drunk, tall, distracted or asleep, the system can alert the driver, and in severe cases, an advanced driver-assist system can pull the car to the side of the road.

Such systems are not subtle. “You can look your eyes down the road and never pay attention,” said Cummings, Duke’s professor. “We’re all lost in our minds.”
https://trendcartz.com/the-almost-future-of-driving-the-cars-that-watch-you-watch-them-drive/

The Snapdragon SoCs are designed with 5-nm process technology that enables performance, power efficiency, and bandwidth for Ultra Cruise’s sensing, perception, planning, localization, mapping, and driver monitoring. Along with Snapdragon Ride SoCs, the compute includes an Infineon Aurix TC397 processor for ASIL-D—the highest Automotive Safety Integrity Level.

https://futurride.com/2022/03/15/momentum-builds-for-qualcomms-snapdragon-autonomy-and-connectivity-solutions/