RE: CB - Smarteye Volvo Gentex14 Mar 2025 00:38
@Maps, As @TLS has summarized, i couldn't have said it better.
Just to add it is clear that standalone DMS in the mirror will need a embedded solution, AI on the edge. Its either going to be a custom NPU or a ARM based heavily optimized code.
There are questions if DMS will work efficiently on ARM, considering that we need to run several AI models. For DMS only could be fine, but DMS + CMS/OMS will be really tough.
Just a gaze monitoring would need a AI chain to run at every 20 msecs then add on top of it there will be separate AI chains running to monitor the body position, device monitoring , smoking etc etc. Then on top of it remember SEE solution is a single camera, RGB IR. so you have 3 video frames every 20 msecs to be processed, for just gaze
So you need something that can run the recent AI models for object detection, gaze estimation all running independently some every 20 msec some maybe every few seconds. There are bandwidth considerations, just having a good processor does not help. you need something that is decent processing with great memory utilization, and hence Occula custom NPU
How do you put so much processing into the form factor behind the mirror and work within all the temperature and vibration pointed out by TLS. Even a company like Gentex is not totally confident, as far as i surmise from their investor calls.
it seems right to me that VW rolled out DMS is a part of their models for the first year, the downside to having this across all models and failing is quite high. SEE has probably crossed the threshold, or maybe in a few more months, that we can say that the product is working.
As to why standalone DMS is important, think what hapeens for mid to lower end cars, which dont have the processing power available in console? Think of DMS design being independent of the car model. It indeed provides a lot of flexibility. The risk is as TLS pointed out, so freaking hard to make it work
Sign In
Follow the stocks
