Gabi Zijderveld

Vehicle interior object management uses analysis for detection of an object within a vehicle. The object can include a cell phone, a computing device, a briefcase, a wallet, a purse, or luggage. The object can include a child or a pet. A distance between an occupant and the object can be calculated. The object can be within a reachable distance of the occupant. Two or more images of a vehicle interior are collected using imaging devices within the vehicle. The images are analyzed to detect an… Show more

Vehicle interior object management uses analysis for detection of an object within a vehicle. The object can include a cell phone, a computing device, a briefcase, a wallet, a purse, or luggage. The object can include a child or a pet. A distance between an occupant and the object can be calculated. The object can be within a reachable distance of the occupant. Two or more images of a vehicle interior are collected using imaging devices within the vehicle. The images are analyzed to detect an object within the vehicle. The object is classified. Alevel of interaction is estimated between an occupant of the vehicle and the object within the vehicle. The object can be determined to have been left behind once the occupant leaves the vehicle. A control element of the vehicle is changed based on the classifying and the level of interaction. Show less

Analytics are used for live streaming based on analysis within a shared digital environment. An interactive digital environment is accessed. where the interactive digital envi-
ronment is a shared digital environment for a plurality of participants. The participants include presenters and view- ers. A plurality of images is obtained from a first set of participants within the plurality of participants involved in
the interactive digital environment. Cognitive state content is analyzed… Show more

Analytics are used for live streaming based on analysis within a shared digital environment. An interactive digital environment is accessed. where the interactive digital envi-
ronment is a shared digital environment for a plurality of participants. The participants include presenters and view- ers. A plurality of images is obtained from a first set of participants within the plurality of participants involved in
the interactive digital environment. Cognitive state content is analyzed within the plurality of images for the first set of participants within the plurality of participants. Results of
the analyzing cognitive state content are provided to a second set of participants within the plurality of participants. The obtaining and the analyzing are accomplished on a device local to a participant such that images of the first set of participants are not transmitted to a non-local device. The analyzing cognitive state content is augmented with evalu- ation of audio information. Show less

In-cabin sensor data, including images of a vehicle interior, is collected. The images can include video, intermittent video, still images, and the like. An occupant is detected within the vehicle interior, based on the in-cabin sensor data. The detecting is based on identifying an upper torso of the occupant, using the in-cabin sensor data. The imaging is accomplished using imaging devices within a vehicle interior. An additional occupant within the vehicle interior is detected. A human… Show more

In-cabin sensor data, including images of a vehicle interior, is collected. The images can include video, intermittent video, still images, and the like. An occupant is detected within the vehicle interior, based on the in-cabin sensor data. The detecting is based on identifying an upper torso of the occupant, using the in-cabin sensor data. The imaging is accomplished using imaging devices within a vehicle interior. An additional occupant within the vehicle interior is detected. A human perception metric for the occupant is analyzed, based on the in-cabin sensor data. The detecting, the locating, and/or the analyzing are performed using machine learning. The human perception metric is promoted to a using application. The human perception metric includes a mood for the occupant and a mood for the vehicle. The promoting includes input to an autonomous or semiautonomous vehicle. Show less

Vehicle manipulation is performed using crowdsourced data. A camera within a vehicle is used to collect cognitive state data, including facial data, on a plurality of occupants in a plurality of vehicles. A first computing device is used to learn a plurality of cognitive state profiles for the plurality of occupants, based on the cognitive state data. The cognitive state profiles include information on an absolute time or a trip duration time. Voice data is collected and is used to augment the… Show more

Vehicle manipulation is performed using crowdsourced data. A camera within a vehicle is used to collect cognitive state data, including facial data, on a plurality of occupants in a plurality of vehicles. A first computing device is used to learn a plurality of cognitive state profiles for the plurality of occupants, based on the cognitive state data. The cognitive state profiles include information on an absolute time or a trip duration time. Voice data is collected and is used to augment the cognitive state data. A second computing device is used to capture further cognitive state data on an individual occupant in an individual vehicle. A third computing device is used to compare the further cognitive state data with the cognitive state profiles that were learned. The individual vehicle is manipulated based on the comparing of the further cognitive state data. Show less

Techniques are described for cognitive analysis for directed control transfer for autonomous vehicles. In-vehicle sensors are used to collect cognitive state data for an individual within a vehicle which has an autonomous mode of operation. The cognitive state data includes infrared, facial, audio, or biosensor data. One or more processors analyze the cognitive state data collected from the individual to produce cognitive state information. The cognitive state information includes a subset or… Show more

Techniques are described for cognitive analysis for directed control transfer for autonomous vehicles. In-vehicle sensors are used to collect cognitive state data for an individual within a vehicle which has an autonomous mode of operation. The cognitive state data includes infrared, facial, audio, or biosensor data. One or more processors analyze the cognitive state data collected from the individual to produce cognitive state information. The cognitive state information includes a subset or summary of cognitive state data, or an analysis of the cognitive state data. The individual is scored based on the cognitive state information to produce a cognitive scoring metric. A state of operation is determined for the vehicle. A condition of the individual is evaluated based on the cognitive scoring metric. Control is transferred between the vehicle and the individual based on the state of operation of the vehicle and the condition of the individual. Show less

Analytics are used for live streaming based on image analysis within a shared digital environment. A group of images is obtained from a group of participants involved in an interactive digital environment. The interactive digital environment can be a shared digital environment. The interactive digital environment can be a gaming environment. Emotional content within the group of images is analyzed for a set of participants within the group of participants. Results of the analyzing of the… Show more

Analytics are used for live streaming based on image analysis within a shared digital environment. A group of images is obtained from a group of participants involved in an interactive digital environment. The interactive digital environment can be a shared digital environment. The interactive digital environment can be a gaming environment. Emotional content within the group of images is analyzed for a set of participants within the group of participants. Results of the analyzing of the emotional content within the group of images are provided to a second set of participants within the group of participants. The analyzing emotional content includes identifying an image of an individual, identifying a face of the individual, determining facial regions, and performing content evaluation based on applying image classifiers. Show less

Content manipulation uses cognitive states for vehicle content recommendation. Images are obtained of a vehicle occupant using imaging devices within a vehicle. The one or more images include facial data of the vehicle occupant. A content ingestion history of the vehicle occupant is obtained, where the content ingestion history includes one or more audio or video selections. A first computing device is used to analyze the one or more images to determine a cognitive state of the vehicle… Show more

Content manipulation uses cognitive states for vehicle content recommendation. Images are obtained of a vehicle occupant using imaging devices within a vehicle. The one or more images include facial data of the vehicle occupant. A content ingestion history of the vehicle occupant is obtained, where the content ingestion history includes one or more audio or video selections. A first computing device is used to analyze the one or more images to determine a cognitive state of the vehicle occupant. The cognitive state is correlated to the content ingestion history using a second computing device. One or more further audio or video selections are recommended to the vehicle occupant, based on the cognitive state, the content ingestion history, and the correlating. The analyzing can be compared with additional analyzing performed on additional vehicle occupants. The additional vehicle occupants can be in the same vehicle as the first occupant or different vehicles. Show less

https://patents.google.com/patent/US10796176B2

Individuals can experience a wide range of emotions and mental states in response to stimuli such as a traffic jam, a dangerous storm, or encountering an accident. These mental states can be useful in evaluating vehicle control. Emotions can be expressed through facial expressions, voice volume or tone, heart rate, and more, which can be collected by cameras, microphones, and other sensors. Changes in emotional state can happen quickly… Show more

https://patents.google.com/patent/US10796176B2

Individuals can experience a wide range of emotions and mental states in response to stimuli such as a traffic jam, a dangerous storm, or encountering an accident. These mental states can be useful in evaluating vehicle control. Emotions can be expressed through facial expressions, voice volume or tone, heart rate, and more, which can be collected by cameras, microphones, and other sensors. Changes in emotional state can happen quickly. Providing an assessment of the individual’s emotional state can help the individual with decision-making. Emotional characteristics and patterns form a personal emotional profile, which can be used to evaluate mental states such as frustration, confusion, engagement, stress, and more. A personal emotional profile can be generated while an individual is a passenger or driver of a vehicle. The vehicle can be controlled and manipulated based on an individual’s personal emotional profile. The manipulation can include performing a lockout operation, recommending a break or a different route, adjusting seats or mirrors, adjusting climate control, adjusting lighting, adjusting music volume or genre, or engaging the brake and steering control to improve the driving experience and maintain safety.
Cognitive state data is obtained from an individual in a vehicle. One or more processors are used to extract the data from facial images of the individual. The images are captured as the individual responds to stimuli. The cognitive state data that was extracted from facial images is analyzed to produce cognitive state information. Norms are developed for the individual. One or more processors are used to categorize the cognitive state information against a personal emotional profile for the individual. The vehicle is manipulated based on the cognitive state information, the categorizing, and the stimuli.
Show less

Individuals who commute or travel for work, school, or necessary trips spend hundreds or more hours annually doing so. The commuting or traveling uses private vehicles such as private cars, public transportation including buses, trains, and airplanes, and ride share vehicles, among many others. The hours that are consumed by commuting or travel are completely lost when the individual is operating the vehicle. If the vehicle is self-driving or is being operated by another individual, then the… Show more

Individuals who commute or travel for work, school, or necessary trips spend hundreds or more hours annually doing so. The commuting or traveling uses private vehicles such as private cars, public transportation including buses, trains, and airplanes, and ride share vehicles, among many others. The hours that are consumed by commuting or travel are completely lost when the individual is operating the vehicle. If the vehicle is self-driving or is being operated by another individual, then the commuter or traveler can spend that time, working, sleeping, chatting with others, or enjoying entertainment offerings. The entertainment offerings that are made to the individual, whether movies, TV programs, games, podcasts, phone calls, or other diversions, can be influenced by the vehicle ride experience. Alternatively, the vehicle ride experience can be influenced by the entertainment offerings. That is, the offerings can be chosen so as to influence moods or emotions of an individual in the vehicle, or can be based on the existing moods or emotions of that individual.
An in-vehicle camera is used to collect cognitive state data on an occupant of a vehicle. The cognitive state data includes facial data and can also include voice data or physiological data. A cognitive state profile is learned for the occupant. The learned cognitive state profile is based on the cognitive state data. Further cognitive state data is captured on the occupant while the occupant is in a second vehicle. The further cognitive state data is compared with the cognitive state profile learned for the occupant. The second vehicle is manipulated based on the comparing of the further cognitive state data.
Show less

Individuals interact with many types of digital media content for work, play, information, and communication. The media is presented by a range of content providers with the aim of engaging or assisting the individuals. The individuals’ responses may include cognitive states, emotional states, and moods. The media content can induce desirable states in an individual who finds the content informative, engaging, or amusing, or can also induce perhaps unintended states such as ennui, annoyance… Show more

Individuals interact with many types of digital media content for work, play, information, and communication. The media is presented by a range of content providers with the aim of engaging or assisting the individuals. The individuals’ responses may include cognitive states, emotional states, and moods. The media content can induce desirable states in an individual who finds the content informative, engaging, or amusing, or can also induce perhaps unintended states such as ennui, annoyance or even anger. The individual’s cognitive states can inform the choice of content to which the individual best responds. The cognitive states can also be used to provide useful information or suggest favorite music. The chosen content can further be used to alter a response of the individual by adjusting environmental settings, or even by manipulating a vehicle in which the individual is traveling. The alterations can be used to calm an angry individual or prevent an impaired individual from operating a vehicle or equipment.
Cognitive state data, including facial and other data, is collected from an individual who is in a first vehicle. The data can indicate that the individual is drowsy, fatigued, distracted, impaired, etc. A neural network is used to analyze the collected data, where the analysis identifies facial expressions and cognitive states. The analysis is based on “classifying” whether a cognitive state is present in the collected data. A cognitive state profile is generated for the individual and is transmitted to a two-sided data hub. The two-sided hub can send the profile to a second vehicle which can be manipulated based on the cognitive state profile. Vehicle manipulation of the first vehicle or the second vehicle includes climate control within the vehicle, activating brakes, and so on.
Show less