In some implementations, sensors provide sensor data reflecting user activity detected by the sensors. An event analyzer generates an impact score for a change to an event associated with a user based on routine-related aspects generated from one or more user routine models associated with the user. The one or more user routine models are trained based at least in part on interaction data comprised of the sensor data. The impact score may be generated by analyzing the event attributes with respect to the routine-related aspects. The impact score is generated based on determining a difference in a level of deviation caused by the change, between one or more event attributes and routine-related aspects and based on comparing a time of the event to a reference time. The impact score can be used to determine which changes to events are important to the user.