I also don't trust this Hololens crap. Microsoft has been known to spy on people.
Since the hololens is designed to map and detail the contents of your house I wouldn't doubt they would use this against their customers.
They see a pizza box in the background, you get a stuff ton of pizza ads in your email.