Discussion about this post

User's avatar
Amy Greenblatt's avatar

Come for the legal analysis, stay for the cat pictures. Thank you, Professor.

Expand full comment
Stephen Michael Kellat's avatar

Well, I wound up with a double-header on Tuesdays and Thursdays for the summer term teaching. I just met both of my new sections of my digital literacy class on Thursday. That means I have to miss office hours through August 1st.

I'll throw this out there now since I can't be at office hours. It kinda intersects the cases being talked about. I know I had to bring it up with my digital literacy students in-class. Microsoft recently announced a feature called "Recall". Quite a few people in the tech sector became increasingly horrified when details dribbled out as to how this would be implemented. It would be a total boon to prosecutors, though. The goal of the feature would be to allow you to ask a natural language question to an AI system and be able to search back within the past 90 days or so to see what you did. To accomplish this, though, the system would take constant screenshots of everything that you did that would be uncensored and would capture everything including financial details, passwords, and medical information. Those screenshots would be transcribed by a computer vision AI running locally on your computer and saved in an unencrypted database that would be accessible to anybody that had your password/PIN to access the computer. A proof of concept attack was published that showed fairly quickly that you wouldn't need anything on the scale of NSO Group's Pegasus to do evil with this.

Although Microsoft said initially it would only be turned on by default on their new Copilot+ AI-enabled computers that they would be selling an additional detail dropped that it would later be pushed to all Windows 11 computers and enabled by default. The outrage in the IT sector got very loud at that point and people started discussing adversarial mitigations to be able to disable the new feature as quickly as possible. Microsoft finally backpedaled Friday and said that it would shift from the feature being opt-out to being opt-in but it would still ship it as part of the operating system.

Imagine if this existed in the criminal cases of Hunter Biden and Donald Trump as evidence.

Expand full comment
10 more comments...

No posts