> ## Content Index
> Fetch the complete content index at: https://www.ai-360.online/llms.txt
> Use this file to discover other available public pages before exploring further.

# MIT Study Reveals AI's Inconsistent Decision-Making in Home Surveillance
- URL: https://www.ai-360.online/mit-study-reveals-ais-inconsistent-decision-making-in-home-surveillance/
- Published: 2024-09-23T10:20:00.000Z
- Updated: 2024-10-03T09:04:56.000Z
- Description: MIT study: AI models in home surveillance inconsistently detect crime, recommend police calls, and show demographic biases in decision-making
- Author: AI-360
- Tags: 1. Enterprise AI, MIT, News, PennState, Bias, Large Language Models

Researchers at the Massachusetts Institute of Technology (MIT) and Penn State University have discovered that artificial intelligence models, if used in home surveillance systems, could recommend calling the police even when no criminal activity is evident. The study, which will be presented at the AAAI Conference on AI, Ethics, and Society, highlights significant inconsistencies in how these AI models apply social norms to similar activities captured on video.

The research team, led by graduate student Shomik Jain from MIT's Institute for Data, Systems, and Society (IDSS), tested three prominent LLMs – GPT-4, Gemini, and Claude – using real surveillance videos from Amazon Ring cameras. They asked the models two key questions: whether a crime was occurring in the video and if they would recommend calling the police.

Key findings from the study include:

1\. Inconsistent crime detection: The models often failed to identify criminal activities, saying no crime was occurring in most videos, even though 39% of the footage showed criminal acts.

2\. Overactive police recommendations: Despite rarely identifying crimes, the models suggested calling the police for 20% to 45% of the videos.

3\. Demographic bias: Some models were less likely to recommend police intervention in predominantly white neighborhoods, even when controlling for other factors.

4\. Terminology differences: In majority-white areas, models used terms like "delivery workers," while in neighborhoods with more residents of color, they used phrases like "burglary tools" or "casing the property."

5\. Inconsistent decisions: Models often disagreed with each other about whether to call the police for the same video.

## Sign up for AI-360

AI from all perspectives: Where business & innovation meets application & regulation.

Subscribe 

Email sent! Check your inbox to complete your signup. 

No spam. Unsubscribe anytime.

The researchers noted that while the AI models didn't show significant bias based on the skin tone of individuals in the videos, they exhibited biases related to neighborhood demographics. This finding suggests that current efforts to mitigate AI bias may be insufficient and unpredictable.

The study raises important questions about the reliability and fairness of AI systems in high-stakes decision-making processes. As these technologies continue to advance, the researchers stress the need for more comprehensive testing and transparency in AI development.

---

[To read more articles like this, and be notified of new content published each week, Sign Up to our FREE newsletter](#/portal/signup/free)

---