Showing posts with label AIpolicy. Show all posts
Showing posts with label AIpolicy. Show all posts

Tuesday, August 5, 2025

What If AI Creates Discrimination? The Truth Behind Facial Recognition Technology and Racial Bias Lawsuits

What If AI Creates Discrimination? The Truth Behind Facial Recognition Technology and Racial Bias Lawsuits

An era when we believed AI was more fair—can technology sometimes be more discriminatory than humans?


What If AI Creates Discrimination? The Truth Behind Facial Recognition Technology and Racial Bias Lawsuits

Hello. Today, I want to talk about facial recognition technology, which is being used in an increasing number of fields, especially legal disputes related to racial discrimination. I personally use facial recognition for access systems and unlocking my smartphone, and I’ve found it very convenient. However, recent news surprised me—this technology may not be fair at all. Cases where the system fails to recognize or misidentifies certain racial groups have actually gone to court. Aren’t you curious, too? In this post, we'll dive into the biases hidden in facial recognition algorithms, the lawsuits they've sparked, and the ethical responsibilities of such technologies.

Overview and Applications of Facial Recognition Technology

Facial recognition technology analyzes faces captured by a camera using artificial intelligence to determine if they match a specific individual. It’s actively used in fields such as security, finance, marketing, access control, and criminal investigations. Especially since the pandemic, it has gained attention as a contactless authentication method and has spread rapidly worldwide. However, behind this convenience lie unresolved technical biases and ethical concerns. Issues such as real-time surveillance, potential privacy violations, and, most critically, disparities in recognition accuracy based on race or gender are at the center of this debate.

AI Bias and Racial Disparities in Accuracy

According to a joint study by MIT and Georgia Tech, commercial facial recognition systems showed an accuracy rate of nearly 99% for white males but only about 65% for Black females. This is due to the biased datasets used for AI training, which tend to include an overwhelming number of white-centered images.

Race/Gender Group Average Recognition Accuracy
White Male 99.0%
White Female 93.5%
Black Male 88.0%
Black Female 65.0%

Wrongful Arrests Due to Facial Recognition in the U.S.

In 2020, a Black man in Detroit was wrongfully arrested due to a misidentification by facial recognition software. This incident is a representative case that highlights structural issues that can arise when AI technology is used in law enforcement. He was identified as a suspect in a crime he had no connection to and was humiliated by being arrested in front of his family.

  • AI analyzed blurry footage from a security camera to identify a suspect.
  • Police fully relied on the algorithm’s results to carry out the arrest.
  • The victim later filed a lawsuit citing civil rights violations and emotional damage.

The legal battle over the misidentification case centered around a sharp dispute over who should be held accountable. The victim sued both the algorithm developer and the police, arguing that not only was the technology flawed, but the investigative agency was also at fault for accepting the results uncritically. In contrast, the police claimed, “The technology was merely a reference, and human judgment ultimately made the decision.” As algorithm-based decisions increasingly influence legal outcomes, there is still no clear standard for determining responsibility.

Regulatory Discussions Around Facial Recognition

As public awareness of the dangers and biases of facial recognition technology grows, some countries and local governments have begun implementing restrictions or outright bans. In particular, San Francisco and Oakland in the United States have legally prohibited public agencies from using facial recognition, while the European Union is moving toward regulating AI based on risk levels through the AI Act.

Region/Country Key Measures
San Francisco, USA Ban on facial recognition use by police and public institutions
European Union (EU) Risk classification system and pre-approval for high-risk AI
South Korea Establishment of AI ethics standards and discussion on revising data protection laws

Ethical Challenges Toward Fair AI

For AI technology to be truly integrated into human society, it must be grounded not just in technical precision, but also in social trust. The following ethical challenges are crucial to consider moving forward:

  • Ensuring diversity and representativeness in datasets
  • Introducing algorithm audits and independent oversight systems
  • Legislating to prevent misuse of technology by public agencies

Frequently Asked Questions (FAQ)

Q Is facial recognition technology racist?

While the technology itself may be neutral, biased training data can result in lower accuracy for certain racial groups, leading to discriminatory outcomes.

Q Has anyone actually been arrested due to facial recognition error?

Yes, a Black man in the U.S. was wrongfully arrested due to a facial recognition malfunction, which led to a civil rights lawsuit.

Q Which companies are developing facial recognition technology?

Major tech companies such as Microsoft, IBM, and Amazon have developed facial recognition systems. Some have since halted sales due to ethical concerns.

Q Are there laws regulating facial recognition technology?

Yes, some local governments and countries have enacted laws to ban or restrict the use of facial recognition. The EU is working on a regulatory framework through its AI Act draft.

Q How accurate is facial recognition technology?

Accuracy varies by race and gender. While it reaches up to 99% for white males, it drops to around 65% for Black females—showing a wide disparity.

Q Can individuals opt out of facial recognition use?

In some countries, legal mechanisms are being put in place to limit facial recognition in public spaces and guarantee individuals the right to refuse.

Final Thought: For AI to Truly Serve Everyone

Facial recognition technology clearly makes our lives more convenient. However, if that convenience comes at the cost of excluding or harming certain groups, then the technology can no longer be called neutral. I’ve grown accustomed to unlocking my phone with my face, but while preparing this article, I was reminded that technology is not always fair or just. As much as we use technology, it’s time we also ask whether it treats us fairly. What are your thoughts? Feel free to share them in the comments!

Friday, May 2, 2025

TikTok Algorithm Ownership Dispute – When Code Becomes a Matter of National Interest

TikTok Algorithm Ownership Dispute – When Code Becomes a Matter of National Interest

Who should own and control TikTok's algorithm? A single line of code has become a central issue in global diplomacy.


TikTok Algorithm Ownership Dispute – When Code Becomes a Matter of National Interest


Hello! I study IT policy and technology ethics, and one of the most intriguing recent cases for me has been the ‘TikTok algorithm ownership dispute.’ This isn't just about technical ownership — it's a complex issue involving national security, data control, and freedom of expression. With the U.S. government sanctioning TikTok and pressuring for a sale, and China firmly opposing the handover of the algorithm, the tension has escalated. In this post, we’ll look at what TikTok’s algorithm actually is, the key points of the issue, and what the future might hold.

1. How Does TikTok’s Algorithm Work?

TikTok’s core competitive edge lies in its user-personalized recommendation algorithm. It collects massive data points such as how long a user watches a video, whether they finish it, how they react to certain music, and more. Then, using machine learning, it delivers hyper-personalized content. This system plays a key role in determining what appears in the “For You” feed.

This algorithm is far more than just a content ranking system — it is deeply involved in shaping public opinion and social influence. That’s why governments around the world are reacting so sensitively to it.

2. Why Is Algorithm Ownership a Problem?

TikTok is a subsidiary of the Chinese company ByteDance, and the intellectual property rights of the recommendation algorithm are held by the headquarters. However, as suspicions emerged that U.S. user data could be transmitted to Chinese servers, the algorithm itself began to be seen as a national security threat.

Issue Details
Intellectual Property Ownership ByteDance headquarters in China holds the core algorithm source code
Data Sovereignty Concern Fear that U.S. user data might be exposed to foreign governments
Algorithm Export Control Chinese government designated the technology as "strategic" and restricted overseas transfer

3. U.S. Pressure for Sale and Legal Grounds

Since 2020, the U.S. government has attempted to regulate TikTok. By 2023–2024, it moved forward with a forced sale bill, claiming that foreign companies should not be allowed to control American citizens' data.

  • National security reviews via CFIUS (Committee on Foreign Investment in the United States)
  • Emergence of specific regulatory bills such as the “RESTRICT Act”
  • Possibility of presidential orders prompting sale or ban of TikTok

4. China’s Stance and Technology Export Restrictions

The TikTok algorithm is not merely a corporate asset but classified as a strategic technology of China. In 2020, the Chinese government updated its list of export control technologies—including AI and content recommendation algorithms—effectively designating the TikTok algorithm as non-exportable.

This is seen as a countermeasure to the U.S. pressure to force a sale, justified by the need to protect digital sovereignty and strategic technology. China argues that the algorithm is not just code, but a “core asset” influencing culture, public opinion, and future industrial competitiveness.

5. The Beginning of a Global Algorithm War

The TikTok debate is not just about a single app. Moving forward, ownership and control over algorithms—in AI-based recommendation systems, search engines, and ad targeting—may become key global issues. The EU, India, Canada, and others are already enforcing strict regulations on tech companies including TikTok.

Country/Region Key Measures Purpose
United States Pressure to sell TikTok, ban on government devices National security, data sovereignty
EU Implementation of the Digital Services Act (DSA) Enhanced algorithm transparency, user protection
India Ban on over 200 Chinese apps including TikTok Digital sovereignty, security concerns

6. Future Scenarios: Sale, Ban, or Separation?

Currently, TikTok stands at a crossroads in the U.S. It’s uncertain whether it will operate as a separate U.S. entity while retaining algorithm ownership, be sold off, or get banned entirely.

  • Sale: Transfer to a new entity managing U.S. user data
  • Ban: Possible revival of a full ban as attempted during the Trump administration
  • Split Operation: Technical separation between global TikTok and TikTok U.S.
  • International Norms: Expansion of discussions on global algorithm sharing or audit systems

Frequently Asked Questions (FAQ)

Q Why is the TikTok algorithm considered so important?

The TikTok algorithm is a core technology that recommends content based on user behavior data. It significantly impacts user engagement, advertising effectiveness, and even public opinion—making it a matter of political and diplomatic concern.

Q Why is the U.S. targeting TikTok?

Concerns center around ByteDance, a Chinese firm, potentially collecting and controlling U.S. user data, and influencing public opinion via the algorithm. These factors have framed the issue as a national security threat.

Q If TikTok is sold, can the algorithm be transferred too?

The Chinese government has designated the algorithm as a strategic technology, restricting its overseas sale. Even if a U.S. company acquires TikTok, it’s unlikely the algorithm itself would be part of the deal.

Q Have other countries besides the U.S. imposed regulations on TikTok?

Yes. India has banned over 200 Chinese apps including TikTok, and the EU is enforcing the Digital Services Act (DSA), demanding algorithmic transparency.

Q Doesn’t ByteDance already have a separate U.S. entity?

Yes. TikTok US operates as a separate legal entity with its own servers, but the core algorithm remains under control of the Chinese headquarters—fueling controversy over this dual structure.

Q Are there international standards or oversight for algorithms?

Not yet. There are only country-level or regional regulations. International standards or audit systems for algorithms are still in the early stages of discussion.

Algorithms: From Technology to Political Weapon

The dispute over TikTok's algorithm isn't just about business competition. Algorithms have now become central to global security, democracy, sovereignty, and cultural control. Code is no longer a neutral technology. It influences what data we see and what content we trust. Who owns and controls these algorithms could shape the future of our world. I hope this article gives you a chance to reflect on the ethics, politics, and importance of defending our digital sovereignty.

Puttaswamy (Privacy) (India, 2017): Privacy Is a Fundamental Right

Puttaswamy (Privacy) (India, 2017): Privacy Is a Fundamental Right “How far can the state look into your body, your data, and your choi...