Monthly update on human rights & tech: February 2023

The secret services' reign of confusion, rogue mayors and algorithm oversight (or not): a quick read through the most interesting developments at the intersection of human rights and technology from the Netherlands. This is the first in a series.

Who does the algorithm supervisor serve?

Supervision of the use of algorithmic systems, and mandatory human rights impact assessments were central to the electoral pact Bits of Freedom, Amnesty and others persuaded nine Dutch coalition- and opposition parties to sign in the run-up to the 2021 elections. Eventually, they even made their way into the coalition agreement. It goes without saying that we're pleased to see these plans coming to fruition. However, we're also weary of how the Dutch Data Protection Authority (DPA) has decided to interpret its role as algorithm supervisor. In its new role, the DPA will identify cross-sectoral risks, share knowledge, improve collaboration, contribute to joint standard-setting and create an overview of applicable rules. It won’t handle citizens’ complaints or carry out any kind of enforcement activities. We can’t help but worryRead a more thorough analysis on our website. (Dutch) the DPA has carried-over its closed-door policy to its new role, and wonder: if citizens cannot turn to the supervisor, who is the supervisor for?

As public institutions are increasingly making use of algorithms, and governments around the world are deciding on the rules to govern them, it’s hard to overstate the importance of cases like this.

Cabinet continues to chip away at secret service supervision and safeguards

For eight years, the secret services –and the cabinet members responsible for them– have been holding citizens and Parliament captive in a semantic tug-of-war. Confusion and exhaustion are central to a strategy that has led the secret services to be given more and more power with fewer safeguards, despite strong objections from citizens, NGO’s and Parliament. Since the new Dutch Intelligence and Security Services Act (Wiv 2017) went into effect in 2017, we’ve witnessed one legislative amendment realized and one announced, a “temporary arrangement”, a new “temporary” bill and, this month, a proposal for an amendment to that temporary bill. This means that currently Members of Parliament are being asked to discuss a proposal for a supplement to a law, of which both the supplement and the law will soon be amended. We responded to the consultationHere’s what we think of the new rules on how the secret services should handle bulk data., pointing out just how the supplement will lead to diminished supervision and safeguards and is far from “temporary”, and calling for due process.

Racist tech and the AI Act discussed during Parliamentary round table

After a few delays, Parliament finally got around to organizing a round table on the opportunities and risks of AI. Two contributions stood out. Quirine Eijkman of the Netherlands Institute for Human Rights spoke about Robin Pocornie’s case against the discriminatory use of proctoring software by VU University Amsterdam. During Covid, the university made students use Proctorio when sitting for exams. One of those students, Pocornie, noticed the software often failed to properly "process" her face. As a result, Pocornie struggled to access her exams, and even resorted to sitting through them with a bright light shining in her face. Supported by our friends at the Racism and Technology Center"Dutch Institute for Human Rights: Use of anti-cheating software can be algorithmic discrimination (i.e. racist)", the VU-student filed a complaint with the Netherlands Institute for Human Rights. At the end of 2022, the Institute ruled she had presented sufficient facts for a presumption of discrimination, and it was now on VU University to prove otherwise. As public institutions are increasingly making use of algorithms, and governments around the world are deciding on the rules to govern them, it’s hard to overstate the importance of cases like this.

The second contribution came from our own Nadia Benaissa, and focused in particular on the opportunities for raising protections in the AI ActThe Dutch Senate shares the concerns we have about the Artificial Intelligence Act.. Benaissa relayed our position on the right to transparency, explainability and verifiability. She also pointed to how the current text falls short in safeguarding people’s right to effective legal protection. Finally, she reiterated the importance of a broad ban on biometric identification"A limited ban on biometric surveillance undermines its own potential": this was our contribution at the European Parliament., which includes not just identification taking place in "real time" and applies to private actors as well as enforcement agencies.

And finally...

On January 18, the New York Times"How the Netherlands Is Taming Big Tech" reported on Dutch privacy activists and advisors spurring major, global changes at Google, Microsoft and Zoom. Interviewing Bits of Freedom co-founder Sjoera Nas, among others, the article identifies how audits of digital services commissioned by the government, have led to Big Tech companies making “major privacy changes”, the effects being felt around the globe. In more local news, mayors have been testing the limits of their powers by issuing online exclusion orders, claiming chat- and social media spaces constitute “online public spaces”Read more about the impact on the freedom of speech and our right to demonstrate. (Dutch) and, when something happens there pertaining to their jurisdiction (like someone calling for a demonstration), they therefore have the power to intervene. In 2021, the Mayor of Utrecht issued an order banning a Utrecht resident from Telegram – it is currently being challenged in court.

Receive this update in your inbox

Want to receive a heads-up when another monthly update is published? Leave your e-mail address behind and we’ll drop you a line whenever a new update becomes available. We'll not use your e-mail address for any other purposes.

E-mail address

Help mee en steun ons

Door mijn bijdrage ondersteun ik Bits of Freedom, dat kan maandelijks of eenmalig.