Race After Technology: Abolitionist Tools for the New Jim Code by Ruha Benjamin
My rating: 5 of 5 stars
This book builds on the research in Algorithms of Oppression: How Search Engines Reinforce Racism and Dark Matters: On the Surveillance of Blackness, so I definitely recommend reading those two books first. I’m not alone in that, in one of the talks I’ve watched Benjamin give, she explicitly mentions those books as influencing her. I really enjoyed this book, it brought together ideas from my own master’s degree, including the complexity of how technology is used. In one class we specifically discussed the Moses’s bridges in New York (despite this being taught in the Netherlands), which were designed to exclude the poor by preventing buses from crossing the bridge. In this book she discusses this bridge and how it can pull in the very people that were expected to benefit the bridge design (basically a bus full of rich white kids went across after they came back from a trip to Europe, the driver hit the top of the bridge which resulted in 6 people getting seriously injured).
She modernizes these examples by describing how algorithms are created to approximate details about people, such as determining their ethnicity to provide “targeted services.” Due to historical redlining, the practice of creating white people only enclaves in suburbs and portions of the city (a Jim Crow era set of laws), the zip code has become a reliable indicator of ethnicity and race. She gives the example of Diversity, Inc., which creates ethnicity or racial classifications for potentially hiring companies. They will look at the names of people and assess their ethnicity, however due to the history of slavery, many African Americans have white sounding surnames, like Sarah Johnson, to “correctly” identify the ethnicity of Sarah, the company uses her zipcode to assign her race.
Overall, I found a lot of examples in this book very illuminating. Benjamin finds the approach to Design favored in Silicon Valley wanting and excluding, primarily focused on empathizing for making money, which in many cases is empathizing with whiteness. Furthermore, Benjamin argues that empathy can lead skewed results, such as body camera video providing empathy for police officers even when they are killing Black people for crimes which aren’t capital offenses or no crime at all.
As an engineer, I took this book as a warning. That we need to understand how data is impacting those around us. That we need to understand how data that might seem harmless to me, could cause serious harm to someone else. That algorithms that seem to be doing good, could instead be quickly turned into something bad. Facial recognition is a great example. Facebook tags people in photos without consent and this can be exploited by law enforcement. Furthermore, since facial recognition software is so inaccurate, it can misclassify a person as the wrong sex, the wrong person, or in extremely bad past cases, as an animal.
Furthermore, engineers have the responsibility to ensure our work is used to create more equity in the world. Benjamin offers a few different organizations that are working to ensure justice and equity for everyone. Maybe it’s time that software engineers/developers have a responsibility for this the same way a civil engineer must ensure a bridge is safe.
I recommend that anyone that works at a social media company read this. Anyone doing work for algorithms in banks, insurance, hiring, and housing really understand the fact that algorithms aren’t objective. They are as objective as our history. Our history hasn’t been objective nor equitable. We must change that.
View all my reviews