TikTok's Algorithmically Directed Me Towards Nazi-Related Products
When I started browsing TikTok Shop, a section of the popular social media platform where users can shop and buy products directly from their favorite creators, I was looking for "hip hop jewelry." The result was not what I expected.
The algorithm repeatedly suggested that I might also be interested in jewelry with blatant Nazi symbolism. Yes, you read that right - Nazis.
I started by searching for "swastika jewelry," which was an innocuous search query many users have likely typed in to find something to wear. However, when I tapped on the product results, TikTok highlighted searches on the next page that were even more explicitly inflammatory.
The web of Nazi-related terms seemed endless. The algorithm suggested I look up products related to "german ww2 necklace," a Star of David pendant, and even phrases like "double lightning bolt necklace" and "ss necklace."
But what was most striking about this experience was how subtle the product results were. Most of them didn't have any obvious Nazi symbolism. Instead, they had symbols that looked similar to swastikas but were less blatant.
A necklace in the product results even had S-like lightning bolts on top of each other, rather than the side-by-side arrangement seen in the "SS" insignia of the Schutzstaffel, a paramilitary group that operated in Germany and Nazi-occupied Europe during World War II.
It's hard to say exactly how this web of search terms originated. TikTok has general ideas about how its algorithms work but says that the exact details are opaque.
However, experts believe that the suggested search results could be either the algorithm "working as intended" or "some kind of manipulation" by nefarious users.
For now, it seems like TikTok still needs to do a lot more to protect its users from hate speech and Nazi symbolism in its online shop.
When I started browsing TikTok Shop, a section of the popular social media platform where users can shop and buy products directly from their favorite creators, I was looking for "hip hop jewelry." The result was not what I expected.
The algorithm repeatedly suggested that I might also be interested in jewelry with blatant Nazi symbolism. Yes, you read that right - Nazis.
I started by searching for "swastika jewelry," which was an innocuous search query many users have likely typed in to find something to wear. However, when I tapped on the product results, TikTok highlighted searches on the next page that were even more explicitly inflammatory.
The web of Nazi-related terms seemed endless. The algorithm suggested I look up products related to "german ww2 necklace," a Star of David pendant, and even phrases like "double lightning bolt necklace" and "ss necklace."
But what was most striking about this experience was how subtle the product results were. Most of them didn't have any obvious Nazi symbolism. Instead, they had symbols that looked similar to swastikas but were less blatant.
A necklace in the product results even had S-like lightning bolts on top of each other, rather than the side-by-side arrangement seen in the "SS" insignia of the Schutzstaffel, a paramilitary group that operated in Germany and Nazi-occupied Europe during World War II.
It's hard to say exactly how this web of search terms originated. TikTok has general ideas about how its algorithms work but says that the exact details are opaque.
However, experts believe that the suggested search results could be either the algorithm "working as intended" or "some kind of manipulation" by nefarious users.
For now, it seems like TikTok still needs to do a lot more to protect its users from hate speech and Nazi symbolism in its online shop.