In a recent interview with CivilNet, Sabrina Palme, CEO and co-founder of Palqee Technologies, shared her fascinating opinion on AI ethics, data governance and the challenges of regulatory compliance in the rapidly evolving tech landscape.
Palme, recognized as one of the 100 brilliant women in AI ethics in 2024, stressed the importance of responsible data use in AI development. She explained: “AI today is trained on the data that reflects our society today and our belief in our own bias. It’s in our nature as humans to be biased and so the data that is used to train the AI by default is biased as well.”
This inherent bias can lead to serious consequences. Palme cited real-world examples.
“There were actually some use cases in the US where they’ve developed an AI system that uses facial recognition technology and on some occasions it wrongfully identified someone as a criminal based on their skin color,” she said.
The potential for bias extends to other sectors as well.
“HR is actually one of the sectors that is already quite heavily implementing AI systems to speed up the recruitment process,” Palme said, adding that these systems can show “Tendencies of bias towards migrants” or even disadvantage non-native English speakers in CV rankings.
Addressing these challenges requires a multifaceted approach. Palme stressed: “It’s very important especially in these sorts of industries, I mean healthcare, including finance, that we develop AI systems that are fair and that makes sure we are not putting certain people and individuals at a disadvantage.”
Regulatory frameworks like the EU’s AI Act are emerging to guide responsible AI development. However, Palme cautioned that compliance could be challenging, particularly for smaller companies: “A lot of businesses will struggle because especially startups and SMEs who don’t necessarily have the capacity to hire someone full-time who has the expertise and understands regulation.”
Despite these challenges, Palme remains optimistic about AI’s potential when developed responsibly. Her work at Palqee Technologies focuses on creating tools to help businesses navigate the complex regulatory landscape and ensure their AI systems are trustworthy and ethical.
Featured image: Credit: CivilNet
