Placeholder Content Image

AI recruitment tools are “automated pseudoscience” says Cambridge researchers

<p>AI is set to bring in a whole new world in a huge range of industries. Everything from art to medicine is being overhauled by machine learning.</p> <p>But researchers from the University of Cambridge have published a paper in <a href="https://link.springer.com/journal/13347" target="_blank" rel="noopener"><em>Philosophy &amp; Technology</em></a> to call out AI used to recruit people for jobs and boost workplace diversity – going so far as to call them an “automated pseudoscience”.</p> <p>“We are concerned that some vendors are wrapping ‘snake oil’ products in a shiny package and selling them to unsuspecting customers,” said co-author Dr Eleanor Drage, a researcher in AI ethics.</p> <p>“By claiming that racism, sexism and other forms of discrimination can be stripped away from the hiring process using artificial intelligence, these companies reduce race and gender down to insignificant data points, rather than systems of power that shape how we move through the world.”</p> <p>Recent years have seen the emergence of AI tools marketed as an answer to lack of diversity in the workforce. This can be anything from use of chatbots and resume scrapers, to line up prospective candidates, through to analysis software for video interviews.</p> <p>Those behind the technology claim it cancels out human biases against gender and ethnicity during recruitment, instead using algorithms that read vocabulary, speech patterns, and even facial micro-expressions, to assess huge pools of job applicants for the right personality type and ‘culture fit’.</p> <p>But AI isn’t very good at removing human biases. To train a machine-learning algorithm, you have to first put in lots and lots of past data. In the past for example, AI tools have discounted women all together in fields where more men were traditionally hired. <a href="https://www.theguardian.com/technology/2018/oct/10/amazon-hiring-ai-gender-bias-recruiting-engine" target="_blank" rel="noopener">In a system created by Amazon</a>, resumes were discounted if they included the word ‘women’s’ – like in a “women’s debating team” and downgraded graduates of two all-women colleges. Similar problems occur with race.</p> <div class="newsletter-box"> <div id="wpcf7-f6-p218666-o1" class="wpcf7" dir="ltr" lang="en-US" role="form"> <form class="wpcf7-form mailchimp-ext-0.5.62 resetting spai-bg-prepared" action="/technology/ai-recruitment-tools-diversity-cambridge-automated-pseudoscience/#wpcf7-f6-p218666-o1" method="post" novalidate="novalidate" data-status="resetting"> <p style="display: none !important;"><span class="wpcf7-form-control-wrap referer-page"><input class="wpcf7-form-control wpcf7-text referer-page" name="referer-page" type="hidden" value="https://cosmosmagazine.com/technology/" data-value="https://cosmosmagazine.com/technology/" aria-invalid="false" /></span></p> <p><!-- Chimpmail extension by Renzo Johnson --></form> </div> </div> <p>The Cambridge researchers suggest that even if you remove ‘gender’ or ‘race’ as distinct categories, the use of AI may ultimately increase uniformity in the workforce. This is because the technology is calibrated to search for the employer’s fantasy ‘ideal candidate’, which is likely based on demographically exclusive past results.</p> <p>The researchers actually went a step further, and worked with a team of Cambridge computer science undergraduates, to build an AI tool modelled on the technology. You can check it out <a href="https://personal-ambiguator-frontend.vercel.app/" target="_blank" rel="noopener">here</a>.</p> <p>The tool demonstrates how arbitrary changes in facial expression, clothing, lighting and background can give radically different personality readings – and so could make the difference between rejection and progression.</p> <p>“While companies may not be acting in bad faith, there is little accountability for how these products are built or tested,” said Drage.</p> <p>“As such, this technology, and the way it is marketed, could end up as dangerous sources of misinformation about how recruitment can be ‘de-biased’ and made fairer.”</p> <p>The researchers suggest that these programs are a dangerous example of ‘technosolutionism’: turning to technology to provide quick fixes for deep-rooted discrimination issues that require investment and changes to company culture.</p> <p>“Industry practitioners developing hiring AI technologies must shift from trying to correct individualized instances of ’bias’ to considering the broader inequalities that shape recruitment processes,” <a href="https://link.springer.com/article/10.1007/s13347-022-00543-1" target="_blank" rel="noopener">the team write in their paper.</a></p> <p>“This requires abandoning the ‘veneer of objectivity’ that is grafted onto AI systems, so that technologists can better understand their implication — and that of the corporations within which they work — in the hiring process.”</p> <p><!-- Start of tracking content syndication. Please do not remove this section as it allows us to keep track of republished articles --></p> <p><img id="cosmos-post-tracker" style="opacity: 0; height: 1px!important; width: 1px!important; border: 0!important; position: absolute!important; z-index: -1!important;" src="https://syndication.cosmosmagazine.com/?id=218666&amp;title=AI+recruitment+tools+are+%E2%80%9Cautomated+pseudoscience%E2%80%9D+says+Cambridge+researchers" width="1" height="1" /></p> <p><em>Written by Jacinta Bowler. Republished with permission of <a href="https://cosmosmagazine.com/technology/ai-recruitment-tools-diversity-cambridge-automated-pseudoscience/" target="_blank" rel="noopener">Cosmos Magazine</a>.</em></p> <p><em>Image: Cambridge University</em></p>

Technology

Placeholder Content Image

Can mental healthcare be automated?

<p>Depression is predicted to become the <a rel="noreferrer noopener" href="https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.0030442" target="_blank">leading global cause of loss of life years</a> due to illness by 2030, yet <a rel="noreferrer noopener" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5288082/" target="_blank">fewer than one in five people</a> who suffer depression receive appropriate care. And there are <a rel="noreferrer noopener" href="https://www.thelancet.com/journals/lancet/article/PIIS0140-6736(21)02143-7/fulltext" target="_blank">worrisome signs</a> the COVID-19 pandemic is exacerbating triggers of the disease.</p> <p>As the burden of disease rises around the world, mental healthcare systems, <a rel="noreferrer noopener" href="https://www.who.int/news/item/08-10-2021-who-report-highlights-global-shortfall-in-investment-in-mental-health" target="_blank">many of which are already patently inadequate</a>, will be stretched thin.</p> <p>That’s why many experts are turning to digital interventions to help manage surging demand, packaging up psychotherapeutic treatments into computer programs and apps that can be used at home. But how effective are digital interventions? And will people accept therapy without a human face?</p> <p>These are the questions an international team of researchers from Finland, Germany, the Netherlands and Italy sought to answer through a systematic review and meta-analysis <a rel="noreferrer noopener" href="https://doi.org/10.1037/bul0000334" target="_blank">published today</a> in <em>Psychological Bulletin.</em> The team analysed 83 studies published between 1990 and 2020, reporting on 15,530 individuals, making it the largest and most comprehensive analysis of digital mental healthcare to date.</p> <p>The findings, while mixed, are promising.</p> <p><strong>Software alone not enough</strong></p> <p>The data suggests that digital interventions <em>are </em>effective in the treatment of depression, but the best results come when a digital program is augmented by support from an actual human. That’s when digital therapy can actually rival the effectiveness of face-to-face therapy.</p> <p>“Digital interventions could provide a viable, evidence-based method of meeting the growing demand for mental healthcare, especially where people are unable to access face-to-face therapy due to long waiting lists, financial constraints or other barriers,” says Isaac Moshe, lead author of the study and a PhD researcher at the University of Helsinki. But, he notes, “software alone just isn’t enough for many people, especially individuals who suffer from moderate or more severe symptoms.”</p> <p>Interestingly, the researchers found that while a level of human support behind a digital program was important, there was no marked difference in outcomes whether that support was provided by a highly experienced clinician or someone with less experience, such as a student or trainee. Moshe says that means digital programs could be scaled up by relying on less experienced practitioners, and offer a powerful solution to a growing problem.</p> <p>Even with the assistance of a clinician, however, there are barriers to the uptake of digital healthcare.</p> <p>According to <a rel="noreferrer noopener" href="https://www.pharmaceutical-technology.com/news/cost-security-concerns-and-lack-of-integration-into-existing-workflow-the-main-barriers-to-the-adoption-of-digital-health-tools-poll/" target="_blank">one industry-based poll</a>, major barriers include cost, security concerns and a lack of digital savviness among patients. Another major therapeutic concern is the idea that spending time working face-to-face with a human builds trust and a sense of alliance. This is <a rel="noreferrer noopener" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7016304/" target="_blank">particularly true</a> among older generations.</p> <p>Digital healthcare is also generally only appropriate for those who can afford the means to access it through a mobile phone or computer. That means it’s inaccessible for many people living in poverty or in remote communities.</p> <p><strong>AI has a role to play</strong></p> <p>The researchers also say artificial intelligence may have a role to play, principally in flagging risk factors for mental health, as well as helping clinicians develop tailor-made interventions.</p> <p>“Over three billion people now own a smartphone and wearable devices are growing in popularity,” explains Lasse Sander from the University of Freiburg, who led the research team. “These devices produce a continuous stream of data related to a person’s behaviour and physiology. With new developments in artificial intelligence and machine learning, we now have promising methods of using this data to identify if someone is at risk of developing a mental illness.”</p> <p>Moshe cautions that the results are focused on moderate depression, and that digital interventions may not be sufficient to cater to severe cases.</p> <p>“There are very few studies involving people with severe depression or individuals at risk of suicide, leaving the evidence unclear for the role of digital interventions for the treatment of severe and complex depression,” he says.</p> <p><!-- Start of tracking content syndication. Please do not remove this section as it allows us to keep track of republished articles --></p> <p><img id="cosmos-post-tracker" style="opacity: 0; height: 1px!important; width: 1px!important; border: 0!important; position: absolute!important; z-index: -1!important;" src="https://syndication.cosmosmagazine.com/?id=176089&amp;title=Can+mental+healthcare+be+automated%3F" alt="" width="1" height="1" /></p> <p><!-- End of tracking content syndication --></p> <div id="contributors"> <p><em><a rel="noopener" href="https://cosmosmagazine.com/health/body-and-mind/can-digital-mental-healthcare-be-automated/" target="_blank">This article</a> was originally published on <a rel="noopener" href="https://cosmosmagazine.com" target="_blank">Cosmos Magazine</a> and was written by <a rel="noopener" href="https://cosmosmagazine.com/contributor/amalyah-hart" target="_blank">Amalyah Hart</a>. Amalyah Hart is a science journalist based in Melbourne.</em></p> <p><em>Image: Getty Images</em></p> </div>

Mind

Placeholder Content Image

One in ten Australian jobs at risk of automation

<p><span style="font-weight: 400;">As the Australian economy begins its recovery efforts in tandem with the coronavirus pandemic slowing, a worrying statistic has been released about Aussie jobs. </span></p> <p><span style="font-weight: 400;">The study, which was conducted by the Organisation for Economic Cooperation and Development (OECD), warns that one in every 10 jobs is at risk of being automated. </span></p> <p><span style="font-weight: 400;">The research concluded that the employment disruption will be felt unevenly across Australia, as cities and regional towns will be hit the hardest. </span></p> <p><span style="font-weight: 400;">In comparison, wealthier and affluent urban areas face the least risk of jobs being automated.</span></p> <p><span style="font-weight: 400;">The OECD believe that plant and machinery operators, as well as food preparation workers are among the employment sectors most at risk. </span></p> <p><span style="font-weight: 400;">The report also says the demographics that will be hit hardest are young people, men and Indigenous people, as they are more likely to have declining job opportunities. </span></p> <p><span style="font-weight: 400;">The regional towns where automation is said to hit have roots in the coal mining industries, as 40 percent of jobs in the New South Wales Hunter Region face some disruption while in Queensland's Mackay region it was about 41 per cent.</span></p> <p><span style="font-weight: 400;">In comparison, Canberra and Sydney's eastern suburbs face the lowest risk of jobs lost through automation.</span></p> <p><span style="font-weight: 400;">Teaching and health services are likely to remain safe from automation technology, as the pandemic saw a drastic increase in jobs in these areas over the last 12 months. </span></p> <p><span style="font-weight: 400;">In order to protect existing jobs, the OECD says some workers will have their duties upskilled in order to save as many jobs as possible from the mundane tasks that automation can be utilised for. </span></p> <p><em><span style="font-weight: 400;">Image credits: Shutterstock</span></em></p>

Technology

Placeholder Content Image

Centrelink urged to cease controversial automated debt recovery scheme

<p>The final report has been handed down by the Senate inquiry into Centrelink’s controversial automated debt recovery program, and the findings are damning. The committee is strongly urging the government put a halt to the highly criticised and “broken” scheme until its “fundamental lack of procedural fairness” was dealt with.</p> <p>Despite the 21 recommendations handed down, Human Services Minister Alan Tudge disagrees entirely. “This is a politically motivated and factually inaccurate report, reflecting the fact that Labor and the Greens don't support auditing of the welfare system,” he told AAP.</p> <p>Tudge referred back to a previous ombudsman review of the so-called “robo-debt” scheme, which described it as a reasonable and accurate way to recover welfare debt.</p> <p>The Greens, however, stand by the new report. “Enough people have been hurt by this program which was designed to get money back quickly regardless of the impacts and whether it is legitimate debt,” senator and committee chair Rachel Siewart <a href="http://www.news.com.au/national/breaking-news/centrelink-urged-to-pause-robodebt-scheme/news-story/6fea74a7920d163dbfd53ba81db5d2fc" target="_blank"><strong><span style="text-decoration: underline;">argued</span></strong></a>. “Urgent action needs to be taken by the government before more harm is done.”</p> <p>Some within the Liberal Party disagree with Tudge’s criticism of the findings, with Liberal senator Jonathon Duniam telling parliament more could be done to improve the system. “I don't think anyone comes to this issue thinking that everything was done perfectly and everything was done right.”</p> <p>Over the past year, over 200,000 people have been targeted by the robo-debt program, with at least one in five of the debt notices issued found to be unwarranted.</p> <p>Have you been affected by the Centrelink scandal? Tell us how it impacted you in the comments below.</p>

Money & Banking

Placeholder Content Image

Airport check-ins to become automated

<p><span>A survey of major airlines has suggested that checking in at an airport is set to become an increasingly automated process. </span>The research, published by air technology firm SITA in their <span style="text-decoration: underline;"><strong><a href="https://www.sita.aero/resources/type/surveys-reports/the-future-is-connected" target="_blank">The Future is Connected</a></strong></span> report, suggests that by 2018 three in every five passengers will use their mobile phones for self-service check-ins.</p> <p>The report also suggests that by 2018:</p> <ul> <li>90 per cent of airports will have automatic bag drops.</li> <li>Four in five airlines will have passport scanners.</li> <li>Self-boarding gates will be available at more than half of all airports.</li> </ul> <p>Nigel Pickford of SITA told <em>Lonely Planet</em>: “The air transport industry has already embraced self-service and now it is turning to the ‘Internet of Things’ to deliver a more connected experience to travellers."</p> <p>"Half of airlines expect to have Internet of Things initiatives up and running over the next three years; meanwhile airports are building out the infrastructure to support [it].”</p> <p>To see the full report, <strong><a href="https://www.sita.aero/resources/type/surveys-reports/the-future-is-connected" target="_blank"><span style="text-decoration: underline;">click here</span></a></strong>. </p> <p><strong>Related links:</strong></p> <p><span style="text-decoration: underline;"><em><strong><a href="http://www.oversixty.co.nz/travel/travel-tips/2016/02/tips-for-handling-flight-delays/">5 tips for dealing with flight delays</a></strong></em></span></p> <p><span style="text-decoration: underline;"><em><strong><a href="http://www.oversixty.co.nz/travel/travel-tips/2016/02/photo-shows-german-shepherd-enjoying-flight/">German Shepherd really enjoys plane ride</a></strong></em></span></p> <p><span style="text-decoration: underline;"><em><strong><a href="http://www.oversixty.co.nz/travel/travel-tips/2016/02/tips-for-travelling-with-people-that-get-on-your-nerves/">Tips for travelling with people that get on your nerves</a></strong></em></span></p>

International Travel

Our Partners