What makes you trust a chatbot?

Or better yet, should we trust chatbots?

Should we build relationships with AI bots?

Should our children?

Two recent podcasts explored issues of trust and relationships with chatbots and robots.

There’s.so.much.to.say.on.this. I’m writing up a storm elsewhere this week so I’m just parking them here for the curious. You should listen and then get your friends together for a podcast dinner to discuss it. Because it’s a wild topic sure to make for engaging conversation.

Science Friday – A Bot You Can Trust

Radiolab – More or Less Human

Interview with a chatbot part 2

These past weeks I’ve been deep into the #HRTech world, tweeting frequently into the void, trying to learn more about increasingly opaque data used in smart HR platforms. Throughout the process I’m documenting the variety of hiring technology on the market, from smart platforms to machine learning for automated resume screening to virtual assistants. Along the way I’ve stumbled on loads of chatbots trying to claim a place for themselves in the hiring process. I’ve got a bit of a crush on chatbot technology so I’ve been trying them out. Two weeks ago I pined for Mya but settled on an interview using TalkPush. Today I found Paradox.ai and gave it a go.

Once again, the intro starts easily enough:

Then I was immediately asked contact details. Mind you, I’m just browsing here, not actually ready to apply. I don’t know if it’s me or what but I’m a bit irritated each time I’m asked for contact details right away (side note: I signed away my LinkedIn data for Wade&Wendy access only to be told post-data exchange that I’m on a waitlist, so maybe I’m just tired of having to give up data to engage). But this is all pretend anyway, so I gave them my phone number and then we moved on to my interests.

I thought here that we might talk about what positions are available but the onus was put on me to define what I want. I actually wasn’t sure what to answer. I like that it’s framed that way but wonder how other job seekers perform when asked this question. Admittedly it caught me off guard and I wasn’t sure what to write. I had to think about it which then sent me down a mini-spiral wondering if they evaluated me on how long it took for me to answer.

Moving along:

This is where it got interesting. They’ll find my profile (and I wonder if they’ll find my other social profiles) for me, so I don’t have to submit anything.

I think there was a hiccup when I shared my non-existent most recent role as the interview ended abruptly. I can’t tell if it’s because a. it’s a bot. b. I’m not a fit. or c. this wasn’t an interview.

Then onto the questions from me. The Q&A started a bit rocky but got better:

So throughout this whole process I wondered: how do you know the difference between a bot that helps you explore job opportunities and one that evaluates you? I misunderstood this bot from the beginning.

I went into it thinking the bot was helping me explore options at the company. But it quickly moves into interview territory by asking my experience level. Then it forces me to automatically apply to the position(s?) we discussed as they pull my LinkedIn profile. What if I hadn’t updated my LinkedIn?

Also, what if I’ve already provided my real name and contact, but wasn’t prepared to discuss my experience, what do I do? If I abandon the convo, and return, how does that affect my evaluation? Am I more desirable because I’m returning? Or am I penalized because I couldn’t answer the prior questions?

I’m so curious what happens on the backend when a recruiter receives the data.

While this experience is certainly efficient it’s hard to get a feel for company culture during these interactions. I was generally curious about the companies that they partner with but didn’t get traction there. Asking about the workplace and getting a canned response about “best talent” and “superstars” doesn’t offer much. If Olivia instead shared a video from the team, or a blog post about a day in the life of a marketer at Paradox, or even a personalized message from the founder that wasn’t full of “superstar” startup speak, it’d instantly provide more value. It’d at least add a personal touch.

Interacting with bots has me wondering how we define candidate engagement within the context of chatbots. Olivia engaged with me but she wasn’t engaging (though she was definitely better than previous bots I’ve engaged with). When the novelty of interacting with recruiting bots wears off (it’s still so very new), I wonder how candidates will view the experience.  If there’s a war for talent, how do you expect someone to chose your company if you can’t show off goods? Do bots play a role in wooing candidates? Or are they just there to expedite the hiring process for HR?

And if candidates are expected to show their soft skills, how do employers expect to identify them when the majority of HR tech aims to take humans out of the selection process?

Interviewing with a chatbot

I’m pretty obsessed with HR tech. Right now I’m examining HR chatbots. Chatbots are becoming ridiculously popular in HR because they save recruiters valuable time. Candidates are comfortable with them too. SHRM reported that 57% of survey respondents confirmed they were fairly or extremely comfortable interacting with AI bots in the recruiting process. In an ideal world the chatbots deliver a premium candidate experience, giving everyone the opportunity to engage with the company.

I’ve been trying to get a look at Mya, the chatbot that interviews you, analyzes and scores your responses, and does the heavy lifting for recruiters. I really really really want that damn bot to interview me in part because I have a crush on its conversational design technology and because I secretly want to be a part time conversation designer.

Natural language processing Mya

But I can’t get Mya to interview me yet as I’m not exactly qualified for their jobs, so no bot access.

Luckily I stumbled on a chatbot for TalkPush, which is a HR chatbot company that makes it easier for recruiters to source. Here’s their pitch:

TalkPush is the first conversation-driven Candidate Relationship Management (CRM) system. On Talkpush, recruiters spend more time talking to qualified candidates, which translates into a better candidate experience and huge reductions in cost-per-hire and time-to-fill”

TalkPush has received about $1 million in funding. Compared to Mya, which has received $34 million and on its Series B funding, TalkPush hasn’t gotten much of that sweet 2 billion dollar plus HR tech funding pie.

Regardless I’m on a mission to try out hiring chatbots and TalkPush made it easy. You can access their recruitment bot from the homepage but you’ll be required to give access to your FB page, an offputting ask since we literally just met (what are you doing with that data?).

However their jobs page gives you access to their bot without having to give over your FB access.

The interaction starts simply enough.

HRChatbotinteraction

HRChatbotInteraction

I was a bit put off by the questions about contact info before I even got to see the jobs. Then again I’d submit this info on a resume, so I suppose it evens out in the end.

There were also a few typos in the exchanges. I thought it reflected poorly on the company since in the US, typos result in the immediate death of your candidacy for employment. Then I found out the company is based in Hong Kong and China, so the conversation is likely written by a non-native speaker. Makes sense now (I see an opp for some talented bilingual interns!)

But then the experience gets a bit lame.

HRChatbotexample

This wasn’t so much a conversation as it is a display of information. After I asked what a (Demo) Job Position is, I got nothing. Radio silence. So I checked in.

HRChatbot5

Aaaaand it seemed like we were back at the beginning. This reminded me of the awkward experience I had with IBM Watson’s chatbot. So I typed in an alternative job. Then we were back on track. Interestingly I was supposed to tell them about my relevant work experience. I wondered what they meant by that. Should I write paragraphs? Is this the place for a short, two-sentence summary of my qualifications, similar to what I’d write in a cover letter intro or say to a recruiter on the phone? Should it be a list of companies? Positions? Software? Skills? Am I being evaluated on the time it takes to answer questions, similar to video interviews? I had no idea. So I just added some fuckery to advance the convo and see the other questions.

HRChatbot hiring future of work

HRchatbot example

As you can see I wasn’t a good candidate. But the questions were interesting reminded me of an initial phone interview.

The flow and expectations in this exchange are a bit problematic though. As a job seeker, I may not have samples of my work or a summary of my work experience on hand during the chat interview. Since I had to put in my contact information before I saw the jobs, it’d be hard to take a break, go get that information, and return to the bot to continue the conversation. Usually a candidate takes a look at a job, builds the required documents based on the job, then returns to submit. This experience was like an application and phone interview in one.

Also the inability to engage at times makes me wonder what candidates should do when a bot fails. Any interaction with an employer should be considered evaluative. This leads to questions about best practices for candidate behavior. What should a candidate do if they’re stuck engaging with a bot? If the chatbot fails, what are the next steps for the candidates? If the chatbot misunderstands their information or can’t answer a question, does the candidates get bumped to a human? Can a candidate press 0 or some magical combo to get a live human?

If I were advising a candidate, I’d tell them to take screen shots and contact a recruiter directly with questions. It’d work in the candidate’s favor maybe. It could show that the candidate is a proactive, problem solving candidate. And it’d (hopefully) help the team improve their bot.

So for all job seekers out there: brush up on your professional written communication skills. You’re going to need them beyond writing cover letters to get past the bots.