--- title: "Worried About ChatGPT in Coding Interviews? Here's 3 Ways to Continue Running Great Interviews | CoderPad" description: "No need to fear these robot overlords." canonical: "https://coderpad.io/blog/interviewing/how-to-design-your-coding-interviews-to-outsmart-chatgpt/" last_modified: "2026-04-15 16:20:52" --- [Back to blog](https://coderpad.io/blog/) # Worried About ChatGPT in Coding Interviews? Here’s 3 Ways to Continue Running Great Interviews March 8, 2023 7 Minute Read By Ken Swearengen [Interviewing](https://coderpad.io/blog/interviewing/) Remember when you only had to worry about candidates copying and pasting code from StackOverflow? Now there’s a new robot kid on the block, and boy, is it making interviewers and technical recruiters nervous. [![Three panel comic. First a bartender is throwing a patron out of the bar, the patron is labelled "candidates using stackoverflow". in the second panel the bartender is labelled "interviewers". in the third panel, the patron is shown sneaking behind the bartender, and the patron is labelled "candidates using chatgpt".](https://coderpad.io/wp-content/uploads/2023/03/img_64089b1349add.png)](https://coderpad.io/wp-content/uploads/2023/03/img_64089b1349add.png) And rightfully so – it opens a whole new way for candidates to pull the wool over your eyes and fake skills they don’t have, meaning you’ll have a bunch of useless new hires that will cost you hundreds of thousands of dollars. Or not. Let me remind you of [this piece of wisdom I doled out in April of 2022](https://coderpad.io/blog/interviewing/the-1-best-anti-cheat-interview-question-ever/): We at CoderPad do not philosophically believe in “anti-cheat” tactics. That’s an arms race that only produces temporary winners – and it’s never good to start an interview coming from a place of distrust. “But unknown CoderPad blogger,” you say (my coworkers call me Ken, by the way), “That’s all well and good for you to say, but I’m the one staking my company’s reputation on the line with these phony candidates. Do you just expect me to ignore ChatGPT?” Of course not. First and foremost one of the best things you can do is to be clear with candidates of expectations and the consequences of using ChatGPT in an interview. There’s also a spectrum of interview designs to help you mitigate ChatGPT’s influence. On one end, you can embrace it and [create interview questions around its use](https://coderpad.io/blog/interviewing/how-to-embrace-chatgpt-in-technical-interviews/) to [letting candidates know it’s okay to use it](https://coderpad.io/blog/hiring-developers/chatgpt-and-the-future-of-technical-interviews-addressing-concerns-of-increased-cheating/) (like an open-book test). On the other end, you can work on creating questions that are ChatGPT-resistant. This blog post will focus on the latter – though I’d encourage you to consider the other two options. ## Get ‘em talkin Nothing puts a stop to using someone else’s solution than being asked to explain the logic behind it. It’s unusual for a candidate to skip straight to the most ideal answer. Humans think through complex problems on an evolutionary path, starting simple then abandoning all but the most ideal branch. Eventually the best candidates do arrive at the right answer, but you can see their methodical thought process. We’ve talked extensively about [the benefits of making your interviews a collaborative discussion](https://coderpad.io/blog/interviewing/3-interview-tips-for-software-engineer-hiring-managers/), but one of the lesser-known benefits these days is encouraging your candidates to explain the large chunk of pasted code you just saw pop up in your interview screen: Nothing fishy here…. Instead of waiting for the interview playback to notice their massive copypasta and terminating their candidacy because of perceived cheating, ask them about the code they copied and pasted. They may have a good reason – maybe they know it would be more efficient to use their time to outsource the trivial code to ChatGPT and focus instead on the lines that take more critical thinking. Or perhaps they knew the basic idea of what they wanted to code but needed a little help verifying the implementation – help like what they’d usually receive from a coworker. Or maybe they don’t have a good reason and lied about their coding skills. Whether or not their reasons (or lack thereof) are red flags is ultimately up to you. But you won’t know if the copy-paste you just witnessed is in good or bad faith until you get the candidate to open up about it. The more you talk with them and make the interview experience collaborative, the more comfortable the candidate will be and the more likely they’ll explain their thought process to you. You’ll learn more about their skill set by asking them how they think than just watching them code anyways. Or you can watch them squirm when [ChatGPT answers their question incorrectly](https://twitter.com/vogon/status/1598334517647134720). ## Create questions with nuance One of the things we’re learning about current iterations of AI-powered tools like ChatGPT is that it doesn’t do so well at understanding nuance or the technical intricacies of specific topics. Take this question about creating palindromes from date formats: > I was asking ChatGPT about palindrome dates for this century and found several algorithmic errors/bugs. Can you spot them? [pic.twitter.com/fCgIFu9PKE](https://t.co/fCgIFu9PKE) — Anthony Mooz (@AnthonyMooz) [February 24, 2023](https://twitter.com/AnthonyMooz/status/1628943556336312322?ref_src=twsrc%5Etfw) Despite 1) knowing what a palindrome is and 2) knowing that different countries use different date formats, ChatGPT struggles with combining those two topics. There’s also this date-time issue: > As I write this, the date is Feb 20th or Feb 21st, depending on where you are in the world. If I ask ChatGPT, it says the date is Feb 22nd. How does it get close at all and why the off-by-one bug? [pic.twitter.com/5minqv2tOd](https://t.co/5minqv2tOd) — Matt Mazur (@mhmazur) [February 20, 2023](https://twitter.com/mhmazur/status/1627766834022711304?ref_src=twsrc%5Etfw) Here, we can see that ChatGPT doesn’t quite understand timezones to give the user a correct answer when they ask for the date. ChatGPT will either give you a wrong answer (like above) or “beat around the bush” when faced with nuanced questions. Consider this conversation: [![question: "who is the greatest football player of all time?" chatgpt answer: "The answer to this question is highly subjective and can vary depending on personal opinions and preferences. However, many people consider the Brazilian forward, Pelé, to be the greatest football player of all time. Pelé won three FIFA World Cups with Brazil and scored a remarkable 1,281 goals during his professional career. He was known for his incredible skill, speed, and agility on the field and his ability to score goals in seemingly impossible situations. Other players such as Diego Maradona, Lionel Messi, and Cristiano Ronaldo are also often mentioned as some of the greatest football players in history. Ultimately, the debate over who is the greatest football player of all time is likely to continue for many years to come."](https://coderpad.io/wp-content/uploads/2023/03/img_64089b1586f33.png)](https://coderpad.io/wp-content/uploads/2023/03/img_64089b1586f33.png) First, notice that it doesn’t understand the cultural nuances of the word “football” – the sport refers to different things in the US, Australia, Ireland, and South Africa than it does in the rest of the world. Second, notice the “hedging” that ChatGPT partakes in: “The greatest football player of all time is a subject of much debate and is ultimately subjective.” “It is important to note that comparing players across different eras is difficult and often contentious, and opinions on the greatest football player of all time will vary depending on personal preferences and criteria for greatness.” Most humans have stronger opinions on that and more business-related questions. For example: - How does a candidate spend their time on a question that requires them to choose between priorities like quality, cost, and time? - How do your front-end candidates choose which design elements are they focusing on for a landing page? - And how do candidates justify these decisions? Consider also that being a software developer is rarely about writing snippets of code in isolation. There are bigger picture nuances that need to be taken into account, which is why adding in [multi-file questions](https://coderpad.io/resources/docs/interview/quick-start-guides/multi-file-frameworks-for-engineers/) to your interview can be beneficial. While ChatGPT can easily provide candidates with answers for generic algorithm questions that only require one file, having to create a multi-file answer to demonstrate engineering nuances is not only a more realistic interview exercise but one that would stump ChatGPT as well. ## Ask ChatGPT Going to get meta here and see what ChatGPT has to say about its controversial role as a cheat enabler. Here’s what it told me when I asked it, “How can I tell if the answer to an interview question came from ChatGPT?”: As an AI language model, I am designed to provide information and assistance to anyone who asks, and I cannot control who uses my responses. However, there are several ways you can try to determine if a candidate’s answer came from ChatGPT: 1. Listen for consistency: While it is possible for a candidate to provide a response that is similar to one generated by ChatGPT, it is unlikely that they will be able to replicate the exact wording and phrasing. Listen for consistency in their response, such as the use of similar vocabulary and grammar to their other answers. 2. Ask follow-up questions: To determine if a candidate’s response is genuine and original, ask follow-up questions that require them to elaborate or provide more detail. If their response is based solely on information from ChatGPT, they may struggle to provide additional information or context. 3. Check for understanding: Ask the candidate to explain the concept or idea in their own words. If their response is based solely on information from ChatGPT, they may struggle to explain it in their own words or may use the same phrasing and vocabulary as ChatGPT. 4. Use multiple assessment methods: To reduce the reliance on ChatGPT as a source of information, use multiple assessment methods to evaluate a candidate’s skills and abilities. This can help to provide a more comprehensive evaluation of the candidate’s abilities and reduce the reliance on ChatGPT as a source of information. Ultimately, it may be difficult to determine if a candidate’s answer came from ChatGPT, and it is important to keep in mind that candidates may use a variety of resources to prepare for an interview. The best approach is to focus on evaluating the candidate’s overall skills, abilities, and fit for the position. It looks like ChatGPT has been browsing the CoderPad blog for answers again. Or maybe I’m unknowingly training my replacement. Either way, ChatGPT has a long way to go before it becomes a concern for interviewers and recruiters who continuously improve their candidate experience. Talk with your candidates and give them real, thought-provoking business cases to solve, and you’ll have little to worry about. ## Subscribe for more CoderPad insights ## Trending Articles Previous slide Next slide [Interviewing ## 5 Skills of the Future Developer: A Framework for Evaluating AI Fluency According to CoderPad’s State of Tech Hiring 2026 report, 82% of developers now find GenAI useful — up from 76% just a year ago. More telling: 54% of developers would experience a measurable productivity drop if AI tools were removed tomorrow. AI isn’t a productivity booster anymore. It’s infrastructure. With this shift, it’s no surprise […] Read the post](https://coderpad.io/blog/interviewing/5-skills-of-the-future-developer-a-framework-for-evaluating-ai-fluency/) [Hiring Developers ## Q&A: Musings of a CEO on Tech Interviews, Cheating and AI In this Q&A session on cheating and AI in tech interviews, Amanda Richardson emphasizes the importance of trust and effective interview design. Read the post](https://coderpad.io/blog/interviewing/qa-musings-of-a-ceo-on-tech-interviews-cheating-and-ai/) [Engineering Management ## How To Use CoderPad To Interview Software Architects Software architects are the masterminds behind the design and structure of software systems, ensuring that projects are scalable, maintainable, and aligned with business goals. Unlike more hands-on engineering and development roles, assessing architect skills in an interview relies much less on watching them code and more on their ability to drive software design principles and […] Read the post](https://coderpad.io/blog/interviewing/how-to-use-coderpad-to-interview-software-architects/) [Hiring Developers ## “Don’t Expect Candidates to Have Everything Memorized”, the Dos and Don’ts of Cheating Prevention With Nathan Sutter Sure, you want to prevent cheating. But you also want to feel good about your hiring process. So how do you do that? Read the post](https://coderpad.io/blog/hiring-developers/dos-and-donts-cheating-prevention-nathan-sutter/) [Interviewing ## Crafting Effective Technical Interview Questions: A 4-Step Guide Writing great technical interview questions can be hard. We're here to help. Read the post](https://coderpad.io/blog/interviewing/crafting-effective-technical-interview-questions-a-4-step-guide/) [Interviewing ## Viral TikTok Layoff Videos: What You Need to Know So, you’ve heard about these viral TikTok layoff videos, but you’re unsure how concerned you should be? Read about what you can learn from this content, and how it should impact your company’s HR practices. Read the post](https://coderpad.io/blog/interviewing/viral-tiktok-layoff-videos-what-you-need-to-know/) [Interviewing ## 8 Steps Recruiters Can Take to Instill Inclusivity in Tech Interviews As TA professionals, you have the power to create an inclusive interview environment for your interviewers and interviewees. Want to know how? This guide will help you. Read the post](https://coderpad.io/blog/interviewing/inclustive-technical-interview-guide/) [Engineering Management ## These 9 Red Flags Are Scaring Away Candidates During Interviews Don't let your name be dragged into a bad Glassdoor review. Read the post](https://coderpad.io/blog/engineering-management/these-9-red-flags-are-scaring-away-candidates-during-interviews/) [Interviewing ## Best Platforms for Remote Interviews Discover how the modern employment landscape is embracing remote work and virtual interviews. Dive into the capabilities of platforms like Zoom, Skype, Microsoft Teams, and Google Meets for general use, and explore specialized options like HireVue, Codility, and CoderPad for technical hiring. Read the post](https://coderpad.io/blog/interviewing/best-platforms-for-remote-interviews/) [Interviewing ## Why One-Way Video Interviews Don’t Work and What You Should Do Instead Read about why one-way interviews are less promising than they seem and explore alternative methods that offer a fairer, more realistic approach to hiring. Read the post](https://coderpad.io/blog/interviewing/why-one-way-video-interviews-dont-work-and-what-you-should-do-instead/) [Interviewing ## 2 Interview Questions to Assess Your Next Intermediate Backend Engineer Looking for guidance in evaluating your intermediate backend developers? We've got the perfect solution with these two insightful questions. Read the post](https://coderpad.io/blog/interviewing/2-interview-questions-to-assess-your-next-intermediate-backend-engineer/) [Interviewing ## 3 Tips To Introduce ChatGPT Into Your Technical Interviews Integrating ChatGPT into technical interviews involves setting clear expectations, demonstrating its practical use, and acknowledging its limitations, creating a fair and realistic assessment environment that aligns with the evolving landscape of software development Read the post](https://coderpad.io/blog/interviewing/3-tips-to-introduce-chatgpt-into-your-technical-interviews/) ## Hire with confidence. See why engineering teams trust CoderPad to evaluate developers with realistic, AI-ready hiring workflows. [Request a demo](https://coderpad.io/sales/)