Yes for sure. I like asking candidates to pull up their favorite LLM and show me how they’d use it to do market research, using a real but irrelevant example like “suppose we’re looking at opening a design office in Belgrade, to get 24 hour coverage. How would you use an LLM to research this? Pull up your favorite and show me.”
I honestly think “oh I don’t use LLMs for anything” is disqualifying. I’ve had a couple of people say that. I would be open to “you know I’ve tried it and it never produced good results, let me show you how I’d use Google and …” but have never heard that.
And of the people who are game, I’ve seen a wide variety, including screen shares that include the STT of our conversation to date and suggested replies. And some genuinely smart, high-leverage AI use that’s impressed me.
I believe the statement "I don't use LLM for anything" should not be disqualifying. Many companies frown upon use of AI because of fear of hallucination, so not everyone is open about it in all settings.
I honestly think “oh I don’t use LLMs for anything” is disqualifying. I’ve had a couple of people say that. I would be open to “you know I’ve tried it and it never produced good results, let me show you how I’d use Google and …” but have never heard that.
And of the people who are game, I’ve seen a wide variety, including screen shares that include the STT of our conversation to date and suggested replies. And some genuinely smart, high-leverage AI use that’s impressed me.