Security quotes of the week

Again, discernment is everything when it comes to getting useful work out of a chatbot. If you don't know anything about my work and you ask a chatbot to explain it to you, you will likely be badly misled. If you are familiar with my work and you ask a chatbot for the best examples where I explain a given subject, you may get a good answer, and if you get a bad one, you'll know it.

As a researcher I've also been spending a lot of time with models, talking through various ideas. I don't think I will surprise anyone when I say that they're obviously getting better, even over the course of the past few months. While I don't have Mythos and $100k to spend, I have been able to query at least one new advanced unreleased model, and I also have received some surprising new "results" to questions that I've been interested in for a few years.

Which brings me to the real problem: just because a model spits out an apparent new result, this does not mean the result is real. Even if models are good at producing real results, they're much better at producing results that look real but are misleading. This can be enormously frustrating, and often means that human attention is more necessary than ever.