WRONG!😱AI Stats are Wrong – Here is how to FIX IT! + Guy’s Trip Recap! – Ask Us ANYTHING❓ | Ep. 385

Jay Schwedelson: We are back for ask us anything from the Do This, not that Podcast presented by Marigold. This is our short episode. We're all week long. We get in questions, we get in Word questions, we get in super ridiculous questions. We try to tackle one. Each. And if you wanna submit a question, you would be actually cool.

Jay Schwedelson: You go to jay schon.com, there's a button that says podcast. Another one says, ask us anything. And that's it. We need your questions. So let's do the work. Question before the ridiculous question. We got a question in from Ben, from Seattle. Ben, what do you got? Jay, I got burned bad in a meeting. I sourced a stat I got from chat GPT in a presentation and someone called me out and said that was not true.

Jay Schwedelson: And guess what? They were right and I was wrong. Super embarrassing. Does that mean I cannot use stats from ai? So this is a great question 'cause this is something I had to go and do a lot of investigation on because. I'm sure all of us, we go on chat, GBT, and we go on other AI tools. Claude, whatever you use, I don't care.

Jay Schwedelson: And then we say, oh, we're working on this blog, we're working on a podcast, we're working on a webinar, working on a presentation, what doesn't matter, and you ask it for stats and information and whatever. And then you get back the information and it sounds super legit. It will actually say, you know, if you do this, it says 37% of people blah, blah, blah.

Jay Schwedelson: And it, and it, it's a stat. Okay? And sometimes, not only will they say the stat, the AI tool, and you ask it a question and it'll say, according to, you know, HubSpot, according to Salesforce, according to whoever. And they're like, oh, it said a stat. And it said, according to whoever. That means it's real. But then what I've realized, so, and I'll give you what I've found and what you should do about it, is that even when it gives you a stat, even when it says, and this is from whatever, a source, whatever.

Jay Schwedelson: Sometimes when I see the stat, I'm like, you know, that sounds ridiculous. Is that really true? And I'll ask Chachi PT again, is this stat that you just gave me actually true? And then a lot of times it'll say, actually, sorry, it's not true. And every time I want to take my computer and throw it against the wall, 'cause I'm like, well, why'd you give it to me in the first place?

Jay Schwedelson: So here's the wild part. And I asked Chad GPT, for example, and I said, I want to know the truth. What percentage of statistics that you give back when someone asks are actually not accurate? And by the way, I have a solve for this. What percentage of stats that you give back are actually not accurate? And what Chacha BT itself said 40 to 50% of stats shared by chat GB BT are not actually real stats.

Jay Schwedelson: Even if they say according to whomever. That is wild. So half the time when you're getting a stat from it, you need to actually further verify it. And so what you want to do is when you are asking for a stat, I don't care what it is, okay? It doesn't matter what it is, you need to use this prompt specifically.

Jay Schwedelson: Okay, I am gonna put it in the show notes and you say this, give me stats for whatever, right? Gimme stats for email marketing, open rates for HR laws that have been passed in the last two. I don't care. Okay, give me stats for whatever, but clearly label them as either sourced. And a hundred percent accurate or inferred and prioritize real stats with sources that you have verified when possible.

Jay Schwedelson: Okay? And when you do that, and you could even say for any stat you ever give me moving forward that you want your stats to be clearly labeled as sourced and fully verified. Versus inferred. 'cause about half of the stats they provide back are inferred. What Chacha P two and the A other AI tools are doing is they're taking all sorts of data that's out there and they're mushing it into one stat and they're spitting it back to you.

Jay Schwedelson: And they're saying it's a real stat, but when you dig into it, it's not. But when you ask Chacha Pier, any other AI tools to say, I want to know that this is sourced and verifiable and a hundred percent accurate. It then will only give you the information that is actually accurate. This is like really important.

Jay Schwedelson: 'cause if not just like Ben, you're gonna get kind of screwed on what it is that you're sharing out there. What is that you're putting out there? It is. It's, this is not like what they call hallucinations by ai. Hallucinations by AI is just completely made up stuff. That's not what this is. What this is, is them taking data from all over the planet.

Jay Schwedelson: And they're inferring a statistic, which is weird 'cause a statistic, uh, just because the nature of what it is should be accurate, but they're not. So you literally can't take a stat that just comes from ai unless you push back and say, I need to know this stat is a hundred percent accurate, it's verifiable, and what is this actual source?

Jay Schwedelson: All right. I know that's pretty wild, but, so that was a really good question because that, that this has messed me up so bad. All right. Let's get to the ridiculous portion of the podcast. We got a question from Jamie. What up, Jamie, where are you from? Oh, you're from Deerfield Beach. That's right near me.

Jay Schwedelson: Alright, Jamie, what's your question? Jay? You mentioned you went on your annual guys trip to Las Vegas, so how was it? Okay, this is true. So for any new listeners out there, I do, I go on an annual guys trip with my friends from college. My six friends from college will go every year. I strongly recommend everybody doing this.

Jay Schwedelson: And we just got back. And um, the way we do it is one person picks out of the hat. And whoever gets picked outta the hat's in charge for that year, planning the trip. And my buddy who, who loves gambling and all this nonsense, he picked Vegas. I could do without Vegas. No offense to Vegas. Vegas is a great city.

Jay Schwedelson: I'm just, I'm not a gambler. I don't, I don't, I don't, I don't like it that much. I'm, I'm horrendous at it, whatever. So, into Vegas, it was great. But speaking of gambling, actually about to go down a rabbit hole. So here's, here's what happened with the gambling. So none of my friends are like, you know, gambling lots of money or anything like that.

Jay Schwedelson: But so one of the, the first night we, no, the second night we were there, everyone's like, let's play blackjack. And I, I don't know how to play blackjack. I mean, I know you try to get to 21, you don't wanna go over 21. That's basically what I know. I've never played blackjack. I'm not a gambler. Which is fine if you are good for you.

Jay Schwedelson: I don't know. I'm just not. And so like everybody else, all the other six guys are like, no, no, no, we'll teach you whatever. So first we find the table with like the lowest dollar amount that you could play at a table. And I sit down next to some random dude, 'cause we couldn't get all the chairs and I didn't know what, I had no idea what I was doing.

Jay Schwedelson: And so they would give you the card and then I didn't know when to hit or not hit. So I would hit and apparently I was hitting at the wrong time. Because you're only supposed to hit a, when certain cards are there, not card. The guy next to me was getting annoyed. He's like, dude, you don't know what you're doing.

Jay Schwedelson: And so I got up, I, I, I was very uncomfortable. So then we found a table where all six of us could sit down together. We played and they were telling me what to do and I proceed. Everybody at the table proceeded to lose money. Not a lot of money, but, but money. Not one person won money. I said, this game stinks.

Jay Schwedelson: 'cause all you're doing is following some sort of pattern or whatever. It was horrendous. It wasn't fun. It was not, I don't, my friends are like, no, this is fun. I'm like, we just all lost money. This stinks. So then I said to them, listen. After dinner because we were going out to dinner, um, none of my friends knew how to play craps.

Jay Schwedelson: I said, I'm gonna teach you guys how to play craps. And again, I'm not a gambler, so why do I know how to play craps? Well, in college I did many, many, many stupid things. I mean, really epically stupid things. One of the stupid things that I did in college was that me and a buddy of mine built a craps table.

Jay Schwedelson: We had no idea what we were doing. We built a craps table and, uh, in his apartment. We were the house and we would've people come over and play crafts for money during college. I mean, talk about a stupid idea. We ended up doing really well with it. But what was I doing? Why was I not like studying? I don't know.

Jay Schwedelson: So I never gambled a lot, but I liked figuring out how to make some money. So in college we had a craft table, so I really knew how to play crafts, but I don't think I've played maybe one time since then, and maybe for like 50 bucks or something like that. So anyway, so after dinner, I go, let's go to the crop table.

Jay Schwedelson: Nobody knew how to play craps. They're like, this is gonna be terrible. This is gonna be boring, it's gonna be bad. So we go to the craps table and um, we're all there and there's a lot of people there, whatever. And my buddy is the one to roll. Uh, this is not normally how it goes down. So my buddy proceeded to roll.

Jay Schwedelson: The way craps works is if you roll for a long time without rolling a seven, then everyone can make a lot of money. The dude rolled for like 25 minutes. It was out of like a movie. Everybody at the table was making a ton of money. It was, we weren't betting a lot, but you just couldn't not make money. 'cause it was going on and on forever.

Jay Schwedelson: And everyone was like, this is the greatest game of all time, everyone. It was wild. I've, it was so crazy. I've never seen this before. Not that I'm there so much, but it went on for so long and my buddy made everybody so much money. I made that money 'cause I taught him how to play that. One of the dudes at the other end of the table.

Jay Schwedelson: Threw my buddy a hundred dollars chip. 'cause he said, you made me so much money, I wanna give you some money. And he gave him a hundred dollars. I was like, I've never seen that before. This is wild. So anyway, blackjack stinks. Craps was great. I really probably won't gamble again for years 'cause it's not my jam.

Jay Schwedelson: I don't like losing money. And that was fun. So Vegas was cool. Check the box. I need to get to the sphere. I still haven't gotten to the sphere. Everybody got to the sphere. So this is the update. This is what I got for you. And um. Yeah, do me a favor, um, register for Guru Conference, our free virtual email marketing event.

Jay Schwedelson: We're gonna have 25,000 people there. Uh, Nicole Kidman's keynoting. We just announced Lance Bass is gonna be there from nsync. It's gonna be wild. We're gonna run out of virtual seats, so go to guru conference.com and I will check you later.