Episode Categories:
Resources:
Join the discussion: Ask Jordan questions on AI search
Upcoming Episodes: Check out the upcoming Everyday AI Livestream lineup
Connect with Jordan Wilson: LinkedIn Profile
Try Our Free AI Prompting Course: Register for our free Prime, Prompt, and Polish AI Course!
The Battle of AI Search Engines: A Comparative Analysis
AI search engines are revolutionizing content discovery on the internet. From daily weather updates to accessing structured financial data, these tools complement our digital interactions, making them quick, streamlined, and smarter. This article explores the accuracy and effectiveness of various AI tools in a live head-to-head test scenario.
Comparing Top AI Tools
Our test incorporated top-of-the-line AI tools - ChatGPT, Perplexity, Gemini, Microsoft Copilot, Grok, and Meta AI. These models were evaluated based on the accuracy of their search results using simple search queries, starting with sports-related information.
The models performed almost equally well except Perplexity, which provided outdated information. The pertinent highlight was the visual superiority of OpenAI's ChatGPT, delivering graphic representations of search responses, providing added clarity to the users.
AI's Vital Role in Stock Market Analysis
ChatGPT stood out with its capability to produce interactive graphs while looking up up-to-the-minute financial data. This is a game-changer for corporate decision-makers who require real-time financial information. The head-to-head testing illustrated the efficacy of these AI tools in navigating complex financial databases and extracting accurate insights.
Embracing AI for Business Growth
Microsoft's advent in the AI space with their WorkLab podcast highlights the potential of AI adoption for business organizations. Generative search experiences powered by AI presents a new paradigm for businesses to leverage AI in enhancing their operational efficiency.
AI's Evolving Dominance in Search
The significance of AI in search engines is growing exponentially, impacting our device usage. Google's integration with AI through its language model, Gemini, has been a transformative step in redefining user experience. AI's seamless blend with search functionalities enhances user engagement and optimizes web interactions.
The Competitive Landscape of AI Search Solutions
The tech giants' battle for AI search solutions is picking up, with the focus shifting towards user starting points and hardware integration. Cohere's launch of Rerank 3.5, an AI search model, marked a considerable improvement in enterprise search accuracy. In contrast, Meta's plan to develop a proprietary search index aims to reduce dependency on Google and Bing.
Verdict: AI Tools' Performance
Overall, based on their task efficiency and accuracy, ChatGPT came out as a clear winner followed closely by Meta AI. Both Grok and Perplexity lacked in some areas, indicating potential for improvements.
Conclusion
The swift advancement in AI technologies is evident from how effectively AI models performed during real-time tests. As businesses plan for future growth, understanding that AI is no longer a 'thing of the future,' but an inevitable and highly beneficial tool of the present, is crucial. Integrating AI tools into business processes can streamline operations, fetch real-time accurate data, and ultimately drive growth. Businesses, hence, should continue to explore the potential of AI and how it can improve their operations.
Topics Covered in This Episode
1. Significance of AI in Search Engines
2. Big Tech Developments in AI search
3. Competitive Landscape in AI Search Solutions
4. LLM AI Search Evaluations
Podcast Transcript
Jordan Wilson [00:00:17]:
How we use the Internet is changing, and it's changing because of artificial intelligence and large language models. And you may think this is a small thing. Right? Either a minor upgrade or a minor inconvenience, depending on how you look at it. But it's actually going to change everything, because AI search is going to start to infiltrate, and it already has every aspect of our work and personal lives. Everything from traditional Google searches to large language models to voice assistants. Things are changing very quickly. You need to know what's going on, how to work, and some of the limitations. So we're gonna be going over that today live and talking about real time AI search and putting together a live head to head battle of all the biggest juggernauts here in this space, ChatGPT, perplexity, Google, Copilot, Grok, and even Meta AI.
Jordan Wilson [00:01:19]:
So I'm excited for today's episode. So what's going on y'all? My name's Jordan Wilson, and welcome to Everyday AI. Before we get started off, have to give a quick shout out and thanks to our partners at Microsoft. So why should you listen to the WorkLab podcast from Microsoft? Because it's the place to find actionable insights to guide your organization's AI transformation. Tune in to learn how to think more creatively about unlocking the full potential of the technology. That's worklab, no spaces, available wherever you get your podcast. Alright. So another place to get your podcast and everything on AI is here.
Jordan Wilson [00:01:59]:
Welcome. Like I said, my name is Jordan. I'm the host, and this thing's for you. It is a daily livestream podcast and free daily newsletter helping everyday people like you and me not just keep up with what's happening in the world of AI, but how we can use all this information to get ahead. Right? I get it. It's hard. Like, you feel like you're constantly being left behind. That's what our daily show is all about, but it starts here.
Jordan Wilson [00:02:22]:
If you're on the livestream listening on the podcast, make sure to check out your show notes because where you actually go to grow is your everydayai.com. There, you can find now, like, 420 plus episodes of everything in the world of generative AI. Go watch, listen, read them all there. It is free. It is the number one, resource of free unbiased information on everything AI for beginners. So make sure you go check that out and sign up for our daily newsletter. Alright. So before we get started, half we're gonna start off as we do almost every day by going over the AI news.
Jordan Wilson [00:02:58]:
And, hey, livestream audience. Give me, please, a specific business related query that you normally Google search. We're gonna use those live later. Alright. So some big AI news today. So the Intel CEO has stepped down amid struggles. So Pat Gelsinger, Intel's CEO since 2021, has stepped down as the company faces challenges in the rapidly evolving AI sector. So Intel has struggled to compete with NVIDIA, whose GPUs are preferred for AI tasks due to their efficient parallel processing capabilities.
Jordan Wilson [00:03:31]:
Under Gelsinger's leadership, Intel's stock has declined by 61%, while at the same time, NVIDIA's has soared over 820% during the same period. A little bit of a difference there. So Intel's market value is now approximately a $100,000,000,000, significantly overshadowed by NVIDIA's $3,000,000,000,000,000 valuation. So Intel's restructuring efforts are described as the most critical since its inception in 1968, have yet to restore investor confidence. This leadership change highlights the urgent need for Intel to innovate and adapt to maintain relevance in the AI driven tech landscape. Alright. Next piece of AI news, Republican senator Ted Cruz has called for an investigation into whether European governments are influencing US laws on artificial intelligence according to Reuters. So Cruz's concerns arise as European countries led by the EU, have implemented comprehensive AI regulations, including the AI act.
Jordan Wilson [00:04:36]:
In a letter to US attorney general Merrick Garland, Cruz criticized the Biden administration for allegedly collaborating with foreign governments on AI policy. Cruz described European AI regulations as bad and accused them of being influenced by the quote, unquote radical left. So, you know, it's it's gonna be really interesting to see the potential political, AI policy being politicized, in the coming weeks as we, go through a change in administration here in the US. And then last but not least, World Labs, well, we finally know a little bit more of what they're actually gonna be doing. So World Labs is a startup founded by AI pioneer and who many call the godmother of AI, Fifi Lee, and it's launched an innovative AI system that transforms a single image into an interactive, explorable 3 d scenes. This is wild. So this technology stands out because it allows users to step into and explore 3 d 3 d environments generated from images, enhancing interactivity and modifiability. Unlike many existing AI models that create 3 d environments with consistency issues, World Labs systems maintains the integrity of generated scenes adhering to basic physical laws.
Jordan Wilson [00:06:00]:
Then the AI generated scenes can be explored via a demo on World Labs website featuring live rendering and an adjustable depth of field for enhanced realism. Despite its advancements, the system is an early preview stage with limited exploration areas and occasional rendering errors. So, yeah, World Labs has already secured $230,000,000 with you know, it's only been out there for a few quarters in VC money, from notable investors aiming to release its first product by 2025. Alright, y'all. So let's talk about it. And and hey. Thanks thanks for the questions, coming in so far. You know? So, Denny, maybe we'll get to yours.
Jordan Wilson [00:06:43]:
But, please, if you have questions on how you would normally use, you you know, the web at your job. Right? What are queries that you're normally, you know, looking up on a daily, weekly, monthly basis? Today's show is gonna be a live one. Alright. But first, I wanna set the scene on why this real time AI search battle is relevant for all of us. Well, I think, ultimately, it's about our devices. Alright. Right? Because how we use our devices, whether that's a computer, whether it's a mobile phone, it influences a lot. Right? And that generally starts with a search engine.
Jordan Wilson [00:07:19]:
Right? And we actually are gonna have a show tomorrow talking about this a little more. So we kinda have a 1, 2 combo here for you. So if this is up your alley, make sure to tune in tomorrow as well. But there's been a lot of recent updates from all the companies in big tech, and I've noticed over the coming, or sorry, over the last few weeks this growing trend. So one, large language model, makers, reportedly getting into hardware. Right? And then your traditional big tech search companies continuing to prioritize AI results, right, and AI, real time information. But where do you start? What do you use? We're gonna get into this, but let's quickly go over, what's new. And y'all, I I I might have some takes on this.
Jordan Wilson [00:08:12]:
Right? It's it's hot take Tuesday, so, let me know if I should take it easy on everyone or if I can ramp it up. Alright? It's up to you guys as always. So over the last few weeks, there's been a lot of recent updates. So one of the biggest ones has been OpenAI. So previously, they had a standalone prototype called SearchGPT. Right? It wasn't available to a lot of people, but it was kind of a standalone product. And then in last, you know, about 5 weeks ago, actually, OpenAI finally released this to the public, and it's now just called ChatGPT search. Right? And if if you're a longtime listener of the show or reader of the newsletter, you actually knew about this.
Jordan Wilson [00:08:56]:
This actually was possible before ChatGPTsearch with some, clever prompting. OpenAI has quietly had a perplexity, type of clone or a perplexity type product, for about 8 months. No one knew because they didn't really announce it, but it's been out there. Right? But now, officially, we have ChatGPT search that was, unveiled. I believe it was October 26th. And this is integrated now, an integrated search engine into ChatGPT. Right? So it was a stand alone product. Now it's integrated, and it's, grabbing real time data retrieval and positioning itself as a competitor to Google's search dominance.
Jordan Wilson [00:09:43]:
Right? We haven't seen, the most latest statistics from 2024 yet because, the year is still going. But in most years, Google controls more than 90% of search revenue. And depending on what style you look at, anywhere from, like, 75 to 85 percent of search traffic. So everyone's trying to get to where you start. Right? That query. How you start your day. Do you go to a website? Do you go to google.com? Do you go to a start page and just search from there? So much of those ad dollars and how companies actually make money depends on the search bar, and that's why we have to pay attention, to these updates. Another big one from OpenAI, well, they released a released a Chrome extension.
Jordan Wilson [00:10:27]:
Sounds small, but it's not. Right? A sneaky way that OpenAI is allowing potentially 100 of millions of users to skip Google. Right? So if you enable, OpenAI or ChatGPT's Chrome extension and you go, as an example, if you have Chrome or Edge, because all of these work in Edge as well, and you go and, you know, normally, you might put something in the URL bar, which is also a search bar. Now it just bypasses Google, and it just launches straight into ChatGPT. And here's here's why I'm like, okay. I know Google's worried about this. Everyone is. Because now, you get a a little prompt.
Jordan Wilson [00:11:08]:
So the first time after you install, the ChatGPT, Chrome extension, it says, did you mean to change your search provider? Google's like, yo, like, are you sure you want to do this or do you want to change it back to Google? Right. So everyone's aware that there's a battle for users and where they start. Alright. Alright. Kathleen and Tara said bring bring a little fire. Let me give a quick shout out to our partners again from Microsoft WorkLab. So why should you listen to the WorkLab podcast from Microsoft? Well, it explores the questions business leaders are asking. How can they guide their organization's AI adoption journey? How can AI help them maximize value and create new products in business models? How should they help their teams reskill for this new era of work? And why is it important to be completely transparent about when and how you use AI? So find the answers on WorkLab.
Jordan Wilson [00:12:09]:
That's worklab, no spaces, available wherever you get your podcast. We'll try. Alright. So Google's scared. They should be. Right? Because if since you guys wanted some some heat, I think Google was grossly behind everyone else when it came to pairing up, their large language model, Gemini, with real time search. We have literally, more than a 1000 videos on our YouTube channel. Right? So you can go subscribe to that.
Jordan Wilson [00:12:44]:
But we showed you once Google Gemini was released and probably in the 6 months after, it had a real hard time connecting to Google, connecting to real time information. And the early AI overviews from Google were a little sketchy. I think they've really improved. So you gotta tip your hat, to to Google because I think they've improved recently, but we're gonna be doing it live. Alright. Here's what's also happened in the last few weeks. Google has expanded AI overviews. We're not gonna be comparing those because they're a little different.
Jordan Wilson [00:13:16]:
Maybe that's another show for another day, but they've expanded AI overviews in search over a 100 companies. Sorry, a 100 countries. Right? Whereas before, I believe it was 7 when it first rolled out. So bringing these AI generated summaries to everywhere. Alright? So even if you're not going into Google Gemini as an example or ChatGPT, you're probably already using these AI search, right, with Google AI overviews. Once they you know, they had some bugs early on, but they're pretty pretty decent now. Right? It's it's, you know, kind of a maturation of what Google has always done. Right? There's always something called, you you know, the SEO world, like position 0, right, where essentially it wasn't an answer.
Jordan Wilson [00:14:04]:
Right? It was kind of like a precursor to AI search right now. If you, put in a certain query and Google had an answer, you know, there's something they might call it a knowledge graph or something like that, but it essentially answered it there for you. But now with the AI overviews from Google, it's really expanded, you you know, bringing that AI, search capabilities even to Google's home page. We're not gonna be comparing that live today, but pretty big. Some other big recent news in the last few weeks, the browser company has previewed Dia, an AI focused browser set to launch early 2025. Cohere. Right? We don't talk about Cohere a ton, here on everyday AI, but when it comes to enterprise companies, Cohere is is a is a force to be reckoned with. So they just released and previewed rerank 3.5, which is an AI search model that processes queries in over a 100 languages, improving enterprise search accuracy by 30%, according to them.
Jordan Wilson [00:15:01]:
Right. And then a couple other ones, perplexity. Right. So now perplexity is bringing shop with perplexity. Right. And also, their CEO has said that they're gonna be developing hardware. Right. I started the show by talking.
Jordan Wilson [00:15:16]:
I think ultimately it's about hardware and pairing AI search with the hardware. We've also seen, you know, reports over the last year that OpenAI CEO Sam Altman is working with former, Apple designer, Johnny Ives on, a hardware device as well. So, you know, you have hardware traditional hardware companies going into search, kind of traditional AI or large language model companies, you know, putting out, you know, AI search products and hardware. Right? So everyone's competing for where users start. Microsoft and Bing aren't any different. They just launched, Bing did their generative search experience. So you have not just Copilot, but in traditional Bing, you're getting these AI powered searches as well. And Meta yeah.
Jordan Wilson [00:16:04]:
Every single big tech company. I'm not I'm not kidding. Meta, announced the development of a proprietary search index for its AI chatbot to reduce reliance on external platforms like Google and Bing. That is making their own search engine. Everyone wants to control where you start your day. Right? And if you're not using, in in AI, you know, or a large language model solution, they're coming for hardware and traditional search engines. So if you're still going old school, you need to stop. Right? You need to stop.
Jordan Wilson [00:16:43]:
But first, what you need to know is what works where. Alright. So, livestream crew, like I said, please give me, please give me a suggestion or 2. What is something that you routinely search the web for? Alright. So I, I have I have a couple a couple ones, a couple ones here, so please get them in. But I also, if possible, it should be something that's easy to grade. Right? So hey. Although I love this one, Fred, Fred says, how will quantum computing impact AI energy needs? Hopefully, it's something that I can easily say, like, yes, no, or maybe.
Jordan Wilson [00:17:25]:
Right? So, something that maybe you've gotten, hallucinations with in the past. Maybe something that, you you know, it's it's definitive. Right? Yes or no? Is it correct or is it not? Alright. So before we, before we jump in, to this live demonstration and podcast audience, I'm gonna do my best to visually describe what's going on, but we're doing a live throwdown of searches that you would just normally do. But before we get started, have to give one more quick shout out to our partners at Microsoft WorkLab. So why should you listen to the WorkLab podcast from Microsoft? It explores the questions business leaders are asking. How can they guide their organization's AI adoption journey? How can AI help them maximize value and create new products and business models? How should they help their teams reskill for this new era of work? Why is it important to be completely transparent about when and how you use AI? Find the answers on WorkLab. That's w o r k l a b.
Jordan Wilson [00:18:23]:
No spaces. Available wherever you get your podcast. Alright, y'all. Let's do this live, and let's, kind of talk about the real time AI search battle. Alright. Let's get into it. So, livestream audience. Please let me know if you can see my screen.
Jordan Wilson [00:18:40]:
Hopefully, this works as we're, jumping around here. But let me just quickly describe, what we're gonna be doing here. Alright. So we have some very simple, and I'm not even gonna say these are prompts. Right? We're doing traditional searches because I think people, when they think of large language models, you think of prompting something. You think of having a conversation. Yes. That is the correct way to use it.
Jordan Wilson [00:19:05]:
However, what I just talked about, every one of these big companies are coming for your traditional search queries, and I do think that there's 2 different things. Right? I think a traditional search query might be a, you know, 2 to 5, word query that something that you just care about. Whereas, if you're working with a large language model, you're probably having a back and forth iterative conversation and using more words. But in this case, we are doing very short, traditional search phrases, and we're seeing how all of these new products and new, updates that we've been talking about across these different, these different stacks here handle them. So like I said, we're gonna be doing ChatGPTsearch, and I'm using paid versions for all of these, except meta AI. So, we're gonna be going over ChatGPTsearch, perplexity, Gemini, Copilot from Microsoft, Grok. Yeah. Grok, and meta AI.
Jordan Wilson [00:20:05]:
And we're gonna be running the exact same simple search queries. Again, this is not a a prompt engineering head to head. This is taking a look at how these AI companies and big tech companies are changing our search queries. Alright. So we're gonna start with sports, and we're gonna do the same, the same search very quickly. Alright? Because I don't want this to accidentally drag on, for an hour. And all I'm doing here is, when I'm using ChatGPT, I'm gonna toggle on, the ChatGPT search. Although generally, even if you use a query that would break that ChatGPT thinks, oh, I need to search the web.
Jordan Wilson [00:20:44]:
You know, some of the times, it would automatically understand that it needs to search the web instead. But just, to so everyone knows, we're gonna be using the same chat window for each of these, which shouldn't technically throw anything off. It just makes it a little bit cleaner. And we're going to be toggling the search, option on inside of ChatGPT. Alright. So we're doing our first one is sports. So we have our scorecard, and we're gonna give every we're gonna give them all essentially a 0, a 5, or a 10. Alright? For the most part, if if I see that there's, you know, some gray area, we might do other scores.
Jordan Wilson [00:21:22]:
But for the most part, a 0 is a hallucination or they get it wrong. A 5 is like, okay. That's that's partially that's partially right. And then a 10 is like, okay. That's that's pretty much that's pretty much right. Alright. So like I said, if you do have, other ideas, get them in now because we're about to fly through this. Alright.
Jordan Wilson [00:21:43]:
So here we go. Our first kind of prompt, we're just saying Bears upcoming schedule. Alright. I'm a Bears fan. Any Bears fans, in the livestream audience? We're getting a new coach, which is great. The Bears find great ways to lose. Alright. So we're gonna do this very quick.
Jordan Wilson [00:21:58]:
We're also using the pro version of perplexity. Alright. So that's all we're doing is just the words Bears upcoming schedule. Nothing else. And I'm quickly jumping between all tabs here. Alright. And we're gonna keep tabs on, did it get it right? Did it get it wrong? Alright. So let's see.
Jordan Wilson [00:22:19]:
So Chad gbt, the new ChatGPT search, love it. Very visual. So we we have this kind of quadrant of their next 4 upcoming games, including team logos. There's links. I can go down here, click the sources. It pops the sources out on the right hand side. So if you haven't used ChatGPT search, I'm not gonna do a whole, overview here, but I want to describe to our podcast audience. So, obviously, got this, got this right.
Jordan Wilson [00:22:46]:
Did a good job too. Alright. So the answer is the next game, the bears play the 40 niners, Sunday at 3:25 PM CST. Alright. Let's take a look at perplexity. Did perplexity get it right? Kind of. So here's the thing. All I said is bear's upcoming schedule.
Jordan Wilson [00:23:08]:
What perplexity did, and it requires a lot more scrolling, it didn't really deliver me the answer that I wanted upfront. So what it did, which I don't like this, it just gave me their entire season schedule. So it's like this is technically outdated. So not only did it not put the upcoming game, because that's what I asked for. It didn't give me the upcoming game. It just essentially gave me this information. Looks like it could be 8 months old. It's not updated.
Jordan Wilson [00:23:36]:
It doesn't give me the the game first. Right? And it there's no scores. So these games are in the past, right, from September, and there's not even results. Right? I would get it if it at least gave the results, but not very good. Right? But it at least does have there if I scroll down. So, not that great, from perplexity, if I'm being honest. I don't know if I should give that a a 5 or a 0. Livestream audience, I'll let you vote.
Jordan Wilson [00:24:00]:
Should I give that a 5 or a 0? Let's go to Gemini. Gemini, straightforward here. Right? Gave me nothing else. Just answered my query. Again, a visual just gave me the bears, 40 niners, and then the next game. So it gave me the next two games. Straightforward. I like it.
Jordan Wilson [00:24:19]:
Gemini passes. Great. Gemini's like, their their old version of Gemini, like, 6 months ago was terrible. It could not connect in real time to anything on the web, which I warned people about. I'm like, if you're trying to use the front end of Gemini chat right now, stop, because it can't even talk to Google. So like I said, you gotta tip your cap when the company improves. Alright. Microsoft Copilot.
Jordan Wilson [00:24:41]:
So no visuals here, yet it did give me the next game, okay, as well as the next upcoming games in, 2 different sources that I can click on, below. So got everything right pretty straightforward. I'd say it passes with a 10. Grok. Here's here's the, the wild card. Right? So if you pay for I I think it's like $77 a month for Twitter's premium version, you get Grok. I'm not a fan of Grok. I don't think it's very good.
Jordan Wilson [00:25:11]:
But for one of its biggest, you know, value props is it's great with live information. Right? So let's see how it does. So, fortunately slash unfortunately, it it searches both post or tweets on Twitter. I'm not gonna call it like axes on acts. I don't know what that means. So it searches both recent Twitter posts as well as web pages, which is a good and bad thing because depending on what you're searching, and I've done plenty of examples of this, sometimes it brings up just a bunch of misinformation, in in, essentially, tweets from spam accounts. Right? Which, using real time information from Twitter, depending on what you're looking for, is problematic. Alright? But for this, the Bears upcoming schedule, got it right.
Jordan Wilson [00:25:57]:
So, there we go. Forty niners. It put it in, Pacific time, but that's okay. It's still accurate. It gave me week 15 and 16. And then I can if I want to, I can click on the post and see the post that it grabbed, that it grabbed from as well as the web pages. Right? Because that's important, especially things with, like, transparency and trust. You have to know where it's getting this information from.
Jordan Wilson [00:26:22]:
So, I'd say Grok passes with a 10. And then let's see meta AI. So a lot of people don't know, but meta AI, you can just go to meta dot a I. Right? You can log you can use it without being logged in, but it won't save your chats. This is free. So this is the only free version. I'm using technically the paid or premium version for everything else, including ChatGPT, perplexity, Gemini, Microsoft Copilot, and Twitter's Grok, but but the free version here for Meta AI. So it uses, Google on the back end.
Jordan Wilson [00:26:52]:
Right? So let's see. It did a good job here. Just no no visuals. So, you know, Meta doesn't give you this kind of, rich snippet type search results, just straight text, which isn't necessarily a bad thing. Alright. So we got it right. It said, you know, the next game there, it, up top, it gave the, the 40 niners. So a 10 from meta.
Jordan Wilson [00:27:15]:
Alright. So here's our scorecard so far. Let's let's see. What did everyone, what did everyone say? Ted said, that, not Gemini. It should have been perplexed. Oh, perplexity is the one we're figuring out. Sorry. So a lot of people said 5 for perplexity.
Jordan Wilson [00:27:36]:
Alright. So per, perplexity gets a 5. Everyone else got a 10 in that one, so it passes. Alright. Our next question. We are doing stocks. Alright. So here's what we're doing.
Jordan Wilson [00:27:48]:
Sports, stocks, weather, news, places, and at least 1 or 2 from the audience. So if you have one, get it in. Alright. We're gonna pick up the speed here. So now I kind of gave you an overview of what each of these platforms give you. Right? So both visually, the results, how they access the web, etcetera. So now all we're doing is NVIDIA's stock price, and this is a live stream y'all. So their current stock price is a $138.63 per share.
Jordan Wilson [00:28:19]:
So 138.63. So let's see, let's see how everyone did here. Alright. So first, let's go to ChatGPT. So ChatGPT actually gives you super nice interactive graphs because of ChatGPT search. I didn't know if you knew that, but we got a perfect, perfect kind of score there. And the markets are gonna open here in about 30 minutes. So it's not like this is changing as we go along.
Jordan Wilson [00:28:48]:
So there we go. We got a good result. We got a good result from ChatGPT. I appreciate everyone's patient here. I'm toggling, you know, doing a live stream with, many different windows is is sometimes a little tricky. So appreciate everyone's patience here as I scroll through. Alright. So, there we go.
Jordan Wilson [00:29:09]:
Let's go to perplexity. So perplexity, same thing. You get a live real time graph. Love this from perplexity. So perfect score there. And it says 13863, straightforward from Gemini. Right? Gemini, you get a nice little, visual as well, up to date. Crushed it.
Jordan Wilson [00:29:31]:
Perfect. Alright. 10. Let's see our friend, Copilot. Let's see how Microsoft Copilot did. No visuals here. Straightforward, though. Got it right.
Jordan Wilson [00:29:42]:
$138. NVIDIA is on fire. If if if only you would have listened to someone like a year and a half ago that said NVIDIA was the most important company in the world. Alright. Grok got it right. A 138. Alright. So so far, everyone's crushing it, and let's look at Meta.
Jordan Wilson [00:30:00]:
Meta got it right as well. So every single, kind of chatbot or AI search engine, got this one correct. Pretty impressive. Alright. Next, let's do weather. Alright. So I'm gonna I'm gonna go ahead and and check the actual weather here, in Chicago in real time. So it looks like it's roughly 22 degrees.
Jordan Wilson [00:30:23]:
Alright. Again, this is things that you would normally be searching for. Right? You probably have an app on your phone, but think you have to think in the future. We might not be using websites. Right? I know that sounds crazy. Let me repeat that. We might not be using websites. You might just be using, you know, your large language model or something like Apple Intelligence if it ever gets smart.
Jordan Wilson [00:30:43]:
Right? You just might be using something that's powered by an AI search engine. So, right now in Chicago, it is 22 degrees Fahrenheit. Yuck. Alright. So, let's get back, to our searches and do weather in Chicago. Alright. So we're gonna do this one, like I said, very quickly. And we are doing them all real quick.
Jordan Wilson [00:31:10]:
So let's see who's going to win. Y'all actually let's, livestream audience. And if you're listening on the podcast right down now, who do you think is ultimately going to win this? Because we're gonna crank up the speed here. Alright. So let's see ChatGPT. And I'm gonna give it's it's it's hard to say. Right? Because I'm I'm even searching right now. I'm getting different results on, you know, weather.com versus accuweather.
Jordan Wilson [00:31:34]:
So as long as it's within, like, 3 degrees, right, as long as it's not wildly wrong, we're gonna give everyone, we're gonna give everyone a 10 here. Right? So as long as it looks like, yes, it's actually accessing the information. Alright. So ChatGPT with the new ChatGPT search, very nice visual table. My gosh. I'm starting to hate using weather apps because you gotta, like, watch, like, a 15 second video just to get the freaking weather. Right. Annoying.
Jordan Wilson [00:32:00]:
Alright. So ChatGPT says 20 degrees. Very visual. Very nice. Perplexity. We'll give this to perplexity. Right. It it looks real time.
Jordan Wilson [00:32:10]:
It says current. It says 18 18 degrees. Close enough. Right? Because I'm getting reads between 2021 when I check manually. Gemini advanced 21. Gemini looking nice here. Right? Who who knew Gemini is really improving for at least simple real time searches, things that you might normally Google. Right? We get a nice, a nice visual here, and you can kinda scroll through, scroll through the hourly forecast there.
Jordan Wilson [00:32:37]:
Very nice. Oh, let's see. I don't know. So copilot, it it's pulling it from forecast dot weather dot gov. It says 25. Okay. So it says a high of 25 and a low of 14 tonight. However, I didn't say what is the weather right now.
Jordan Wilson [00:32:56]:
I just said weather in Chicago. Alright? So, livestream audience, you're the, determining factor. Do we give Copilot a a 5 or a 10 on this one? Technically, it's correct. I didn't say what's the weather now. It gave me a high and a low. I just said weather in Chicago. Alright. Grock Grock says the current temperature is 16 degrees Fahrenheit with a high expected, to reach 29.
Jordan Wilson [00:33:23]:
Is it actually gonna hit 29 today? I don't think. May I mean, maybe maybe it will. Maybe it will. So, Grok, alright. I'm gonna say that passes. And then Meta AI. So, unfortunately, it looks like meta oh, let's see. Meta AI says it's a chilly day in Chicago with partly cloudy skies and a temperature of 18 degrees Fahrenheit.
Jordan Wilson [00:33:45]:
Alright. So I think mostly all of them probably got a 10 unless anyone says Copilot, gets a 5. Alright. Most most of you guys said, it passed. Alright. Alright. So it passed. Everyone everyone there passed.
Jordan Wilson [00:34:04]:
Yay. Did the did it do better than your local weather person? Alright. Now here's here's one where we might have to get a little bit specific with the grading. So now I'm saying top AI news stories for this month. This month is December. So I didn't say for the past month. I'm saying this month it is December. So we're doing all of these.
Jordan Wilson [00:34:35]:
And this is where I'm probably going to judge these on the fly. I promise you, I'm not going to be biased, because I think a lot of times when you ask for news stories, some some of these large and this is something you would probably be using these models for for business. Right? What's happening in your industry and your vertical, etcetera? A lot of time they give these general, general outputs. Right? Like, oh, you know, there's all these new advancements. Right? So if I see some of that, probably going to give it a 5. Right. Maybe lower. Depends on what else we see.
Jordan Wilson [00:35:07]:
All right. So first, ChatGPT. And again, you get this kind of links at the bottom where you can click the sources as well. Alright. So, let's just kind of see a couple of things. So it says as of December 3, 2024, several significant develops. Alright. So US imposes stricter export controls on AI chips to China.
Jordan Wilson [00:35:26]:
We have that in our newsletter yesterday. Some European defense start up news. OpenAI targets 1,000,000,000 users. This is all very, very recent, which makes sense because we're only December 3rd. Alright. AI chatbots enhance holiday experience. Yep. Good.
Jordan Wilson [00:35:40]:
All right. So this is all hot, fresh AI news from chat. And live stream audience. I know a lot of you are giving me your scores. Just let me know. Like news chat g p right? If if if you wanna score it at the end, just at least let me know what category. So if I need to, like, go to you, for an answer, I at least know what you're talking about. Alright.
Jordan Wilson [00:36:04]:
So perplexity, top AI news stories for this month. AWS leadership change. Did that happen? No. That's very old. I'm I'm clicking this. The very first one right here. Oh, gosh. This is from August.
Jordan Wilson [00:36:22]:
Yeah. I'm looking at this. I'm like, that's not new. That's old. Yeah. So it's giving me old information. I said this month. And I'm looking at these stories from perplexity Aside from the AWS re Invent conference, which is happening this week, none of this is from this month.
Jordan Wilson [00:36:43]:
I'm looking. I I don't think no. I don't know. To me, this I mean, it's not a 0, but to me, that's like a 2 for perplexity. These things are not from this month. A lot of these things are very, very old. So perplexity, everyone thinks. Right? I haven't been using perplexity or talking about it as much because I've noticed a lot of hallucinations and a lot of simple errors.
Jordan Wilson [00:37:06]:
Right? I've been reaching out to the perplexity team being like, yo, what's up? But they haven't answered my calls. Alright. Let's look at Gemini. Alright. So here we go. It's, Alibaba's Cloud AI overhaul. I'm checking that one. I don't know when that one is from.
Jordan Wilson [00:37:23]:
I don't know if that's from this month. Let's see. December 3rd. All right. There we go. Alright. So Gemini Salesforce, predicts UK AI leadership. That's new.
Jordan Wilson [00:37:33]:
Amazon's big investment in in Anthropic. That was technically the end of November. I'm just gonna double check that. I believe that was. Yeah. November 22nd. So, okay. Most of these things most of these things, I would say, are fairly close, whereas perplexity was just very, very old.
Jordan Wilson [00:37:52]:
So I'm looking at some of these. It's a mixed bag from Google Gemini, but much better than perplexity. So I'm going to probably give it like a 7. Let me know if you guys think that's correct or not. Going into Microsoft Copilot top AI news stories for the month. And here, I like this. Copilot just responds. Here are some of the top AI news stories for December 2024.
Jordan Wilson [00:38:14]:
So it at least recognizes, yeah, I'm supposed to be giving you up to date information. So the first thing is top AI stocks to watch. I don't know. Is that real? I mean, it's it's from December 2024, so that's fine. So it's giving me some more, general things, but I don't think some of these are very, up to date. So as an example, this one AI and Nobel Prizes, I believe that was October or November. So, essentially, it's pulling from certain websites, and there's dates on here. So there's a date on this website it was pulling it from that said December, but I believe, yeah, that is from November.
Jordan Wilson [00:38:54]:
And it's actually from before that. So the AI, let's see. AI Nobel Prize. I think that was, oh, look at that. I was trying to do a Google search, and I have my default, to ChatGPT. So I believe that was October or later. Yeah. October.
Jordan Wilson [00:39:13]:
Yeah. So it's it's mixed bag there from Copilot. And it is a little more general, but some of the things are new. So without going down each and every one, I'm guessing I'm gonna do similar to Gemini. I'm gonna give it a 7. Much more accurate than perplexity. Let's look at Grok. Alright.
Jordan Wilson [00:39:31]:
OpenAI's trademark move on reasoning models. US proposes AI Manhattan project. I believe that's old. Yeah. That's in November, and I think it was actually from before that. Elon Musk, legal action, that's new. AI and advertising integration. Yep.
Jordan Wilson [00:39:47]:
That's new. Okay. So pretty pretty good, from Grok. I'll say probably a 7. So it looks like Gemini Copilot and Grok, much better than perplexity, but throwing in some older things from, October or November. Whereas Chad GPT, at least according to my eye, only brought in things from, December. Alright. Let's see, Meta AI, leadership transition at oh, no.
Jordan Wilson [00:40:15]:
This is this is old. Alright. So Meta is bringing things in from last year. Alright. So it's OpenAI CEO Sam Altman stepping down. Elon Musk, AI chatbot Grok. Alright. This is all bad.
Jordan Wilson [00:40:28]:
Alright. So the real time information, from Grok gets a big fat 0 because none of it was correct. Alright. Let's do places. All right. We're going to go quick. So I'm doing best pizza places in Chicago. Right? This is probably something that you're Googling all the time.
Jordan Wilson [00:40:45]:
You want to know, you know, a restaurant or a local business to shop at. So, let's just quickly do this one and, see who gets this kind of right. And I'm picking something I know. If there's one thing I know, I know my pizza places in Chicago. So let's look at ChatGPT first. Alright. So, if you didn't know, the new ChatGPT search has a very cool, kind of interactive graph. So this is gonna feel very, reminiscent of, Google.
Jordan Wilson [00:41:15]:
Right? A Google map. So I can also toggle to the list view. The list view keeps the map in there, but then brings the, the list as well. So, pretty good. Let me see it. Brought in, Luminati's, Spaca and Napola Giordano's. It brought in. Okay.
Jordan Wilson [00:41:32]:
Coal Fire, Bert's Place. I don't even know that. Okay. Did did a pretty good job. Did a pretty good job. It offered not just things right in downtown because I didn't say downtown Chicago. So it did get the kind of the whole area. So pretty good there.
Jordan Wilson [00:41:46]:
Let's look at perplexity. Perplexity as well gives me a little map or visual, on the right hand side that I can click on. And similarly to ChatGPT, it gives me an interactive graph. So it brought in all the staples. Right? Giordano's, Pisano's, Luminatis. So pretty good here. So, both of them so far, very, very good. Alright.
Jordan Wilson [00:42:09]:
Gemini. No no interactive map gave me a great list. So it not just gave me classic Chicago, but deep dish, deep dish pizza and then for beyond deep dish. So great, great response here from Google. And it also asked me some follow-up questions so it could help me better. Microsoft Copilot. Simple. Give me all the staples, including pea quads.
Jordan Wilson [00:42:32]:
Love some Pequads. Alright. So pretty pretty good. No hallucinations so far. Let's see. Grok, again, pulled in from Yelp, from, Tripadvisor, as well as, some different post, from Twitter. Same thing. Pequads, Luminati's, Giordano's.
Jordan Wilson [00:42:50]:
Give me give me all the, the staples there. And then meta, deep dish favorites, thin crust spots, unique spots. So no lies here. No hallucinations. However, ChatGPT perplexity, gave me a little something more. It gave me maps, which I like. If you're thinking local, somebody give the nod, a slight nod, to ChatGPT and perplexity, And I'm gonna give the rest of them probably an 8 because no one was right. But I think that, kind of additional, aspect of having the maps in ChatGPTsearchandperplexity, was a little better because if you're searching for something, that is location specific, having the location, even though putting it out in plain text, and I know that's just some of these other options don't have those capabilities, but it's my show.
Jordan Wilson [00:43:41]:
I can score them how I want. Alright. Let's see. Jackie said only people from Chicago can vote on that one. And, yes, Mark Mark is saying Grok may be using x tweets as a source. Yes. So Grok uses both websites, and tweets, which might be a good thing, might be a bad thing. Alright.
Jordan Wilson [00:44:03]:
Jackie says I'm being too nice to grok. I'm I'm trying to be as unbiased as possible. Alright. Let's see, let's see if we got any good. We might only have time to do one, but if you didn't get it in already, I wanted to do one, from the audience here. So let's see if there's something that I can actually gauge. Alright? If there's a yes or no, yes or no answer here. Alright.
Jordan Wilson [00:44:31]:
Let's see. Let's see some of our, questions. So, Denny, with quite a few. Thanks, Denny. When is the most recent news in topic of interest? What are fun things to do in blank city? Christopher saying, you know, talking about replacing Stack Overflow. Fred, we talked about that one. Quantum computing. I can't get I can't know the answers.
Jordan Wilson [00:44:55]:
How can you use the app where you have 6 apps open at the same time? Samuel from YouTube saying my search from last night. What's the secret code clearance pricing at Home Depot? I don't know how to score that one. Okay. I like this one from Marie saying which EV vehicle is the most efficient and economical? That one's pretty good. I should probably, be able to get the answer. Maybe, maybe not. Okay. Here's one from Denny.
Jordan Wilson [00:45:17]:
Thanks for this one, Denny. I know this is kinda stock related, but this one at least has the has a correct answer. What what stock has the largest market cap? Alright. So we're just gonna do one audience question, and we're gonna wrap this up. Alright. So we're gonna do what stock has the, what stock has the largest market cap? Yeah. I do this live, y'all. I love typing live.
Jordan Wilson [00:45:46]:
Alright. Let's first see the answer. Alright. This is a site that I'm always at. So right now, NVIDIA has a slight or sorry. Apple has a slight advantage over NVIDIA in terms of market cap, so it is a $3,600,000,000,000 market cap. Alright. So let's go ahead.
Jordan Wilson [00:46:05]:
Love this question because it's easy to judge. I am going to say what US stock has the largest market cap. So pretty pretty simple question. We should, in theory, be able to get a yes or no or, partially complete answer. So I'm going through I'm pasting this in all of our, all of our options here. And, again, the answer, is going to be Apple with 3.6 trillion market cap. All right. So let's go ahead and see.
Jordan Wilson [00:46:41]:
All right. So chat gave us a nice, nice graph and it correctly says Apple 3.6. All right. So chat passes with flying colors there. Alright. Let's go ahead into, perplexity. So perplexity says Apple, 3,600,000,000,000. Perplexity gets it right.
Jordan Wilson [00:47:09]:
Alright. And over to Gemini. So I do like that Gemini said as of December 2nd. That's good. It says 3,590,000,000,000. I don't know. Yeah. You guys, what do you think? I mean, it's it's like, are we rounding here? The actual number is 3.62.
Jordan Wilson [00:47:27]:
So let me know. What does what does, yeah, what does Gemini get for that 1? 3.59. I don't I don't wanna I don't wanna be accused of being biased. Alright? So you guys can vote. So whatever it gets, Copilot's probably gonna get the same because it says the market cap is 3.5 trillion, 3.55 trillion. So, Gemini and, Copilot were a little off. Let's see. Grok.
Jordan Wilson [00:47:57]:
Grok. Okay. Grok just got it wrong. Grok got it wrong. This is why I tell people, I don't think Grok is a serious model because you would think. Right? Because it's like, oh, according to these 15 web pages and 8 tweets, You would think by looking at 23 sources, Grok could at least get this right. It got it wrong. It says it's let me just double check here.
Jordan Wilson [00:48:22]:
Yeah. It says NVIDIA, 3,600,000,000,000. Grok gets a big fat zero. Right? Everyone's like, oh, Grok's gonna be amazing. It has real time, you know, information to Twitter and and and how it can access the web. And I've been telling people it's bad. There's no instance where I would ever use Grok. I'm sorry.
Jordan Wilson [00:48:42]:
Even if I'm searching Twitter, I'm not gonna use grok. Alright. It's just full of hallucinations. It's it's it's not good. That's my opinion, but that's why we do live tests. Alright. Let's see meta. Meta surprisingly got it right.
Jordan Wilson [00:48:57]:
3.6, 3.6 trillion. Alright. So, let's see. What did our audience vote? Did we get any, what should we give Gemini in Copilot? Let's see. Michael says Gemini gets 3.59 points for that. That's that's, that's funny. Oh, I like this one. We might have to do one more.
Jordan Wilson [00:49:22]:
I'm sorry. We had another good one. That this one this one should actually be a good one. So, I like this one. So we're going to give Gemini, we're going to give Gemini and, Copilot. I don't know. Sixes. We're going to give them sixes.
Jordan Wilson [00:49:38]:
Alright. I like this one, from Michael. Yeah. I'm I'm I'm biased. Saying, how many episodes are there of the everyday AI podcast? I'm gonna say give it, give it a little hint here. All right. Because I don't think any of them I don't think anyone's going to get this right. All right.
Jordan Wilson [00:49:59]:
So there are 400 and oh, little error on our website. Interesting. I'll have to fix that up. So technically, it's 412, but we had a little, error there, where it's double labeled. So it should be 4. I'll I'll accept 411 or 412, but I don't think any of them are gonna get this right. But let's let's, let's go ahead and see. All right.
Jordan Wilson [00:50:23]:
So quick one. We're going into all of them and we're going to see we're just going to see how bad they are. Maybe this is great. So, Michael, thank you for this suggestion, because if there's any ties, I believe this one is going to separate any ties that we may have. Alright. So let's look at ChatGPT first. So it says, ChatGPT says 400. Alright.
Jordan Wilson [00:50:48]:
And it does say as of December 3, 2024. So it's a little wrong. We look at the sources, and it's bringing in a bunch of different sources. Alright. So not correct there, but close. Perplexity, 415. That's wrong. It's saying there's more than there actually is.
Jordan Wilson [00:51:06]:
So ChatGPT went under. Perplexity went over. Livestream audience, get get your, get your votes in. Right? Get your votes in on on where you think, all these should be because some are under, some are over. Alright. So Gemini says 415. So, Perplexity and Gemini both said 415. Copilot says 398.
Jordan Wilson [00:51:31]:
Alright. Grok says 3. Bad. Grok says 329. That's not even close. Right? And then Meta Meta says 412? Meta got this even more correct than our website. Alright. Meta.
Jordan Wilson [00:51:51]:
Was not expecting that, was not expecting that out of meta. Alright. So we're gonna get meta big fat 10. Good job. I I don't know. Where do we where do we land with every, with these other ones, y'all? I'm gonna go ahead as we wrap up. Jackie says this was fun. Alright.
Jordan Wilson [00:52:11]:
So let's see. Grok Grok was just very, very bad. 329. So I don't know. Grok, I'm gonna give a 2, I guess. Okay. I'm gonna give Grok a 2. I mean, the rest are kind of close.
Jordan Wilson [00:52:29]:
40415. Maybe 415 is a little closer. So maybe we'll do perplexity in Gemini. We'll do maybe a 6 for perplexity in Gemini, and then we'll do a 5 for ChatGPT and maybe a 4 for Copilot because Copilot was a little further off. Alright. So let's add up our very unofficial scoring here. Alright. Let's see which large language model did the best in our very unofficial testing.
Jordan Wilson [00:53:06]:
So did you get it right? What do you think as I add up here? If you were to think, hey. I'm using 1 Internet connected large language model for my business, for my career. Are you using the right one? What are you using? Again, this is, you know, this is a very unofficial, unofficial experiment here y'all. So, but I'm I'm surprised with some of the results. Right? Like, as an example, I was not expecting Meta to be the only one that got that correct. So, here we go. I'm gonna go ahead and order these, in the order in which they did. Alright.
Jordan Wilson [00:53:47]:
So here we go. Our final totals, ChatGPT search got a 65. Meta AI in 2nd place. Alright. So ChatGPT search, number 1. Meta AI, number 2, surprising. Again, this is subjective with 58. Gemini, updated and improved.
Jordan Wilson [00:54:08]:
Great job, Gemini. 57, Copilot, a little bit behind there. So Gemini and Copilot in the middle of the pack. Copilot, 55. Perplexity, surprisingly stumbled. 53 in Grok. 47. Alright.
Jordan Wilson [00:54:24]:
So we're giving our medals. ChatGPT, number 1. Meta AI, number 2, Gemini, number 3, Copilot, number 4, Perplexity, number 5, and Grok, last place, number 6. Alright, y'all. Yeah. You know what, Michael? Michael says, I'm so surprised by perplexity. Their business model is search. I think perplexity, rightfully so, had a lot of I don't wanna use the word hype.
Jordan Wilson [00:54:46]:
I'll I'll use the word hope, a lot of promise. And early on, I think when none of the other, options could do a great job at real time search, I think everyone flocked to perplexity. One thing that I noticed, and I have done some perplexity episodes in the past, but I if you go back and look, I've talked about it a lot less recently because I'm noticing a trend of hallucinations. I'm noticing a trend of perplexity missing simple things that it used to do better. Yes. You can choose your model. Right? You can choose your model and perplexity. I'm using Claude 35's on it, but that doesn't change, the actual, perplexity's ability to browse the web and give you accurate information.
Jordan Wilson [00:55:24]:
So the model that you choose when using perplexity, at least in our testing, I've done blind testing on this. It doesn't impact the results. So if if you're saying, oh, Jordan, you used the wrong model. You should have used, you know, sonar large or you should have used GPT 4 o. No. You get similar results. So if it gets it right, it gets it right. But, you know, the model that you choose, right, because perplexity is an answers engine, and you can choose, SONNET 35 or you can choose GPT 4 o.
Jordan Wilson [00:55:50]:
It just changes how it presents the information. But if it gets it wrong, it's still gonna get it wrong regardless of the model that you choose. So, yeah, perplexity, I think, has had some, if I'm being honest, some struggles lately, and I'm a big fan. But hallucinations, they're real. Right? And and not answering simple queries. I think especially since they introduced shopping, you can ask a query and you can ask a question about a certain product and you want an answer. And instead, perplexity is now since they released this shopping, now they're just trying to push products in front of you. And I'm asking.
Jordan Wilson [00:56:24]:
Right? Like, I'm trying to, you know, get a new dishwasher or whatever. And I'm saying, like, hey, you you know, give me specs on this dishwasher. What's the difference between this one from Samsung and this one from LG? And it doesn't even answer it, and it just says, here, go buy it. You can buy it now in Perplexity Pro. It's like, yo, that's not what I'm asking. So in my my personal experience, Perplexity has gone I'm not gonna say downhill, but it's gradually trending downwards in its ability to deliver answers based on your actual query, which is important. Alright. So I hope this is helpful.
Jordan Wilson [00:56:57]:
I know this was a longer one y'all. So, please let me know if this was helpful. And, also, tomorrow, we got a nice little one two combination because, we're gonna be talking about this a little bit more in-depth tomorrow with our guests. And talking about the AI race is towards who owns the search bar on your phone. So if this episode yeah. It's a longer one. If it was interesting, if you wanna dive into deeper in the insights, make sure to join us tomorrow, and make sure to share this if you find it helpful. And for today's recap, go to your everydayai.com.
Jordan Wilson [00:57:30]:
Sign up for the free daily newsletter. Thank you so much for tuning in. Please join us tomorrow in every day for more everyday AI. Thanks, y'all.