Report: Google Assistant is most efficient assistant, Siri is least

[Red Hardware]

 

Soure:  https://www.androidauthority.com/efficient-virtual-assistant-2018-859875/

Quote

 

• A marketing company performed a thorough test of the four main virtual assistants.
• The results paint a clear picture that the Google Assistant smartphone app is the most efficient virtual assistant.
• Cortana is in second place, Amazon’s Alexa is in third, and Apple’s Siri came in last.

 

A new report from marketing agency Stone Temple Consulting confirms what we knew already: Google Assistant is the most efficient virtual assistant as compared to its top rivals. Apple’s Siri came out last for efficiency in the same set of tests.

Base on this report, Google assistant is the best virtual assistant right now, you might say not surprising. Yep but details are more interesting with this

 

 

If you take a look at the chart above, You'll see that there is small difference between google assistant on smartphones and google assistant on Google home, but what's more interesting is how bad siri actually is. Only 40% answers attempted ???? which is far below others like google and cortana or even alexa. 

In terms of fully and correctly answered questions, siri is doing better but it's still dead last which is not good news for those who bought Apple's $350 "Smart" speaker.

 

And for Apple fans out there wanting to say that the sample size was not big enough:

 

Quote

To perform the experiment, testers delivered a total of 24,710 queries, which is an incredibly large sample size.

They also have a chart which shows how many questions they got wrong and compares them with their last year score:

 

Again, siri is not doing great and it got worse compared to last year, even more interesting, Alexa got a lot worst. Personally i think it's because of it trying to answer more compared to last year.

Also cortana is doing great with the lowest percent of wrong answers.

 

Quote

From the results, we can draw these conclusions:

 

• The Google Assistant smartphone app answers more questions and gets more answers right than any other virtual assistant in its class.
• Microsoft’s Cortana is comfortably in second place with both sets of results not too far off from Google’s.
• Amazon Alexa does a pretty good job of answering questions correctly but is lacking when it comes to attempting answers.
• Apple’s Siri is way behind when it comes to attempting answers, but doing OK when it comes to answering questions correctly.

 

Quote

You can read the full report from Stone Temple Consulting at its website.

 

Edit: I'm also interested to see Bixby next time and see how it does compared to others. Also i like to note that from my experience, Cortana on windows 10 has some problems with voice recognition and she hear things more wrong than others. I think MS need to work more on their voice to text conversion as well.

[Spotty]

This won't come as news to Bitwit.

[Dabombinable]

There is a reason for Siri being the butt of so many jokes across the internet and entertainment.

[ItsMitch]

Not bad, good overall report, well wrote and a lot of information. ThumbsUp

[Tech Enthusiast]

Turns out, that just buying a Voice Assistant and claiming it to be "Apples best" is not going too well for them.

After buying Siri, they did not improve it at all.

 

Hell, in germany Apple approached the biggest University and asked for help to make it even remotely work in german.

Seems like apple does not actually have any coder capable of working on a voice assistant.

 

This report show this in a nice and well done manner tho. So thumbs up for showing the sheep how well they are doing. We need more of these for the other areas apple claims to be best and actually is worst.

[Aleks NE]

43 minutes ago, Red Hardware said:

 

Soure:  https://www.androidauthority.com/efficient-virtual-assistant-2018-859875/

Base on this report, Google assistant is the best virtual assistant right now, you might say not surprising. Yep but details are more interesting with this

 

 

If you take a look at the chart above, You'll see that there is small difference between google assistant on smartphones and google assistant on Google home, but what's more interesting is how bad siri actually is. Only 40% answers attempted ???? which is far below others like google and cortana or even alexa. 

In terms of fully and correctly answered questions, siri is doing better but it's still dead last which is not good news for those who bought Apple's $350 "Smart" speaker.

 

And for Apple fans out there wanting to say that the sample size was not big enough:

 

They also have a chart which shows how many questions they got wrong and compares them with their last year score:

 

Again, siri is not doing great and it got worse compared to last year, even more interesting, Alexa got a lot worst. Personally i think it's because of it trying to answer more compared to last year.

Also cortana is doing great with the lowest percent of wrong answers.

 

 

 

Edit: I'm also interested to see Bixby next time and see how it does compared to others. Also i like to note that from my experience, Cortana on windows 10 has some problems with voice recognition and she hear things more wrong than others. I think MS need to work more on their voice to text conversion as well.

I call bs on cortana.

[suicidalfranco]

"it's not about who's best, it's about the ecosystem"

 

- Apple fanboys coming soon in this thread

 

EDIT: would love to see Mycroft on that chart, just to get an introspect of it's evolution YoY and see how does a open source, community powered idea evolves in time compared to the rest of the industry.

[Red Hardware]

4 hours ago, suicidalfranco said:

"it's not about who's best, it's about the ecosystem"

 

- Apple fanboys coming soon in this thread

 

EDIT: would love to see Mycroft on that chart, just to get an introspect of it's evolution YoY and see how does a open source, community powered idea evolves in time compared to the rest of the industry.

lol

siri will give them better answers because they are in the "ecosystem"  

and yep i like to see other assistants in there as well since their sample size way bigger than a youtube video that compares them.

[Red Hardware]

5 hours ago, <Aleks> said:

I call bs on cortana.

I'm surprised by that as well

[Trixanity]

I tend to agree about the dubious Cortana results. Microsoft's search engine barely works and that's regardless of whether you talk search on Windows or search on Bing. Both suck and don't provide accurate results. 

If basic search doesn't work then how would advanced queries work? 

[Commodus]

The study is fairly obvious, I'd say... Siri needs work, and Apple knows it (they've been on a huge hiring spree).

 

With that said, there are some places where Siri does better.  It's much, much nicer for home automation, for example: Siri and HomeKit can invoke very specific scenes with just a short code phrase.  You could say "evening" and it would turn your living room lights to 60 percent at a certain color, your kitchen to 50 percent at another color, your thermostat to 72F... you get the idea.

 

Google, meanwhile?  Let's put it this way: they've just started adding similar routines, and issuing a command to turn your lights white turns them... yellow.  It's as if no one at Google ever bought a Hue bulb kit and tried to use Assistant with it.

[Red Hardware]

6 minutes ago, Commodus said:

The study is fairly obvious, I'd say... Siri needs work, and Apple knows it (they've been on a huge hiring spree).

 

With that said, there are some places where Siri does better.  It's much, much nicer for home automation, for example: Siri and HomeKit can invoke very specific scenes with just a short code phrase.  You could say "evening" and it would turn your living room lights to 60 percent at a certain color, your kitchen to 50 percent at another color, your thermostat to 72F... you get the idea.

 

Google, meanwhile?  Let's put it this way: they've just started adding similar routines, and issuing a command to turn your lights white turns them... yellow.  It's as if no one at Google ever bought a Hue bulb kit and tried to use Assistant with it.

Are you sure?

As i know, google home and amazon alexa work really well with smart home systems and there are a lot more devices out there that support google assistant and amazon alexa.

And again as i saw on YouTube, you can do all you said about siri with Google assistant as well. I really don't get why you are saying that Siri is better with smart homes

[Tech_Dreamer]

The real shocking part of this is hearing cortana being second over Alexa.

[Guest]

This wasn't very objective testing tbh. If you look on their website whether they judge an answer is wrong is pretty subjective. 

 

You can't really conclude much from this. 

[iamdarkyoshi]

To be fair, siri is pretty useless

 

 

Here's one I encountered on my own mac:

 

[NoOverflow]

Google assistant on smartphone is pretty good. Only complains is sometime it won't unlock my phone when i say "Okay Google"

If i'm gonna buy a personnal assistant one day it's gonna be a Google Home

Not gonna buy Alexa for political reasons (she's a SJW)

[DrMacintosh]

1 hour ago, iamdarkyoshi said:

To be fair, siri is pretty useless

Siri on Mac is very different from Siri on Apple Watch, iOS, and HomePod. They are all different from each other and are designed to do different things. 

(I have a gif but the forum doesn't work for anything)

 

[Cyberspirit]

I still don't see the point of voice assistants but, then again I never used one.

They are not available in Hungary because I guess a Hungarian person can't speak any other language. 

[Guest]

1 hour ago, iamdarkyoshi said:

To be fair, siri is pretty useless

 

<Snep>

 

Here's one I encountered on my own mac:

<Sn1p>

 

To be fair most users just click on the App Store icon. Apple most likely gets feedback on most asked questions and goes from there to work into Siri. iPhones are targeted at a much more user friendly audience than Android it's not really necessary to incorporate some of these functions due to lack of popularity. 

 

[Commodus]

7 hours ago, Red Hardware said:

Are you sure?

As i know, google home and amazon alexa work really well with smart home systems and there are a lot more devices out there that support google assistant and amazon alexa.

And again as i saw on YouTube, you can do all you said about siri with Google assistant as well. I really don't get why you are saying that Siri is better with smart homes

Yes, but mainly because I'm in the unusual position of having actively used all three for long periods.

 

Here's the thing: up until recently, Google Assistant was basically limited to "shortcuts" based on single phrases.  You could tell it to turn all your lights to 80 percent, for instance, but you couldn't easily tell it to perform complex actions (multiple lighting levels, throw in smart appliances at the same time, that sort of thing).  Routines add that functionality.

[JoostinOnline]

I can't use Google assistance. "Okay, Google" is a horrible activation phrase. I stumble saying it. They should be a single word, preferably a unique name.

 

[SpaceGhostC2C]

To me, this reads like "Best 3D monitor is X, worst is Y"  

[GoldenLag]

3 hours ago, JoostinOnline said:

I can't use Google assistance. "Okay, Google" is a horrible activation phrase. I stumble saying it. They should be a single word, preferably a unique name.

 

What else would it be that you dont stmble upom by accident that is also rememberable and linked to google?

[Linus_torvalds]

"Siri" like you sound when you read it in my native language means dick Apple knew about this and they wrote that they know but won't change it. Good for them because after asking questions their assistant really is "siri"

Google has so much information that there is no doubt their assistant is the best in answering questions.

[Not_Jony_Ive]

 

Good news everybody. Take a look at our next generation macbook pro.