Firefox

The survey design accounts for this. See https://lemm.ee/comment/13835466.

That's why they did it in sets of three. They could just give every user a blank text box for every option, but doing it this way makes it far easier to analyze the data in bulk.

Product managers know what KPI's they want to improve, and its almost never survey sentiment results. The survey will be used to justify projects that improve the KPIs they already have. Best case scenario it helps them choose what to work on first, worst case (and most likely) it doesn't matter what the survey says - it's engineered to justify a pet project.

i.e. Straight out of "how to lie with statistics" - Would you rather drink bleach or add in browser advertisements based on privacy respecting AI categorization of you browsing behavior? ..... The people have spoken and they OVERWHELMINGLY want more monetization in their browser.

Which do you prefer:

( ) browser twice as fast

( ) women find you irresistible

hi we're the marketing team and we already decided what we want to do, and we can make up whatever data you want to see for us to justify it!

Which of these options do you prefer:

( ) having an AI assistant integrated into the browser

( ) getting kicked in the balls by elon musk

For me that was together with

A privacy-respecting AI assistant that makes your browser smarter by learning how you use it

So I don't really care how slow the browser is, as long as it doesn't have an AI "assistant" that is monitoring my browser usage

It's an Inferred importance method, as other users have commented it is likely that there are some calibration metrics in there. MaxDiff is the name of the approach if you want to check out more.

Wait, I swear mine said twice as fast. Well I guess I got filtered then. Lol

Control question probably, to check if you actually read the questions.

I don't know if the survey questions are loaded, but it feels like they could easily be misinterpreted.

For example, somebody might rank the "organize toolbar buttons and AI chatbots" even if they hate AI's snake oil, and now Mozilla has a data point where they can say "Some of our respondents said they want AI as much as side tabs!"

This seems especially sketchy when the side tab idea came directly from a vocal portion of Mozilla users, while the decision to follow the AI chatbot trend was decided by the same management that overpays their CEO every year.

This is fairly standard survey design, I believe. They're not looking to know which features are wanted in general; they want to know their relative popularity. The sets you're presented are randomised (i.e. we don't all get to see the same sets), which allows them to get a ranked list of lots of potential features, while only having to run ten survey questions per participant.

If you get a set with three features that everyone likes or dislikes at about the same level, then it doesn't really matter want you answer: they'll all end up at the top or bottom of the list, respectively. Because each of those options also get presented as part of different sets to different users, where different answers can win out.