this post was submitted on 27 Nov 2024
0 points (NaN% liked)

Firefox

20257 readers
7 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 5 years ago
MODERATORS
 

They support Claude, ChatGPT, Gemini, HuggingChat, and Mistral.

top 20 comments
sorted by: hot top controversial new old
[–] [email protected] 0 points 7 months ago (1 children)

I don't understand the hate. It's just a sidebar for the supported LLMs. Maybe I'm misunderstanding?

Yes, I would prefer Mozilla focus on the browser, but to me, this seems like it was done in an afternoon.

[–] [email protected] 0 points 7 months ago (1 children)

I want my browser to be a browser. I don't want Pocket, I don't want AI, I don't want bullshit. There are plugins for that.

[–] [email protected] 0 points 7 months ago (1 children)

that's the great thing: you don't have to use it

[–] [email protected] 0 points 7 months ago (1 children)

But Firefox wastes time developing that instead of fixing 20 years-old bugs.

[–] [email protected] 0 points 7 months ago (1 children)

i know it is an unpopular opinion around here. but currently AI features open doors for sales. that is important.

for the software i help develop, we introduced an optional AI integration. just its presence allowed us to sell the main SW multiple times. the AI plugin was never sold so far.

investment AI: 2 weeks of gluecode. i am not concerned with finances, but that plugin is for sure net positive.

[–] [email protected] 1 points 7 months ago* (last edited 2 weeks ago)

deleted by creator

[–] [email protected] 0 points 7 months ago (1 children)

Thing is, for your average user with no GPU and whp never thinks about RAM, running a local LLM is intimidating. But it shouldn't be. Any system with an integrated GPU, and the more RAM the better, can run simple models locally.

The not so dirty secret is that ChatGPT 3 vs 4 isn't that big a difference, and neither are leaps and bounds ahead of the publically available models for about 99% of tasks. For that 1% people will ooh and aah over it, but 99% of use cases are only seeing marginal gains on 4o.

And the simplified models that run "only" 95% as well? They can use 90% fewer resources give pretty much identical answers outside of hyperspecific use cases.

Running a a "smol" model as some are called, gets you all the bang for none of the buck, and your data stays on your system and never leaves.

I've been yelling from the rooftops to some stupid corporate types that once the model is trained, it's trained. Unless you are training models yourself, there is no need for the massive AI clusters, just for the model. Run it local on your hardware at a fraction of the cost.

[–] [email protected] 1 points 7 months ago* (last edited 2 weeks ago)

deleted by creator

[–] [email protected] 0 points 7 months ago (1 children)

I wish I had telemetry on such features.

I really doubt a significant number of people use AI chatbots often enough that having it in a dedicated sidebar is worth it.

[–] [email protected] 0 points 7 months ago (1 children)

I wish I had telemetry

I'm sure they do as Mozilla is an ad company

[–] [email protected] 0 points 7 months ago (1 children)

This is apparently either not widely known or some people just like to shoot the messenger.

[–] [email protected] 0 points 7 months ago (1 children)

While you are not wrong your dislike of Mozilla is has more to do with your instance being anti west. I'm not sure I'm ready to side with lemmyml

[–] [email protected] 0 points 7 months ago* (last edited 7 months ago) (1 children)

I happen to know jwz personally, and he knows Mozilla intimately: he founded it. His dislike of Mozilla is pretty much the same as mine, and he is neither “anti west” nor anti liberal. We dislike Mozilla because it has lost its way from being a FOSS browser maintainer and a booster for & steward of an open web.

And I’m not “anti-West,” I’m anti-capitalist, anti-settler-colonialist, and anti-imperialist; and those happen to be things that “the West” presently embodies.

[–] [email protected] 1 points 7 months ago* (last edited 2 weeks ago) (1 children)
[–] [email protected] 0 points 7 months ago (1 children)

I’m pretty sure I know what the instance I admin does & doesn’t endorse, thanks.

[–] [email protected] 1 points 7 months ago* (last edited 2 weeks ago)

deleted by creator

[–] [email protected] 0 points 7 months ago (1 children)

as someone who's never dabbled with ai bots, what does this feature do? is it only to query for information like a web search?

[–] [email protected] 1 points 7 months ago* (last edited 2 weeks ago) (1 children)
[–] [email protected] 0 points 7 months ago* (last edited 7 months ago) (1 children)

It gives you many options on what to use, you can use Llama which is offline. Needs to be enabled though about:config > browser.ml.chat.hideLocalhost.

[–] [email protected] 1 points 7 months ago* (last edited 2 weeks ago)

deleted by creator