Free Open-Source Artificial Intelligence

2886 readers

1 users here now

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

founded 1 year ago

MODERATORS

submitted 9 months ago by [email protected] to c/[email protected]

13 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 0 points 9 months ago (10 children)

I have tried the version available at hugginchat and it's almost gpt4 level for programming tasks but not so much for general knowledge

[–] [email protected] 0 points 9 months ago (2 children)

Do you know if there are any plans to quantize it? I'd love to test it, but my 3090 can't handle 70b models without quantization, unfortunately.

[–] [email protected] 0 points 9 months ago

There are quantized versions on hugging face. There's a q2 version, but idk how well that performs

load more comments (1 replies)

load more comments (8 replies)