Technology

1148 readers

59 users here now

A tech news sub for communists

founded 2 years ago

MODERATORS

[email protected]

Baidu joins open-source movement by making Ernie 4.5 models publicly available (www.scmp.com)

submitted 1 day ago* (last edited 1 day ago) by [email protected] to c/[email protected]

2 comments fedilink hide all child comments

https://archive.ph/oCCx9

https://yiyan.baidu.com/blog/posts/ernie4.5/

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 5 points 1 day ago (1 children)

Nice of them to make even a 0.3B model, just too bad it was the only one that wasn't MoE. I've been wanting more small MoEs since Qwen 30B A3B.

[–] [email protected] 5 points 1 day ago

On a random note, I'd really love to see this approach explored more. It would be really handy to have models that can learn and evolve over time through usage https://github.com/babycommando/neuralgraffiti