Throwaway4669332255

@Throwaway4669332255@lemmy.world

This profile is from a federated server and may be incomplete. Browse more on the original instance.

[Paper] The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits (huggingface.co)

From the abstract: “Recent research, such as BitNet, is paving the way for a new era of 1-bit Large Language Models (LLMs). In this work, we introduce a 1-bit LLM variant, namely BitNet b1.58, in which every single parameter (or weight) of the LLM is ternary {-1, 0, 1}.”...

Throwaway4669332255,

So are more bits less important than more paramters? Would a higher paramter or higher bit count matter more if the models ended up the same size?

Throwaway4669332255,

They said their’s is “comparable with the 8-bit models”. Its all tradeoffs. It isn’t clear to me where you allocate your compute/memory budget. I’ve noticed that full 7b 16 bit models often produce better results for me than some much larger quantied models. It will be interesting to find the sweet spot.

Throwaway4669332255,

Apparently I am an idiot and read the wrong paper. The previous paper mentioned that “comparable with the 8-bit models”

huggingface.co/papers/2310.11453

Throwaway4669332255,

I’m so glad I work for a medium-small company. We moved to a smaller office and only require to go in twice a month

Throwaway4669332255,

I am surprised reddit hasn’t removed this post yet.

I got an account banned for saying “lemmy dot world” when someone asked “Are there even any good alternatives?”

Throwaway4669332255,

Thank you! I had no idea this existed.

Throwaway4669332255,

Its a disturbing tend and more evidence to own physical copies.

Throwaway4669332255,

Sony choose to not offer refunds. Sony knew the contract when they agreed to sell the content. When something gets pulled from steam I can still download and install it.

Throwaway4669332255,

I got banned because I said “lemmy dot world” in reply to someone who said they wished reddit had an alternative.

Throwaway4669332255,

Jokes on you. I’m off for 4 days!

Throwaway4669332255,

At work we pay Microsoft thousands for developer licensees, have windows pro, and there is still ads in the OS… Windows exists to service them not us.

Throwaway4669332255,

I hope Mastodon succeeds but I don’t see it taking off like twitter did.

Throwaway4669332255,

Stuff like this will be used in the anti monopoly cases going on world wide.

Throwaway4669332255,

I love this channel so much

Throwaway4669332255,

Gamemaker is still focused on 2D. I also think its easier for people without programming experience and the design guides you more but is less flexible.

YouTube Says New 5-Second Video Load Delay Is Supposed to Punish Ad Blockers, Not Firefox Users (www.404media.co)

Firefox users are reporting an 'artificial' load time on YouTube videos. YouTube says it's part of a plan to make people who use adblockers "experience suboptimal viewing, regardless of the browser they are using."

Throwaway4669332255,

That might be hard unless they start requiring logins.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • JUstTest
  • mdbf
  • DreamBathrooms
  • modclub
  • tacticalgear
  • GTA5RPClips
  • magazineikmin
  • thenastyranch
  • Youngstown
  • InstantRegret
  • rosin
  • slotface
  • everett
  • kavyap
  • provamag3
  • cubers
  • ngwrru68w68
  • normalnudes
  • cisconetworking
  • Durango
  • khanakhh
  • Leos
  • ethstaker
  • tester
  • anitta
  • osvaldo12
  • megavids
  • lostlight
  • All magazines
    •