oatmeal,
@oatmeal@emacs.ch avatar

Trying to install rocm on Fedora 39 was really messy... containerized ollama with# rocm support was relatively easy to get running. Used this recipe from https://github.com/prawilny/ollama-rocm-docker/tree/master... only had to point at another repo for rocm itself, since the one used there does not exist anymore.

RUN git clone --recursive <https://github.com/jmorganca/ollama.git> ollama-rocm &amp;&amp; \  

Was able to pull models in, but it crashes on running any prompt.





harish,
@harish@hachyderm.io avatar

@oatmeal It’s so difficult and unpolished. (The AMD software stack in mean.)

Could you clarify what you mean by “another repo for rock itself?” I tried on Debian and crashed and burned so hard.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • emacs
  • kavyap
  • ngwrru68w68
  • osvaldo12
  • DreamBathrooms
  • mdbf
  • magazineikmin
  • thenastyranch
  • Youngstown
  • khanakhh
  • everett
  • slotface
  • tacticalgear
  • rosin
  • normalnudes
  • megavids
  • Leos
  • GTA5RPClips
  • ethstaker
  • InstantRegret
  • cubers
  • modclub
  • Durango
  • provamag3
  • cisconetworking
  • tester
  • anitta
  • JUstTest
  • lostlight
  • All magazines