Obsidian + LLM as an alternative to Notion AI?

Hey, I’m currently trying to get away from Notion to either Obsidian or Logseq. Currently it feels like I’m drifting towards Obsidian.

I only have one topic left on my list of “I would like to have that”: an alternative to Notion AI.

With Notion AI it’s possible to ask a question like “which books that I’ve read are talking about the history of mankind and how are these related to each other?” and it’ll search your documents and give you an answer. This works really good. Downside of Notion is that you don’t earn your files and that of course the AI model is scanning all your stuff for this when you use it.

I’ve seen that there are some add-ons for Obsidian that support AI but I haven’t really achieved anything good yet. My try was to set up Ollama on my Linux computer and connect it to some Obsidian plugin (not sure about the name right now unfortunately). As a model I was using Llama3 (the small one since the big one is too heavy for my laptop with NVIDIA GPU).

That in fact works but the results are…meh. It kinda leaves out 80% of what would be relevant and thus isn’t really helpful.

Is it somehow possible to achieve something like an alternative to Notion AI in Obsidian, that can do more than “complete this text for me”?

borari, (edited )

If you have a 30- or 40- series Nvidia card you can probably use ChatRTX to do what you’re asking. It uses Nvidia-trained models with all your content staying local. It does require Windows 11 though, and while the site doesn’t specifically say it supports .md files it does say it supports .txt files, so I don’t see why it wouldn’t work.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • obsidianmd@lemmy.world
  • ngwrru68w68
  • rosin
  • GTA5RPClips
  • osvaldo12
  • love
  • Youngstown
  • slotface
  • khanakhh
  • everett
  • kavyap
  • mdbf
  • DreamBathrooms
  • thenastyranch
  • magazineikmin
  • megavids
  • InstantRegret
  • normalnudes
  • tacticalgear
  • cubers
  • ethstaker
  • modclub
  • cisconetworking
  • Durango
  • anitta
  • Leos
  • tester
  • provamag3
  • JUstTest
  • All magazines