gael, (edited ) French
@gael@mastodon.social avatar

Imagine a running locally on a smartphone...

It could be used to fuel an offline assistant that would be able to easily add an appointment to your calendar, open an app, etc. without issues.

This has come to reality with this proof of concept using the Phi-2 2.8B transformer model running on /e/OS.

It is slow, so not very usable until we have dedicated chips on SoCs, but works (and !)

🙏 Stypox

on 👇 👇 👇

owzim,
@owzim@mastodon.social avatar

@gael I'd say before that happens, running an LLM on your local network is your best bet. Projects like https://ollama.com/ make that incredibly easy. #llm #ollama

essentiel,
@essentiel@mastodon.social avatar

All these actions are so so soooo difficult to do manualy! That's a perfectly reasonable motive to add yet another chip, burn some more ressources, use more energy 🙄
@gael

safonas,
@safonas@mastodon.social avatar

@gael add crowdsource training for actions it can perform via assistant api, similar to r1 and we'll have our first OSS assistant... OSSistant? 😁

realsimon,
@realsimon@mastodon.green avatar

@gael lots of potential :ablobcatheart: Especially if it can access third party apps so I can say stuff like 'send [filename] to [contact] via [messenger]'

gael,
@gael@mastodon.social avatar

@realsimon yes, lots of potential!

lutindiscret,
@lutindiscret@mastodon.libre-entreprise.com avatar

@gael speechtotext en français pour pouvoir dicter mes messages et retranscrire les messages vocaux que je reçois bientôt dans /e/ ?

  • All
  • Subscribed
  • Moderated
  • Favorites
  • llm
  • ngwrru68w68
  • rosin
  • GTA5RPClips
  • osvaldo12
  • love
  • Youngstown
  • slotface
  • khanakhh
  • everett
  • kavyap
  • mdbf
  • DreamBathrooms
  • thenastyranch
  • magazineikmin
  • anitta
  • InstantRegret
  • normalnudes
  • tacticalgear
  • cubers
  • ethstaker
  • modclub
  • cisconetworking
  • Durango
  • provamag3
  • tester
  • Leos
  • megavids
  • JUstTest
  • All magazines