@rmader@floss.social
@rmader@floss.social avatar

rmader

@rmader@floss.social

Mostly #wayland stuff around #gnomeshell, #gstreamer, #Firefox, #Pipewire, #libcamera, #linuxmobile - https://floss.social/@collabora

Generally thing that make the Linux desktop use graphics hardware features. And sometimes random boosts.

Based in Berlin.

Member of the German green party.

This profile is from a federated server and may be incomplete. Browse more on the original instance.

rmader, to firefox
@rmader@floss.social avatar

enables by default \o/

Let's hope it sticks 🤞

https://phabricator.services.mozilla.com/D189367

rmader, to random
@rmader@floss.social avatar

So we'll have a neat little camera indicator in .

It will only show up for apps that use for camera access so we depend on more apps switching to that.

During the "State of the Shell" talk I was asked what incentives there are for app developers to do so and unfortunately I messed up to make the probably most convincing ones, so short 🧵

  1. support for modern cameras via (as opposed to only / UVC cameras).

rmader, to GNOME
@rmader@floss.social avatar

I'll also be at and do a short talk about video offloading related stuff I've been posting about, featuring , , and

https://fosdem.org/2024/schedule/event/fosdem-2024-3557-the-state-of-video-offloading-on-the-linux-desktop/

See you there!

rmader, to firefox
@rmader@floss.social avatar

If you use on you might know the privacy indicator. Yeah, that little floating window that's supposed to be "always-on-top" and positioned at the top of the screen, just that it isn't because on Wayland we don't want apps to have the power to do such things by themselves. The one that mostly duplicates stuff that's provided by your DE already, informing you that you're sharing the screen.

So we finally disabled it on Wayland: https://bugzilla.mozilla.org/show_bug.cgi?id=1668358

You're welcome.

rmader, to RaspberryPi
@rmader@floss.social avatar

The 5 is here and like its predecessor it supports decoding and displaying H.265 in 4K@60fps.
Some of you may wonder: does that really work on a modern / desktop? If my laptop fan starts spinning when playing such content, how can the PI handle it?

Here I'd like to draw your attention to a pretty cool feature we just introduced in - support for YCbCr or YUV pixel formats in the system compositor (Mutter).

Short 🧵

rmader, to linuxphones
@rmader@floss.social avatar

#postmarketOS just landed the last MR needed to make the #libcamera + #PipeWire camera stack work on the #Librem5 and #PinePhone by default, using the new software ISP shipped in libcamera 0.3.
So if you have such a device: just update and go install apps like Snapshot, Warp, Decoder etc. You can even use it with Firefox and - very soon - Chromium.

Note that this does not replace #megapixels or #millipixels - those continue to be the default camera apps.

rmader,
@rmader@floss.social avatar

Note that with all of this in place, camera support on a lot of other devices is in close reach. For example the and should only need kernel patches enabling the camera sensors. The softwareISP should then - at least in theory - "just work". Well, fingers crossed :)

P.S.: the one device where this already worked is the - but until recently it broke audio. That was also fixed in the process.

rmader, to GNOME
@rmader@floss.social avatar

Got the last bug fixed to make play video with overlay in full zero-copy / hardware plane only mode \o/

This allows highly efficient playback with e.g. subtitles and other overlays, only using the GPU when GTK needs to repaint parts of the main window / the overlay.

I'll talk more about this at my presentation at , see https://fosdem.org/2024/schedule/event/fosdem-2024-3557-the-state-of-video-offloading-on-the-linux-desktop/

The video shows a weston desktop. The gtk4 video player demo is launched, a video started and put into fullscreen. The camera moves to a second screen where weston debug output is printed, showing that weston indeed uses a cursor, overlay and primary plane (and no rendering / compositing) to display the video and overlay (and thecursor).

rmader, to random
@rmader@floss.social avatar

Just found out that on one can add a + to an issue or MR link, making the preview show the whole title. I.e. instead of "" you get "Some thing is broken ()" - if you write "+"

So if you don't know, now you know 🤷

rmader, to firefox
@rmader@floss.social avatar

116 can finally be build without dependencies / only \o/

ac_add_options --enable-default-toolkit=cairo-gtk3-wayland-only

https://bugzilla.mozilla.org/show_bug.cgi?id=1833855

I hope we'll also get Mutter/ over the line for 45

Not having to deal with X11 is especially nice on

rmader, to GNOME
@rmader@floss.social avatar

My presentation about video offloading is online. If you are interested, you can watch it here: https://fosdem.org/2024/schedule/event/fosdem-2024-3557-the-state-of-video-offloading-on-the-linux-desktop/

I'm happy about feedback, both on the technical side as well as how I can improve doing presentations :)

rmader, to linuxphones
@rmader@floss.social avatar

For those of you interested in our recent video offloading / zero-copy playback work: I quickly put together some s to make it easy to test stuff already. Compositor offloading should work on all semi-recent Intel/AMD and a variety of ARM64 devices.

If you trust the sandbox you can get them here:
https://cloud.silentundo.org/s/r8733siTjP4yRJp

I expect quite a few people hitting driver bugs, so please help tracking those down :)

A picture of a PinePhone Pro easily and smoothly playing a 4k@60fps VP9 video.

rmader, to linuxphones
@rmader@floss.social avatar

Just want to quickly share with folks that the new softwareISP does indeed work with the - and with a + pipeline. Here's a first image running Warp (from Flathub).

There's still some stuff to iron out to make this work reliably and ship to users - but things are falling into place.

rmader, to GNOME
@rmader@floss.social avatar

What I really like about is that it turned out to be a really good release for old and low-end devices. One of my test devices is Thinkpad T400. That hardware is over 15 years old and is has actually got faster over the last few years - especially this release.

One of my favorite improvements here, headed by Christian Hergert, was the boost to VTE. Terminals using are now much faster and responsive. I mean, damn, even switching tabs doesn't trigger a full redraw!

A video of Gnome-Console running on a Thinkpad T400. The Mutter damage overlay is enabled, showing that updates to the content only updates the areas that actually change - even when switching tabs.

rmader, to GNOME
@rmader@floss.social avatar

My Mutter MR to support scaling and cropping via KMS landed in time for

https://gitlab.gnome.org/GNOME/mutter/-/merge_requests/3177

I'm really happy about this one because it should improve things for multiple use-cases:

  1. It allows full hardware offloading of fullscreen video playback for cases when the video dimensions don't perfectly match the screen, i.e. up- or downscaling. There are not many clients supporting this yet - but hopefully we'll see more soon, especially ones.

Short 🧵

rmader, to random
@rmader@floss.social avatar

For folks: just found out about https://wayland.app/protocols/ - quite neat!

rmader, to GNOME
@rmader@floss.social avatar

Just watched Sintel in 4K using display hardware YUV->RGB conversion and scaling on Mutter with - no 3D GPU usage (no shaders, no compositing) and also very littly CPU usage (video decoding done by VAAPI) and thus very power efficient.

We are finally getting there - unleash the power of :P

If you're interested in the technical progress or want to try: https://gitlab.gnome.org/GNOME/mutter/-/merge_requests/3177
https://github.com/mpv-player/mpv/pull/12237

rmader, to linuxphones
@rmader@floss.social avatar

I'm incredible happy that we finally landed YUV support for . It'll allow us to make video players much more efficient in many cases (like or , but also regular laptops/desktops) and especially make developing such features more pleasant on the desktop. I'll write more in detail about it soon.

Thanks goes to @collabora for allowing me to work on it during my work hours and to @jadahl and some other devs for helping pushing it over the line!

rmader, to GNOME
@rmader@floss.social avatar

For app folks: IMHO we need to think about what to do with Totem / Gnome Videos. It has not yet been ported to , which is increasingly becoming an issue.

Apart from not fitting nicely UI wise, it prevents us from using the newly introduced hardware offloading (zero-copy playback) and, crucially, from (properly) supporting HDR content going forward.

I.e. we either need a port - or should consider making an alternative a core app to focus on.

Short 🧵

rmader, to GNOME
@rmader@floss.social avatar

Regarding the future of video playback in I'd like to add some more context around current developments in , and in a short 🧵

TL;DR: by making use of more modern hardware features we're finally in the position to catch up to other platforms with regards to energy efficiency. So let's do it!

rmader, to firefox
@rmader@floss.social avatar

with the patches will now use (and thus ) by default, allowing cameras to work out-of-the-box on distros shipping that patchset (well, assuming the camera works with libcamera of course).

https://gitlab.com/postmarketOS/mobile-config-firefox/-/merge_requests/38

rmader, to linux
@rmader@floss.social avatar

Friends of energy efficiency - the Light Video 0.1.0 update is out, build with 4.14 and 1.24.1.

This should be the first app targeting the / FDO desktop enabling Wayland video offloading (think zero-copy playback) by default. In many cases (actually more than I expected) this can improve battery lifetime - and on low-end devices even playback performance - significantly.

https://flathub.org/apps/org.sigxcpu.Livi

rmader, to GNOME
@rmader@floss.social avatar

For those who like me find themselves often listening radio on youtube during work - lofi stuff in my case - I can really recommend giving a try. If you search for a genre, chances are high that you get like 5-10 stations to choose from. And using a dedicated radio app has a bunch of benefits in different domains.

rmader, to linuxphones
@rmader@floss.social avatar

@dino 0.4.3 just got released with some exciting improvements for

  1. Several fixes for touch input, making audio/video calls actually usable on phones
  2. Fixes for video support so devices with / support like the work now
  3. The app is now recognized as mobile friendly on
  4. Stricter sandbox - no device/all any more

The new version is available on and lots of distro repos.

rmader, to linuxphones
@rmader@floss.social avatar

If you want to follow the process of getting the (with softwareISP) + stack into place on - which will allow way more apps to use cameras on devices like the , (the was the first were it already kinda works) and hopefully many more devices in the future - then here's a meta issue you can subscribe to: https://gitlab.com/postmarketOS/pmaports/-/issues/2787

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • megavids
  • GTA5RPClips
  • thenastyranch
  • ethstaker
  • everett
  • Durango
  • rosin
  • InstantRegret
  • DreamBathrooms
  • magazineikmin
  • Youngstown
  • mdbf
  • slotface
  • tacticalgear
  • JUstTest
  • kavyap
  • modclub
  • cisconetworking
  • cubers
  • ngwrru68w68
  • khanakhh
  • tester
  • anitta
  • normalnudes
  • Leos
  • osvaldo12
  • provamag3
  • lostlight
  • All magazines
    •