josiah

@josiah@mapstodon.space

spatial stats @ esri
#rstats power nerd
wannabe #rustacean

This profile is from a federated server and may be incomplete. Browse more on the original instance.

josiah, to random

Valve: :rstat: belongs in production

Get started with {valve} and make your code fly!

https://www.youtube.com/watch?v=11FM-dxxi3M

josiah,

@jrosell which time?! 4secs should be the first run because plumber APIs haven’t all been spawned yet :)

brodriguesco, to random
@brodriguesco@fosstodon.org avatar

Found this on LinkedIn (haven't tested yet though): "Faucet is a new runtime for Plumber that enables async requests. Built with Rust, it guarantees the correct managment and distribution of HTTP requests across different Plumber workers."

https://youtu.be/1uXFe2fUYSA

Looks like the author is not on Mastodon. Link to github repo https://github.com/andyquinterom/Faucet

josiah,

@jrosell @brodriguesco @jospueyo huh, super interesting. Looks similar but using actix.

josiah,

@jrosell @brodriguesco @jospueyo took it for a spin performance difference is negligible.

faucet requires you to make a facuet specific entrypoint. faucet has debug logs built in which is nice! That's on my timeline. But it also pre-allocates plumper workers. So if theyre not being used they're eating up space. Compared to valve which spawns with only 1 worker and despawns them after an unsued amount of time.
He beat me to the video punch! But my video is gonna rock.

image/png

josiah,

@brodriguesco @jospueyo also has an R package for people who don’t use rust!!!

josiah,

@brodriguesco @jospueyo really got scooped today on my own tool! My video is being uploaded to youtube rn :P

josiah,

@brodriguesco @jospueyo
https://mapstodon.space/@josiah/110911047093200148

josiah, to random

Goodness me! 20x smaller Docker 🐳 image for {valve} 🪠 !
Going to be updating Docker templates and work on an :rstat: -helper function to create Docker images for valve / plumber apps.

This image with valve is smaller than rocker/r-base :O

the r-minimal image is seriously so small!!

josiah,

@jrosell oh that’s up to you! This is based on a Docker image :) not base R

josiah,

@mdsumner I haven’t pushed the updated Dockerfile yet. Weathers bad and Powers out rn so idk when I’ll push. 🤣

josiah,

@mdsumner this is the Dockerfile that is super smol. The challenge i foresee is that pak doesn’t have system requirements for alpine Linux

josiah, to random

🪠 Valve + 🐳 Docker + 🌊 DigitalOcean

make R :rstat: & {plumber} go brrrrrrrrrr

Live example: https://plankton-app-ozvgy.ondigitalocean.app

Docs: https://valve.josiahparry.com/articles/deploy-with-digitalocean

josiah, to rust

I wonder what I did to make this be the first suggestion by VS Code. It is certainly not a real associated function.

josiah,

@ilmai lol it looks like it might be!

coolbutuseless, to random
@coolbutuseless@fosstodon.org avatar

Work-in-progress: New JSON library

Early results on a microbenchmark look promising!

Fastest JSON parser for R?

Note: Benchmark is not be indicative of real-world use cases. Performance gap narrows on larger examples.

Output of code benchmarking new JSON parser. Results show new parser is faster than jsonlite and RcppSimdJson on this microbenchmark.

josiah,

@krzysztof_dyba @coolbutuseless holy smokes Batman. What wizardry is this? 2 questions: is there int64 support like RccpSimdJson? And is it possible to return NAs in data frames instead of NULL?

josiah,

@coolbutuseless See the example with iris at https://fosstodon.org/@coolbutuseless/110795041340566647

only RcppSimdJson has NA in the data

andrie, to rust
@andrie@fosstodon.org avatar

CRAN has published a policy for using code in an package. https://cran.r-project.org/web/packages/using_rust.html

josiah,

@brodriguesco @jonthegeek @andrie it makes it almost impossible to publish rust based packages on CRAN. Polars will never be on CRAN with this policy. This is like saying you have to include the source code for all R packages you depend upon (and their deps) inside the tarball of your R package. It’s 100% unreasonable and untenable

josiah,

@jonthegeek @brodriguesco @andrie they can, though, choose to vendor their own “trusted” cargo crates but that would be silly. A better solution would be to only allow crates directly from crates.io limiting what internet conns are available during build time (which I think they already do?)

josiah,

@jonthegeek @brodriguesco @andrie another way of thinking about this is like not being able to get your dependencies from CRAN and having CRAN handle them. They’re essentially saying they will not use the Rust package manager

josiah,

@jonthegeek @brodriguesco @andrie at the end of the day this is a bad move for the health and longevity of R as a language. Rust in R packages will be as revolutionary, if not more, than Rcpp is/was.

josiah,

@jonthegeek @andrie @brodriguesco you’d have to create an entirely new build process for rust crates that isn’t supported by rust. Seems untenable imo

josiah,

@andrie @jonthegeek @etam @brodriguesco “Source package tarballs should if possible not exceed 10MB” is the part of the CRAN policy that makes this reallyyyy challenging

shunley42, to random

Dumb grooming question for people with facial hair:

Is it easy to shave around a beard with a manual razor? I've always used an electric razor because it's easy to maintain my beard. But I want a closer shave, so I'm thinking about a manual razor.

josiah,

@shunley42 it is indeed easy! Ive thought about getting one of those foil razors for this

josiah, to random

I've got covid so I don't get to go do fun things this weekend. Strongly considering making a new youtube video.

What non-tidyverse topics are y'all interested in?

Something geospatial? Something rusty? Something advanced R?

josiah, to random

I just really want to write Rust but im busy at a conference or something like that

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • megavids
  • tacticalgear
  • DreamBathrooms
  • osvaldo12
  • mdbf
  • everett
  • magazineikmin
  • khanakhh
  • Youngstown
  • rosin
  • slotface
  • modclub
  • kavyap
  • tester
  • JUstTest
  • ngwrru68w68
  • thenastyranch
  • cisconetworking
  • Durango
  • ethstaker
  • InstantRegret
  • Leos
  • anitta
  • GTA5RPClips
  • normalnudes
  • cubers
  • provamag3
  • lostlight
  • All magazines
    •