dlakelan

dlakelan, 7 hours ago

@GhostOnTheHalfShell
Your biggest issue is running MariaDB on the same machine and having it take up RAM. It's very reasonable for a 32GB machine, doable with 16 but maybe not a great idea with 8GB.

Your best bet is a CONNECT table https://mariadb.com/kb/en/connect-csv-and-fmt-table-types/

dlakelan, 6 hours ago

@GhostOnTheHalfShell
The less traditional stats you know the better 😉.

Don't add the datasets to the git repos, too big! But a script to do the download and extraction would help document what we downloaded and help anyone who wants to replicate.

git add, git commit, git push, and git pull are the most important getting started commands.

Did you get VSCodium and the Julia extension? I'll write a quick getting started notebook tomorrow you can use as a template for sorting and plotting

dlakelan, 5 hours ago

@GhostOnTheHalfShell

MacOS version of codium

https://github.com/VSCodium/vscodium/releases/download/1.88.1.24104/VSCodium-darwin-x64-1.88.1.24104.zip

You can get the Julia extension from the extension manager. I recommend codium because of the Julia extension, which nicely captures plots, reads and edits Jupyter notebooks, and has debugger and data inspector for Julia objects etc

dlakelan, 5 hours ago

@GhostOnTheHalfShell
Stats is like Econ, it's full of bog standard stuff in all the textbooks that is wrong.

Not math wrong, just inappropriately applied with bad assumptions.

If it involves tests or p values feel free to avoid any of that. For now focus on making good plots of interesting facts.

dlakelan, 5 hours ago

@GhostOnTheHalfShell
Here's an example of interesting question, what's a typical ratio of rent+utilities to mortgage+utilities in each county each year. To make that ratio you need to decide on households you can compare. Probably match county, year, household size, then randomize them and form the ratios and histogram that.

dlakelan, 5 hours ago

@GhostOnTheHalfShell
I think the ACS has an estimate of taxes paid on income? So another one would be distribution of the ratio of annual income minus taxes to annual rent+utilities, and you could split out by household size.

Don't expect you to be able to just do these manipulations right straight off but your coding background is gonna make it pretty easy for you to read documentation and examples and work out how to do what you need I'm pretty sure.

dlakelan, 5 hours ago

@GhostOnTheHalfShell
Richard McElreath's "Statistical Rethinking" is my recommendation.

I started putting together some example stuff for videos here

https://github.com/dlakelan/JuliaDataYouTube

But then opted out of the YouTube ecosystem. Thinking of doing them on my own PeerTube instance instead.

dlakelan, 4 hours ago

@GhostOnTheHalfShell
I don't think you can track families in the ACS data. Maybe each family is interviewed twice? But it might just be once.

Yeah questions like the ones you raise are good. Sometimes we just start simple and add complexity. Sqft is not available I think, but house type might be (single family, townhouse, trailer, whatever). A good place to start is the data dictionary they give you in the ZIP file (I think it's included?). Understand what's been collected first.

dlakelan, 4 hours ago

@GhostOnTheHalfShell
I've got a gigabit connection and PeerTube distributes the videos via BitTorrent so it might be ok to run it out of my closet. But yeah, Archive.org is good stuff I love them.