hdkarlsen, 9 months ago to random

The birdplace seems to stagnate, so I'm jumping ship. A short #introduction to me: I'm an associate professor of psychology in 🇳🇴 and work on personality psychology and psychometrics. Really just as an excuse to nerd out about R.

ByrdNick, 29 days ago to psychology

We know that the task demands of cognitive tests most scores: if one version of a problem requires more work (e.g., gratuitously verbose or unclear wording, open response rather than multiple choice), people will perform worse.

Now we have observed as much in Large Language Models: https://doi.org/10.48550/arXiv.2404.02418

The tests included analogical reasoning, reflective reasoning, word prediction, and grammaticality judgments.

#cogSci #psychometrics #assessment #edu #psychology #AI #LLM #genAI

image/jpeg
image/jpeg
image/jpeg

ByrdNick, 9 months ago to psychology

Does #curiosity refer to just one thing?

There seem to be two (related) notions:

Curiosity1: goal-directed information seeking — e.g., following a string of citations to find the source of a particular claim.

Curiosity2: exploratory information seeking — e.g., watching whatever explainer video is recommended next, even if it’s about a different question or topic.

Metcalfe & Jacobs: https://doi.org/10.4324/9781003009351-6

#Psychology #PhilMind #PhilSci #Measurement #Psychometrics

image/png
image/png
image/png

pgmj, 1 year ago to random

New preprint on #psychometrics criteria for "valid & reliable" measures, and reporting guidelines https://doi.org/10.31219/osf.io/3htzc

Also, we present an #rstats package to simplify psychometric analysis with #Rasch and combine analysis code and documentation with #quartopub https://pgmj.github.io/raschrvignette/RaschRvign.html

bud_t, 8 months ago to random

I'd like to see an actual #validity argument for the CLT. I imagine it doesn't exist. #psychometrics

Florida accepts conservative and Christian-backed test as alternative to the SAT : NPR
https://www.npr.org/2023/09/10/1198638538/what-to-know-classic-learning-test-florida-sat-act-colleges

jrboehnke, 5 months ago to random

As a #PeerReview-er and #NightshiftEditor the software I most frequently recommend is actually FACTOR:
https://psico.fcep.urv.cat/utilitats/factor/Description.html

Reference: https://journals.sagepub.com/doi/10.1177/0146621613487794
Exploratory factor analyses remain a widely used tool in my research area. Most commercial software is really not great at it, and #Rstats may be too steep a learning curve (although I think one rarely regrets it 😅 ).

#HRQL #Psychometrics #EFA

odr_k4tana, 10 months ago to random

#psychometrics community: I found a paper that developed a short scale and tested it via #LPA and #kmeans clustering. (Paper here: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0281021). Now for me, this is odd as it uses two clustering techniques to assess scale quality. But then again this is a sociology paper and I know that sociologists and psychologists have a different world view. In case you didn't know: Sociologists tend to look at groups within society or societies at large, whereas psychologists tend to see individuals and groups as aggregates of individuals. Obviously, coming from a sociological perspective, using such clustering methods makes sense. However, I still have mixed feelings about this approach. I still feel a IRT approach would be better since obviously k-means and LPA does NOTHING to evaluate items, for example.

How do you see this? Am I completely wrong here?