Author
|
Topic: reliability and validity: What's the difference
|
janfromthebruce
rabble-rouser
Babbler # 14090
|
posted 27 October 2008 10:28 AM
Earlier this am I was working on posting a response in the thread concerning vapidity. Got called away and when I went to post, the thread was closed.The debate had turned into the reliability and validity of measurement and so this was the post I wanted to put in for what it is worth. Let's look at reliability and later the validity of the "measures" used to ascertain both in proving which is more reliable and valid measure of vapid. quote: If you google "she is vapid" and "he is vapid"
AND quote: 'he is vapid' produces 213,000 more hits than for 'she is vapid'.
Really folks this appears to be the argument. Reliability and Validity: what's the Difference quote: Reliability is the consistency of your measurement, or the degree to which an instrument measures the same way each time it is used under the same condition with the same subjects,
and is an estimate. There are two ways that reliability is usually estimated: test/retest and internal consistency.Coming from a stats point of view, when using and not using " marks around words "he is vapid" or "she is vapid" in comparison to using no quotation marks actually shows "a lack of internal consistency." In other words, the instrument of measure "the use of quotation marks" is NOT reliable measure of these concepts, as removing the quote marks shows a complete different "estimate." Concerning validity, as suggested in the reference page, "involves the degree to which one is measuring what one is supposed to, more simply, the accuracy of the measurement. I believe the the combined words have validity in the assertains stated here: he is vapid and she is vapid, but the internal consistency is lacking because inserting quotes or no quote marks should show internal consistency and don't. Unionist you were trying to assert that only this reliability measure was valid, but Test/Retest, is the more conservative method to estimate reliability. Essentially what Remind showed was that your "measurement" lacked "internal consistency." She used a different grouping (no quote marks) to measure the same concepts of he is vapid and she is vapid. The difference in numbers of responses in the Google search for both genders did not generate a high correlation and thus lacks reliability. I hope that made sense, and just wanted to move from a personal debate.
From: cow country | Registered: Apr 2007
| IP: Logged
|
|
|
|
|
|
|
|
|
|
|
M. Spector
rabble-rouser
Babbler # 8273
|
posted 27 October 2008 11:38 AM
quote: Originally posted by RosaL: I have to agree with that. I also think Sarah Palin is vapid.
I don't agree with that. Some of her statements are vapid, but I don't think that adjective applies to her as a person. It means dull, or lacking in liveliness.P.S. That's another reason why Googling "she is vapid" is beside the point. The original reference to which that thread pointed was a reference to Alice Klein's "rhetorical vapidity", which is very different from saying Klein herself is "vapid". That's why I did a Google search on "rhetorical vapidity" (with the quotes, natch) and showed that, on the internet at least, that phrase was not an anti-female trope. [ 27 October 2008: Message edited by: M. Spector ]
From: One millihelen: The amount of beauty required to launch one ship. | Registered: Feb 2005
| IP: Logged
|
|
|
|
|
janfromthebruce
rabble-rouser
Babbler # 14090
|
posted 27 October 2008 12:05 PM
quote: Originally posted by M. Spector: I don't agree with that. Some of her statements are vapid, but I don't think that adjective applies to her as a person. It means dull, or lacking in liveliness.P.S. That's another reason why Googling "she is vapid" is beside the point. The original reference to which that thread pointed was a reference to Alice Klein's "rhetorical vapidity", which is very different from saying Klein herself is "vapid". That's why I did a Google search on "rhetorical vapidity" (with the quotes, natch) and showed that, on the internet at least, that phrase was not an anti-female trope. [ 27 October 2008: Message edited by: M. Spector ]
And I googled rhetorical vapiditywithout quotes to see if it had internal consistency, and guess what it did!
From: cow country | Registered: Apr 2007
| IP: Logged
|
|
|
oldgoat
Moderator
Babbler # 1130
|
posted 27 October 2008 12:12 PM
quote: Originally posted by janfromthebruce:
I still am oldgoat and so are you.
Well yes, very true. Just a brief note of explanation and I'll no longer bother the mathematically competent. In grade school, I was lousy at math, and in high school it became a real full blown phobia. Combined with other things going on in my life, it caused me to never actually pass grade 10. When I finally made it to university years later as a mature student I found I needed to take stats if I wanted to get an MSW, but I might as well have tried to learn to fly. Oddly enough I managed research methodology ok, which uses math differently.
I ended up doing the same sort of stuff anyway, but through a more roundabout route and with a history degree. So carry on with your serious discussion. 
[ 27 October 2008: Message edited by: oldgoat ]
From: The 10th circle | Registered: Jul 2001
| IP: Logged
|
|
|
unionist
rabble-rouser
Babbler # 11323
|
posted 27 October 2008 12:41 PM
quote: Originally posted by janfromthebruce: Unionist you were trying to assert that only this reliability measure was valid, but Test/Retest, is the more conservative method to estimate reliability. Essentially what Remind showed was that your "measurement" lacked "internal consistency." She used a different grouping (no quote marks) to measure the same concepts of he is vapid and she is vapid. The difference in numbers of responses in the Google search for both genders did not generate a high correlation and thus lacks reliability.I hope that made sense, and just wanted to move from a personal debate.
Hi jftb, just noticed your post for the first time. You're mistaken. Remind's search was meaningless and measured nothing. Why is this not obvious??
From: Vote QS! | Registered: Dec 2005
| IP: Logged
|
|
|
janfromthebruce
rabble-rouser
Babbler # 14090
|
posted 27 October 2008 04:13 PM
quote: Originally posted by oldgoat:
Well yes, very true. Just a brief note of explanation and I'll no longer bother the mathematically competent. In grade school, I was lousy at math, and in high school it became a real full blown phobia. Combined with other things going on in my life, it caused me to never actually pass grade 10. When I finally made it to university years later as a mature student I found I needed to take stats if I wanted to get an MSW, but I might as well have tried to learn to fly. Oddly enough I managed research methodology ok, which uses math differently.
I ended up doing the same sort of stuff anyway, but through a more roundabout route and with a history degree. So carry on with your serious discussion.
[ 27 October 2008: Message edited by: oldgoat ]
Hey, oldgoat I know about that request to get into an MSW program. Classical stats is well classical, and that math stuff is trying. In my own MSW I completely avoided quantitative and used qualitative design and avoided that stuff. Good that things changed.
From: cow country | Registered: Apr 2007
| IP: Logged
|
|
|
Michelle
Moderator
Babbler # 560
|
posted 27 October 2008 04:56 PM
oldgoat, same here re: math. I dropped math after grade 10 math (which I barely squeaked through).Then I took a first year economics course in university which required some calculus. I got 92%. I think my math phobia was just that - a phobia. I'd probably be good at it if I did it now, but I've never gotten around to trying. [ 27 October 2008: Message edited by: Michelle ]
From: I've got a fever, and the only prescription is more cowbell. | Registered: May 2001
| IP: Logged
|
|
Boom Boom
rabble-rouser
Babbler # 7791
|
posted 27 October 2008 05:10 PM
I have quite a serious hearing loss, not quite made up for with a hearing aid, so listening to theory in math class in high school was a struggle, and I didn't do all that well. Then, I got accepted into college as a mature student a few years after finishing the four year tech program in high school, and things improved dramatically - smaller classes and more of a serious attitude from fellow students. Along with the required courses in Communication Arts, I did Micro and Macro Economics, and that was an eye opener. After I finished college, I worked as a program officer for the Local Initiatives Program in Ottawa (early 1970s) for a few years, saved big bux, and went to university to do a bachelor's in Experimental Psychology, which was mostly advanced statistical analysis. I did quite well, so having had difficulty with math in high school weasn't a harbinger of anything at all. It wasn't until I got out of high school that I was able to really get anywhere. Later on I did a Master's in a completely unrelated field. I have two older brothers who had careers in management and accounting, and I think I could have done the same.
From: Make the rich pay! | Registered: Dec 2004
| IP: Logged
|
|
|
|
|
Fidel
rabble-rouser
Babbler # 5594
|
posted 27 October 2008 05:27 PM
quote: Originally posted by Michelle: I can barely do basic algebra.So I majored in Philosophy instead. [ 27 October 2008: Message edited by: Michelle ]
I think if you can master what few rules of highschool algebra there are, that's a big part of calculus nailed down right there. I flunked grade eleven general level math when I was young, and so that, im my mind, reinforced the idea that upper level math was impossible for me. Like you and Boom Boom, I was wrong about that, too.
From: Viva La Revolución | Registered: Apr 2004
| IP: Logged
|
|
|
|
|
Tommy_Paine
rabble-rouser
Babbler # 214
|
posted 28 October 2008 08:11 PM
Well, move it if you must but not while I compose, please. If you do, I will become uncomposed. Which is better than decomposed, I suppose.I've done Reliability and Repeatability studies on measuring equipment at work. We used precision instruments made to measure steel parts. And I found numerous ways to manipuate results. And don't get me started on Statistical Process Control. While it's valuable to attempt to quantify something in order to problem solve, it's tricky enough when we are dealing with solid "things". I think it goes irrevocably awry when we try to quantify an abstract concept. But, we will continue to do this, if only to keep the social "sciences" alive and well.  [ 28 October 2008: Message edited by: Tommy_Paine ]
From: The Alley, Behind Montgomery's Tavern | Registered: Apr 2001
| IP: Logged
|
|
|
|
Boom Boom
rabble-rouser
Babbler # 7791
|
posted 29 October 2008 07:37 AM
Speaking of spelling, Caissa, my worse school experience ever probably was a spelling competition in grade five - that would have been in 1960. The teacher divided the class into rows of two, and alternated giving words to spell. When it came my turn, because I'm very hard of hearing, of course I didn't hear the word I was asked to spell. So, using my ingrained 'coping mechanism', I asked the teacher to spell the word for me, because I couldn't hear it... forgetting I was in a spelling competition, and of course the whole class burst out laughing, and I was throughly humiliated.
From: Make the rich pay! | Registered: Dec 2004
| IP: Logged
|
|
|
|
Tommy_Paine
rabble-rouser
Babbler # 214
|
posted 29 October 2008 02:39 PM
I get compliments about my daughters, and when I do I say, yeah, well, Darwin took a break....So, I'm dissapointed no one took the bait about my dig at social sciences. I once considered myself babbles slyest master baiter, but I will have to reconsider. Anywho, I googled "Cervantes literature" and "Daniel Steel literature". Apparently, there are 800,000 more people who consider Daniel Steel a bigger part of literature than Cervantes. (1,450,000 Cervantes hits to 2,250,000 Daniel Steel hits) Happy reading.
From: The Alley, Behind Montgomery's Tavern | Registered: Apr 2001
| IP: Logged
|
|
janfromthebruce
rabble-rouser
Babbler # 14090
|
posted 29 October 2008 05:13 PM
quote: Originally posted by Tommy_Paine: I get compliments about my daughters, and when I do I say, yeah, well, Darwin took a break....So, I'm dissapointed no one took the bait about my dig at social sciences. I once considered myself babbles slyest master baiter, but I will have to reconsider. Anywho, I googled "Cervantes literature" and "Daniel Steel literature". Apparently, there are 800,000 more people who consider Daniel Steel a bigger part of literature than Cervantes. (1,450,000 Cervantes hits to 2,250,000 Daniel Steel hits) Happy reading.
book baiting is not allowed.
From: cow country | Registered: Apr 2007
| IP: Logged
|
|
Tommy_Paine
rabble-rouser
Babbler # 214
|
posted 29 October 2008 05:54 PM
Janfromthebruce/smartass, seven hits.Janfromthebruce/locquacious interesting vibrant, zero hits. Don't you love imperical data?
From: The Alley, Behind Montgomery's Tavern | Registered: Apr 2001
| IP: Logged
|
|
|
|
|
janfromthebruce
rabble-rouser
Babbler # 14090
|
posted 30 October 2008 01:09 PM
quote: Originally posted by Tommy_Paine: Janfromthebruce/smartass, seven hits.Janfromthebruce/locquacious interesting vibrant, zero hits. Don't you love imperical data?
that is war (does anybody know what button I need to push on my keyboard to get it to quit typing in French. eg. Čččččč
From: cow country | Registered: Apr 2007
| IP: Logged
|
|