CECS 6514 Week Eight

Down the Rabbit Hole of CECS 6514

I think that overall I did get better at coding this time. Practice makes perfect, right? I have just been trying to really dig into what the utterances are saying and make my codes as specific as possible. Probably still have a ways to go, but I think the practice and feedback is what mainly helped me get better. Also I think getting all of the class on the same page helped a lot more, too. I know a few weeks ago many students were certain that we were supposed to be doing high inference, while others were certain we were supposed to be doing low inference. One even seemed to have skipped coding altogether and was assembling a theory straight from the utterances. But once we were able to all be on the same page for low inference coding, that made things move a lot faster.

So what I took from the feedback was the need to expand the codes to make sense to others. In my head I know I was making low inference codes, but then reducing them to put on the spreadsheet. This made the codes longer, with some being considerably longer than the original utterance. But that is okay I now know. I think my problem now is that I am missing older codes that could fit the newer utterances as I go along. In the small groups this week, Alana and Heather pointed out how some of the utterances near the bottom of the page could fit into the codes from the earlier utterances. I realized I had been so deep into being descriptive that I was just giving everything its own code and not making connections (where needed) with earlier codes. So in the future I need to keep in mind existing codes as well.

CECS 6514 Week Six

Down the Rabbit Hole of CECS 6514

Overall, I am happy about the progress I am making. I know I still have a lot to learn about CMDA, but considering that my background in actual research is a bit weak, I am happy that I am making progress. Of course, I know that I read and interpret a lot of research as an instructional designer, but that doesn’t make me an expert on conducting and writing about research. I watch a big… umm… “discussion” on Twitter concerning what the research says about online teaching in general. Someone was trying to make a point that actually teaching a course online can radically change your view about online teaching, and another person swore it didn’t matter that they had not taught online because they could read the research. I think research is the same way – reading a lot about it doesn’t mean you know what it means to actually do it. I was able to do some general qualitative coding on the cyberbullying article that was recently published. But CMDA obviously takes coding to a much deeper level. So, all that to say I am happy with my progress but know that I have a lot more to go.

What I am struggling with right now is creating names for the codes. Part of that is just a slight OCD thing I have with Excel spreadsheet columns being too wide. I just hate to see all of the wasted screen space with a long column header for a column that just has a 1 or 0 in it. So that is leading me to shorten my codes a bit too much to the point that they aren’t as descriptive. So I just have to get over that one and do it the right way. This would all be more of a problem with the method and not qualitative methods overall. In general I lean towards qualitative, so I think these codes tell us a whole lot more about the actual substance of the data more than a quantitative number of “4” on a somewhat generic scale of 0-5 or what ever might.

The other hard part, of course, is coming to agreement with my group. Seems like we currently have more than one radically different idea of what CMDA coding means. I think some of the the other group members have confused emic with etic, or maybe they have skipped ahead to creating categories and theories out of the data itself before doing the actual coding. I’m not really sure. I think that will work itself out as we go along, but it does mean I am still hoping to see a productive group meeting that doesn’t turn out to be a long discussion about what counts as CMDA and what doesn’t.

CECS 6514 Week Three

Down the Rabbit Hole of CECS 6514

What I learned about coding today. I think I am learning how to make my coding better. I’m still not completely sure that I am choosing the right things to code (or maybe I am just not labeling them right). But I see that as I try more, I like what I am coding more. I also notice that I get at least one repeated code per attempt at coding, so I need to make sure and pay more attention to existing codes as I go through them.

I also noticed that the group coding exercise was difficult because none of us were sure exactly what to do. I think that means it would be important to know what you are doing before you jump in to this for real.

It would also appear that the source conversations that you code can make a difference. For example, coding the chat window was pretty strange in that it was often scattered and unfocused. The example coding that we looked at in class last week was obviously more focused since it was from a research study. I can imagine that the coding gets very complex and hard to follow once you start looking at things like email exchanges and discussion board postings that could cover hundreds of lines and hundreds of topics.

I liked how the etic coding made me focus more on specific ideas from the chat rather than coding everything. There is value in both,, but I think I got a better picture of a specific theme from etic, while with emic I got a broader picture that would have been helpful if I had no idea what I was looking for. Of course, those facets were covered in class, but seeing it work out that way as I worked on it really helped to solidify how those two facets are different from each other.

Back to the group work, I noticed that we all had very different ideas of what the codes meant, so I think the coding guide becomes very important when that is the case. Which, of course, it will probably always be the case. I would probably like to see an example of a group that knows what they are doing going through their codes. I’m still just not sure that we were going about our small group work the right way. Or maybe we were getting there and just ran out of time.

CECS 6514 Week Two

Down the Rabbit Hole of CECS 6514

Overall, I think the first quick analysis went well. That was probably due to being told to not over think it too much, because I would have definitely over thought many parts. To me, it was pretty easy to come up with coding categories to add – even though some were more obvious than others. What was harder for me was determining what lines went with what older codes. I think it would be better to complete the whole thing from the beginning. Trying to go back and figure out what was decided back in class for those codings was a bit hard. Sometimes it was obvious what the code meant, but other times it was not. I also found it a bit difficult to figure out if certain ideas needed new codes or if they fit into the older ones. I think part of that was just that I couldn’t remember all of the reasons for the categories we created in class. I am pretty sure that once I code a set on my own from the beginning that this will be less of a concern as I will (hopefully) remember my own reasoning better.

Looking at my research study from last week, they seemed to be doing the correct steps for CMDA. It seemed like they were trying to focus on a specific idea (creating third space communications between faculty and students). So I guess that would be the only question I would wonder about: can CMDA be used to only focus on certain features of conversations, or does it have to be completely open at first in order to be accurate? In other words, do you have to code everything and then look for ideas that might support your research focus, or can you focus in from the beginning? Maybe that was covered when the little guy was screaming at Star Wars Angry Birds in the middle of the online session last week, but hopefully it will be repeated if that is so.

What I will be interested in seeing is how my coding matches up with the other students. Will my social constructivist leanings cause me to see things that others didn’t? Or does that even affect what is coded in CMDA? Or even more so, does my previous experience with Second Life give me a different view on what needs to be coded? I know there are certain things that have dried up in Second Life since these responses were collected, so hopefully I didn’t skip over those thinking that they are no longer relevant. And I was probably a bit harsh on the line that mentioned digital natives…. but at least no one mentioned best practices, right?

CECS 6514 Week One

Down the Rabbit Hole of CECS 6514

So how can we best understand the world? Wow – I’m not even sure if we are close to even beginning to answer that question. Just the other day I was reading an article on the Fermi Paradox (on why we haven’t convincingly discovered alien life yet). This article theorized on how civilization will someday harness the energy of stars and even galaxies directly (like building Dyson spheres). We can already theorize about our own abilities thousands of generations down the line that would take a million times greater understanding of the universe…. so where does that put us today?

Well, I guess we really can’t rate since we can’t see the future. We only have what we know now. But I think if we can theorize these crazy advanced civilizations, then we should at least realize that no one person can know everything, and therefore we need others. We need to always be ready to change, to grow. Ultimately, while there are absolute truths out there… there are scientific facts… we are so far away from knowing enough as a species to even begin to think that we can hold absolute truths. So while I believe there are truths out there – we are far, far from possessing them.

So having covered the “how” and stated my case first, I will now state that I feel social constructivism is the best way to understand the world and determine what can be known. This would not mean that we can not discuss absolutes, but that we should hold lightly to these truths knowing that some major break through tomorrow could change our thinking radically. Scientists (including Eisenstein) originally fought tooth and nail against the big bang theory. Many held to the steady state theory, while others thought that it proved there was a supreme being of some kind and therefore dismissed it as “creationism.” Eventually, they came to accept the evidence and changed paradigms rapidly. They just had to discover that it took billions of years and not thousands. But what if they had embraced it originally? Would we be that much farther down the road of exploring our reality? Who knows.

But if we held on to our ontologies a little looser… maybe, just maybe we would fight less and learn more.

Of course, a lot of this probably comes from me being a “metamodernist” for lack of better words. I swing back and forth between modernism and post-modernism, accepting parts of both while rejecting others. That explains I believe that there is truth out there, but that we have very limited abilities to understand truth and need to give room for disagreement, debate, and change.

However, I have mostly been speaking of scientific matters and not so much on research matters (although they do overlap). When we start talking about what we can know about another person, that is a whole new ball game. We spend a lot of money to have trained professionals help us understand ourselves in therapy sessions. Then we try to find the words to express what we understand. When we find those words, we have to communicate those through systems that often remove part of our communication (phones, email, etc). Even if we are face-to-face, the person we are speaking to could get distracted, or there could be a loud atmosphere, or any one of many things that would make our communications difficult to hear or receive. Then the hearer has to interpret the words and other visual clues, filter that through their understanding, and see how that connects to what they know. All of this would happen in good communication – so imagine adding layers of misunderstanding (both of ourselves and others)? What we can know about others is very distorted, and we can only know what a person has learned or knows based on what they communicate to us through tests, papers, oral exams, etc. So in other words, what we can know through research or education is very limited and distorted. I like illustration from my first class at UNT comparing our communication to a wall with small windows through it that only give us small glimpses into the whole picture.

So, research is basically our attempt to stare through those small windows to figure out what is going on. We hope to stare through enough windows eventually to get a small usable picture of what is going on in a specific area. Our in-class definition had some very good points like ” the exploration of being able to meaningful support answers to questions
that can be expanded to other situations through the use of observations to help provide potential explanations, predict outcomes, add a descriptive look into social or natural behaviors and activities.” My addition to the class definition was “It is not a perfect pattern to replicate exactly, but a set of examples of what worked in one place at one time. We should look at research as a table full of play-dough sculptures that others have created. We choose the ones that might apply to our situation, take them out, and use them or re-mold them as we see fit.” I think that many times, people like to look at research as a “still life” arrangement that they have to them sit down and paint an exact replica of because “this is the best practice!” We can’t exactly replicate what happened in any research project, even if we tried. That is why I like the play dough analogy. Try as you might, most people can’t create a perfect play dough sculpture. At best we create ones that look like something else… maybe. But you shouldn’t just look at one play dough sculpture at a time like you would with a still life arrangement. You should look at all that are out there, like looking at a “table full of play dough sculptures.” Then start to pick and choose which ones look like they might work for you – or even just the parts of different ones that look good. Then use them as is, or remold them into something else.

How does this help me? Well, hopefully I will not look at my research as a way to find answers, but just as a way to add to the big table of play dough. I can look at my research as something that is only a part of what others will use, not the be-all, end-all answer. Hopefully that will change my writing to be more helpful in the long run.

But, this could also make it more difficult to work with others, at least with those that are looking for easy answers and best practices. It may also make it harder for me to publish. Maybe I will just have to hold back on all this squishy relativity stuff and make some grand bold statements occasionally just to get published. I know a co-author and I just had a really difficult time getting our cyber bullying article published just because it was… gasp!… mixed methods (thank you finally Texas Public Health Journal!). So maybe I will need to pull it back a bit more towards the dark side of quantitative research to work better with those types. We shall see.