Theme 6 - Reflection

This week’s theme was qualitative methods and case study research.

After the readings I think I just got enough out of it to write last week’s blog post but didn’t really reflect if I learned anything.  Therefore I’ve tried to find some more information from other sources about case studies to understand what it really contains, and after I read the short summary in the CourseWiki I finally felt like it all made sense. So I would like to add some more information to what I wrote about what a case study is, and make the description clearer.

A case study is a research method using one or several examples of “real-life”…

1)   …Phenomena

2)   …Events

3)  …Persons

… to analyse and give a deeper understanding about something. It often includes a combination of quantitative and/or qualitative methods together with empirical and theoretical studies. It can also involve different cases and multiple levels of analysis.

After writing my new description about what a case study is, I feel like I also understand better what it can be used for. One example is when there are several theories that contradict each other. I realized that it can be very useful in the area of media technology because it’s possible to use a variety of methods since media technology is constantly developing. Case study research is used to provide description, test theory or generate theory, which is very useful in media technology just because it’s constantly developing and therefore theories sometimes are new and need to be tested, and sometimes new theories will be generated.

Theme 6 - Qualitative and case study research

This week I chose the media technology research paper From Moodle to Facebook: Exploring students’ motivation and experiences in online communities by Liping Deng and Nicole Judith Tavares from the journal Computers & Education. The qualitative method used in the paper was individual interviews with 14 pre-service teachers. The interviews lasted between 30 and 80 min, and both authors conducted most of the interviews together. The paper examines the student teachers’ experiences with and perceptions of using Facebook and Moodle. The purpose was to see which factors have bigger impact on students’ engagement in online discussions on the two online platforms. The paper investigates why they were not actively involved in voluntary online discussions on Moodle, and how they were encouraged to voluntarily participate in online discussions on both Facebook and Moodle. The usage data from Moodle was collected and analyzed, but the data from the Facebook group that the students also used was only collected in the interviews when the student teachers gave them the information since the researchers didn’t have any access to the Facebook group.

The benefits of using qualitative methods are that you get very specific information, which can be valuable for certain topics and types of research. In this case they used interviews and interviewed 14 persons that were in the target group of the research. The interviews were explorative which means that they had a few topics and guiding questions for the participants to answer and from there they would rather explore what was going on on the online platforms rather than expect anything and ask already decided questions.

The limitations are that it’s impossible to generalize the information that they got during the interviews. This case is only possible to apply to that group of student teachers, since they all were from the same university in Hong Kong. They were all part of the same online community on both Facebook and Moodle. To improve the results I would have interviewed both students and teachers to get both sides. It would have been interesting to see what the teachers did to encourage the students to use the discussion board on Moodle, if they did so.

Case study

A case study is research method with the aim to give a deeper knowledge of what the research is about. The basic idea is to collect empirical data with both qualitative and quantitative methods for example interviews, questionnaires and focus groups. There are numerous of aims with the use of case studies; providing description, testing or generating theory.

I chose a paper called “Structuring the discourse on social networks for learning: Case studies on blogs and microblogs” in the journal Computers in Human Behavior. The paper was about blogs and microblogs and how they can be used in education to improve student interaction. In the case study in this paper the authors used questionnaires with both open and closed questions. They interviewed some participant sand collected data from the applications for the blogs and microblogs.

Theme 5 - Design Research - Reflection

The theme this week was design research. We had two lectures and the first one was with one of the writers, Ylva Fernaeus, of the paper that we read last week; ”Comics, Robots, Fashion and Programming: outlining the concept of actDresses.” The lecture was very interesting and gave me a deeper understanding in what they thought during their research. Fernaeus described their process very well, which I think was one of the most interesting parts of the lecture she held. The first thing in a research process according to Fernaeus is to see something that everyone else missed out on. Then you start doing some research about it, you take notice and then you convince the people around about your idea/research and then they finally accept it.

Haibo Li held the second lecture, which was about ideas and problems. Great ideas, how do we come up with them? Li wanted us to think about the possibilities to come up with great ideas and make it happen. The lecture was more focused on the economic part of design research than I though at the beginning of the lecture but it was good to see the subject from a different angle. Li said that more focus and energy should be within defining the problem instead of trying to solve the problem. If you don’t know exactly what you research is about, if you don’t have a defined problem, then it’s going to be hard to solve the problem too. The timing should be right too, to be able to get a return on the investment of the research. I liked that it was more business in his way of seeing research than when I’ve been thinking about research before. It was like a quick introduction to how you can both do research and business at the same time, which I found quite inspirational.

Theme 5 – Design Research

Technology is taking more and more space in our lives and the more we use it the more people want to personalize it. It’s everything from stickers to put on your computer, to cases, bags, covers etc for your phone. Fernaeus and Jacobsson talked about such accessories in the paper Comics, Robots, Fashion and Programming; outlining the concept of actDresses.

actDresses is created so the people can personalize robots by dressing them differently. Depending on what the robot is wearing the robot acts differently.

I think this is necessary to develop more if the robots are making their way into our lives to stay. This week I also watched the documentary Mechanical Love, and I can easier apply the readings from this week to what it actually is about personalizing robots. Seeing a robot that is supposed to look like a human for me is just scary. It’s dressed up as a human, kind of looks like a human but somewhere there it feels like something is definitely not normal. I think it’s a long way to go, but by doing research on the subject I think we can reach far, and develop interesting solutions for the future.

1. How can media technologies be evaluated?
When designing media technologies there is always an end user for the product or service. Therefore it’s important to bring in the users during the development process to test the product in the different stages of the process. There are many different design evaluation strategies out there that all fit for different purposes, but a common denominator is that they all want to eliminate the problems and make it easier for the users. The best way to test new technologies (or even old ones for improvement) is to test it with the real users in the environment it’s supposed to be in. There might be a lot of things going on in the surroundings that you might not think of while developing the technology, something that will have an impact on the way the user uses the technology.

2. What role will prototypes play in research?
Prototypes are already a big part of design processes in many different areas of professions. Prototypes is an easy way to test a product at an early stage to see what improvements need to be done. It’s called iteration when you take something, test it, develop it a bit more based on what you learned from the testing, test it again, adjust, test again, and again until the product reaches the final product. I think prototypes can be used more at an early stage, but they don’t have to be very advanced from start. I think that if you put a bit of time and effort into prototypes and evaluation of them earlier on in the process, the results will be reached earlier since you have the chance to avoid problems that may occur and in the end this also can give more return on the investment since the product will fit the users better.

3. What are characteristics and limitations of prototypes?
Some limitations of prototypes are that it takes time to develop prototypes. Some ideas are really complex and a prototype for such a product might take more time, effort and money than what you will get in return after launch. From my point of view prototypes differ a lot depending on what kind of technology it is about. A web application prototype differs a lot from a prototype of a robot. Anyway, in both cases the prototypes are playing a big role in the design process to reach the final product. I’ve done a bit of prototyping for mainly smartphone apps. And the first prototypes in the process are very basic, usually on paper. This is obviously not a prototype for the final product but regarding the limitations it’s a useful way to early on see if I’m on the right way towards the goal. Later on in the process the prototype gets interactive, and even later the design is included and at the end the prototype is basically the final product. When it comes to web applications and such things there are many useful tools out there that eliminates many limitations, mainly cost related ones. For example Omnigraffle is a tool made for prototyping apps, websites etc. It might be a bit time consuming in the beginning, but the prototyping is easy when you learn how the program works. I know that there is a totally different part of prototyping when it comes to physical media technology products, when hardware is needed. The limitations in that case are often that it’s expensive and very time consuming.

Theme 4 - Reflection

This past week I’ve learned a bit more about quantitative research methods. I read the paper Canadian university students in wireless classrooms: “What do they do on their laptops and does it really matter?" from the journal Computers & Education last week but since then I haven’t had the chance to go to the seminar nor the lecture this week. But this week I actually feel like I gained something from the readings and from reading the fellow classmates blog posts from both last week and this week.

I chose my paper last week because of my interest in e-learning and felt like I should take the opportunity to learn more about a subject I’m interested in and at the same time understand more about the research methods used in the paper. The paper made it a lot easier to understand how the chapter Methodology is supposed to be. I think that many of us before we start with the master thesis have an idea that this chapter is supposed to describe you have done to get to your results. And that’s true. It’s supposed to describe that. But what I haven’t reflected about before is that you should describe every single detail of the decisions you made on the road, and back it up with theory to make it valid. Another person should be able to copy your method and do it all over again and get the same results.

I see from my classmates’ blog posts that one of the topics at the seminar was the importance of testing a survey/questionnaire before sending it or handing it out to the participants. People often interpret the questions differently, and it is of great importance that no questions are written in a way that makes it as easy as possible for everyone to understand them. Short descriptions can help out throughout the questionnaire. By testing the questionnaire before, you can eliminate the risk of participants misunderstanding the questions. I remember when I handed out a questionnaire for my bachelor thesis at a university in Argentina, I realized that the students interpreted the whole survey different than the student at KTH (the same questionnaire for both universities). We did the test of the survey at KTH and not at the university in Argentina, so if I ever do a similar research I’ll remember to test the method in the actual context where it is supposed to be and not expect that it should be the same just because the groups of participants in the research are similar.

Another topic related to questionnaires that I could see was discussed during the seminar was if the questionnaire was printed and handed out, or sent to the participants by the web. There are a few pros and cons regarding the two ones, for example papers are platform independent but sometimes it can be hard to read the handwriting.

Theme 4

I read the paper Canadian university students in wireless classrooms: “What do they do on their laptops and does it really matter?" from the journal Computers & Education.

1. Which quantitative method or methods are used in the paper? Which are the benefits and limitations of using these methods?
The paper used two different methods referred to Study 1 and Study 2. Study 1 started in the beginning of the fall semester and Study 2 started a few weeks before the Christmas break the same semester. In both studies the students were able to participate only if they were self-identified as laptop users in the classrooms.

In Study 1 1129 students from a university in Ontario participated in this study. The students ranged from 16 to 50 years old, and from a range of different programs at the university. The students had to answer what they were using their laptop for in class; Taking notes on the laptop, Searching complementary information on the web
, Sending emails with the laptop
, Navigate on web sites that are unrelated to school work, Visiting social networking sites
, Using laptop to watch videos/pictures
, Text messages on phones or other electronic devices
, Laptop is a source of distraction.

Study 2 focused on three unaddressed issues in Study 1; the use of a self-reported measure of academic achievement, the use of a cross-sectional design in which it was impossible to determine whether laptop utilization behaviors were prospectively associated with future academic performance and last internet addiction remains a controversial phenomenon but the uncontrolled urges to access the internet in some individuals have nonetheless been widely documented in psychological science.

In Study 2 88 undergraduate students (27,3% male) from a public university in Ontario participated. This time the students completed questionnaires that measured their laptop utilization behaviors during class time and a series of self-regulatory, motivation, Internet addiction, learning style, and emotional variables. The questionnaire was set up through psychdata.com, which is a website where one can set up questionnaires and is a tool to enhance online research. The students that participated in this study were the ones that didn’t mind sharing their grades form the courses with the researchers.

The benefits of using these methods is that it’s possible to get results that can be more or less generalized for that university since they got a big number of students participating in the surveys. Limitations when using questionnaires are always the selection of participants. Do the students that participated really match the reality?

2. What did you learn about quantitative methods from reading the paper?
I’m not sure if I can say that I learned something new about quantitative methods. Most of it I felt like I knew, or it seemed logical to me. But I realized that it’s possible to have a different layout on the paper. In this one they had Study 1; Methods & Results and then Study 2; Methods & Results, instead of having a chapter with methods and one for results. This made more sense and made it easy to follow.

3. Which are the main methodological problems of the study? How could the use of the quantitative method or methods have been improved?
Study 2 solved the main methodological problem. Other than that I can’t really tell if there are any bigger problems with the method of choice. There are a few thing that could have been improved for example the selection of students. The students were mainly from the first year because it was mandatory for them to participate in the survey, and they also got credits for it. The other students from other years got 5 dollars for the effort. Since 76,6% were from the first year of study, and also first semester I feel like this study could have been focusing a bit more on students further into their studies. Students on the first semester of university students might not have figured out their own study method yet, compared to students from other years. An improvement that could have been done is to either focus on first year students, or the others. 

4. Which are the benefits and limitations of using quantitative methods?
Benefits of using quantitative methods are that it’s possible to get a result reflecting an average situation. The bigger quantity the more accurate the results get. Limitations are that it’s hard to understand why the answers sometimes looks they way they do. When dealing with a complex research question quantitative methods are limited because it’s hard do develop a high quality questionnaire that can generalize a complex problem.

5. Which are the benefits and limitations of using qualitative methods?
Benefits with qualitative methods are that it’s possible to apply to more complex problems, for example when the research is about people. It’s more time consuming, since these methods often include focus groups or interviews. The results will be accurate, but only for the people that have been chosen to participate. It’s often hard to get the research group in qualitative methods to reflect the whole mass, which means that it’s hard to generalize the results gained by qualitative methods.

Theme 3: Research and Theory - Reflection

This week we had two seminars on the theme Research and Theory. Last week we were supposed to choose and read a text and describe what kind of theory that was included in it. Unfortunately I was sick during last week, and also this week. So I can’t really remember what we discussed during the first seminar this week, and the seminar that we had this morning I missed out on. I was hoping to be able to attend the seminar today, since I felt like I didn’t learn anything from the readings and the other seminar.

I decided to read the course wiki instead to see if I might be able to get some more new information that I didn’t know before, or just make the concept theory clearer for myself. I liked the part in the course wiki where there are examples of theories. This made the text The Nature of Theory in Information Systems by Shirley Gregor sink in a bit more. I liked how the examples show how the classification, which Gregor mentions in her paper, can be done.

Theme 3: Research and Theory

I chose a journal called New Media & Society with an impact factor at 1.824. It is an international journal that publishes research articles within the subjects; communication, media and culture, but also sociology, geography, anthropology, economics, the political and information sciences and the humanities.

In the journal New Media & Society I chose to read the article Morality and ethics behind the screen: Young people's perspectives on digital life by Andrea Flores and Carrie James. 61 qualitative interviews were held with youth from a few high schools and colleges around Boston. The paper had a focus on moral and ethics and the main questions to the students were what they thought when posting something online.

Briefly explain to a first year student what theory is, and what theory is not.

Theory is a term that is hard to define, since it’s defined differently depending on the discipline. It is a lot easier to define what theory is not. Theory is for example not references, data, variables, diagrams or hypotheses. References, data, variables, diagrams and hypotheses can rather be seen as parts that back up a theory. A theory tries to answer the question Why something happens.

Describe the major theory or theories that are used in your selected paper. Which theory type (see Table 2 in Gregor) can the theory or theories be characterized as?

The main theory in the paper I chose was a moral development theory that can help understand young people’s approaches to online life. The theory is based on studies in psychology (Kohlberg, 1981, 1984; Piaget, 1965; Selman, 1975; Turiel, 1983). Kohlberg’s stage theory can help people understand how youth thinks when they’re online. The stage theory describes an evolution of moral thinking in different stages; with focus on the self, to known others, to society and toward the establishment of abstract principles, such as justice.

Which are the benefits and limitations of using the selected theory or theories?

The benefits of using this theory are that it can easily be used to discuss some of the results from the qualitative interviews. The interviews showed that many students don’t think about the consequences when they post things online, which shows that the students are at the first stage in Kohlberg’s stage theory; they only think twice when they think the post can affect themselves. I think the theory is a good choice for this paper because it kind of gives a clear view of at which stage the students are and you can easily see which stages that follows and how they can reach them.