Method

The project applied the Desing-based research method to address its objectives and purposes. This chapter provides a general description of the technique, its core principles, strengths, and limitations in relation to the project's objectives.

Summary

Design-Based Research (DBR) is a methodological framework that tackles societal challenges through collaboration. It involves iterative design, implementation, and evaluation cycles, allowing for ongoing refinement of educational and social interventions in real-world contexts.

DBR emphasizes engaging relevant stakeholders, including a main target group of people facing a specific situation or experience, organisations, policy leaders, community leaders, employers and educators, throughout the research process. This engagement ensures that solutions are informed by the experiences and needs of those who use them, leading to more meaningful and sustainable changes.

DBR aims to bridge the gap between research and practice by integrating theoretical insights with practical applications. Researchers work as agents of change, developing both practical interventions and theoretical knowledge that directly apply to educational and social settings.

The approach values the diversity of participant groups and actively challenges structural racism and biases. DBR encourages self-reflection among researchers and participants to promote an equitable research process and create inclusive environments.

DBR's strengths include its adaptability to various educational contexts, its capacity for fostering innovation, and its use of mixed methods to understand interventions comprehensively. Its collaborative nature helps address practical problems with grounded solutions.

Despite its benefits, DBR faces challenges such as managing large amounts of data, potential biases due to researcher involvement, and the complexity of implementation. To enhance its effectiveness and validity, clear standards and improved methodological procedures are also needed.

Design-Based Research (DBR)

Design-based research (DBR) is a robust methodological framework that tackles societal challenges by collaboratively creating impactful solutions for lasting change. This approach is well-suited for initiatives that involve establishing connections across different sectors and countries around a shared goal. By engaging relevant stakeholders throughout the process, DBR ensures that solutions are shaped by those who use them daily, leading to more meaningful and enduring changes.

Design-Based Research (DBR) is a cutting-edge methodological framework within the social sciences. Its solid and iterative cycles are crucial for developing, implementing, and refining educational and social interventions. This collaborative and adaptive approach begins with an initial hypothesis, rigorously tested and refined through continuous engagement with the relevant target groups. The methodology is distinguished by its cyclical nature, as opposed to traditional linear methods, requiring ongoing resources and a degree of flexibility to accommodate iterative refinements that are a hallmark of the process.

DBR is dedicated to improving educational and social practices and developing theories through a collaborative design and evaluation process due to the urgent need to bridge the gap between practice and research. It emphasizes creating and refining social interventions, tools, and policies while also contributing to advancing theoretical understanding. As agents of change, researchers work closely with stakeholders, who are actively involved as collaborators, ensuring that the research is grounded in practical realities and that the outcomes directly apply to social settings. Cited by Armstrong et al. (2019) and Tseng et al. (2016), DBR is recognized for its potential to yield sustainable innovations, effectively bridging the gap between design and research knowledge and fostering a more integrated approach to social improvement.

DBR works with three core principles: Iterative design and implementation cycles, engagement with target groups, and evaluation and reassessment.

Iterative Design and Implementation cycles: DBR operates on cycles that involve designing interventions, implementing them in real-world settings, analyzing the outcomes, and refining the interventions based on feedback. This cyclical nature ensures that the interventions evolve to meet the participants' needs better.

Engagement with Target Groups: The approach emphasizes direct engagement with the target groups throughout the process. The engagement includes initial hypothesis testing and gathering feedback during the pilot phase to ensure the interventions are grounded in the participants' experiences and needs.
Evaluation and Reassessment: After the pilot phase, a thorough assessment is conducted to assess the effectiveness of the interventions. The findings from this evaluation lead to recommendations and a reassessment of the initial hypothesis, ensuring that the interventions remain relevant and practical.

DBR inherently values the diversity of participant groups, recognizing the richness that different perspectives bring to the research process. It actively challenges structural racism and individual biases that can create barriers to participation and success. Key aspects include:

Challenging 'Blind spots': By acknowledging and addressing the unique experiences of different groups, DBR avoids the pitfalls of 'blind spots', which can inadvertently lead to exclusionary practices.
Engaging Actors: It involves a heterogeneous group of stakeholders such as educators, employers, and community leaders reflecting on their practices and biases, promoting a more inclusive environment.
Self-Reflection: Researchers and participants are encouraged to recognize and address their prejudices, contributing to a more equitable research process.

Trust is fundamental in DBR. The methodology advocates for creating a safe and welcoming environment for participants:

Informal Interactions: Researchers use informal interactions to build rapport and trust before formal data collection.
Small Groups for Feedback: Smaller settings are recommended to enhance social safety and facilitate more meaningful feedback.
Flexible Data Collection: While structured sessions and scripting are helpful, DBR allows flexibility in adapting conversations as they evolve naturally.

DBR emphasizes the importance of a collaborative environment where participants feel comfortable sharing their experiences:

Personal Story Sharing: Ample time is allocated for participants to share personal stories, helping to build a deeper understanding of their contexts and challenges.
Workshops and Communal Activities: Workshops often include communal activities like shared meals to foster community and collaboration.

DBR Strengths

Design-based research (DBR) is a powerful approach that offers several key strengths in developing and testing social interventions. One of the primary strengths of DBR is its iterative process. The iterative process involves a continuous cycle of design, implementation, and evaluation, which allows for the ongoing refinement and improvement of educational interventions (Armstrong et al., 2019). By conducting research within real-world contexts, DBR ensures that findings are highly relevant and applicable to social settings, enhancing their practical value (Tseng, 2016).

Collaboration is another significant aspect of DBR. The approach emphasizes close collaboration between researchers and practitioners, ensuring that the research addresses practical problems and benefits from the insights of those directly involved in the educational process (Armstrong, 2019). This collaboration helps ensure that the interventions developed are practical and grounded in educational environments.

Furthermore, DBR integrates theory and practice by aiming to develop practical interventions and theoretical knowledge. This dual focus helps to bridge the gap between research and practice, allowing theoretical insights to inform practical applications and vice versa (Christensen & West, 2018).

DBR's flexibility is another advantage. The approach is adaptable and can be applied to various educational contexts and problems. This adaptability allows for various applications and innovations, making it suitable for diverse educational challenges (Ponte et al., 2016).

Moreover, DBR positions researchers as agents of change, actively working to improve educational practices rather than merely observing them (Armstrong, 2019). This focus on change and improvement distinguishes DBR from other research methodologies.

DBR often employs mixed methods, combining qualitative and quantitative data to comprehensively understand the educational interventions being studied (Rawson, 2015). This mixed-methods approach enables researchers to gain a richer and more nuanced understanding of how interventions work and how they can be improved.

Finally, DBR has a strong capacity for innovation, particularly in creating sustained innovations in educational practice. By integrating design principles with empirical research, DBR fosters the development of innovative solutions that are both effective and grounded in real-world practice (Reinmann, 2005).

Overall, these strengths make Design-Based Research a practical approach for developing educational interventions that are impactful and deeply rooted in practical experience.

Weaknesses and limitations

Design-Based Research (DBR) is a valuable approach to educational research, but it also has several weaknesses that researchers must consider. One major challenge is the copious amount of data it generates, which can be overwhelming and difficult to manage effectively (Rawson, 2015). This abundance of data requires meticulous organization and analysis, which can be time-consuming and resource intensive.

Another issue with DBR is the lack of clear standards to determine whether an initial design is sufficiently developed to undergo further iterations. Without clear benchmarks or criteria, judging when a design is "good enough" to proceed can be difficult, leading to potential inconsistencies and inefficiencies in the research process (Rawson, 2015).

The interventionist nature of DBR presents unique validity concerns. Since researchers are actively involved in the design and implementation of interventions, there is a risk of introducing bias. This involvement can affect the objectivity of the research and raise questions about the validity of the findings (Rawson, 2015).

Implementing DBR is inherently complex and requires careful planning and execution. The method demands a high level of skill and expertise to be carried out effectively, which can be a barrier for some researchers (Christensen, 2018). Additionally, while the flexibility of DBR is often seen as an advantage, it can also be a weakness. This adaptability may lead to DBR being perceived as a multipurpose tool that attempts to do many things but does not excel at any aspect (Rawson, 2015).

Researcher enthusiasm is another potential source of bias in DBR studies. The intense and long-term nature of DBR projects necessitates dedicated and enthusiastic researchers, which can sometimes lead to biased results despite efforts to minimize this risk (Rawson, 2015). Furthermore, improved methodological procedures and greater capacity for theoretical elaboration are needed within DBR. Enhancing these areas can help produce more robust results that can be effectively integrated into educational practice (Ponte, 2016).

These weaknesses highlight the challenges and complexities of conducting Design-Based Research. Despite its potential benefits, researchers must carefully navigate these issues to ensure the validity and reliability of their findings.