Developing, implementing and evaluating health promotion resources for high school students in the Northern Territory

Developing, implementing and evaluating health promotion resources for high school students in the Northern Territory

Developing, implementing and evaluating health promotion resources for high school students in the Northern Territory

The Cancer Council Northern Territory invited Community Works to support a program they developed, the School Smoking Education Program (SSEP). The purpose of the program was to educate students through evidence-based information about the harmful impacts of cigarette smoke and e-cigarette vapours. The target audience was 12-16 year olds, focussed on students in years 7, 8, 9 and 10 attending schools in Darwin and Palmerston.

The program was implemented into the school curriculum and it ran over four lessons covering topics that included the health implications of tobacco, chemicals and nicotine addiction, social determinants of health, societal factors in tobacco use and smoking cessation methods. The intended outcome of the program was to reduce the number of adolescents who take up smoking and increase the number who quit smoking if they are already smokers.

Cancer Council NT staff designed the program and delivered the sessions in each school. Community Works supported them through the design of resources for the program and by assisting with the evaluation of student responses to the program in each school. The design and framing of resources by Community Works carefully considered literature on the key concerns and most important issues impacting adolescents aged 12-16. For example, this included an emphasis on concerns about the environment and about family members becoming seriously ill. The resources also took into consideration the increasing trend of adolescents to take up e-cigarettes or vaping.

Examples of the resources are shown below. They were designed for use across multiple formats including as posters, magnets and pamphlets, as well as on social media.

In addition, the flyer provided to all students included explanations of the wider social and environmental effects of tobacco production and use.

Cancer Council NT considered an evaluation of the program to be very important as a means of gauging how well the materials had been understood by students and what the likely impacts would be on their knowledge, attitudes and behaviours relating to smoking. An evaluation would also help to show any changes or improvements that could be made to the program in the future.

As an engaging and efficient strategy for the evaluation, we recommended choosing a small number of questions and then putting them to students through Mentimeter, an online platform that enables a range of question-types to be developed, such as open-ended, survey or multiple-choice questions. Mentimeter enables responses from a group of people to be immediately presented and analysed according to different formats that could be chosen in advance by Cancer Council NT staff. For example, one question asked students to write down three words that represented their reactions to the program. The format we chose to present the results was a word cloud like the one below, with most common reactions shown in larger font.

This approach was engaging to students because they could respond anonymously to questions using mobile phones or tablets and the combined responses could then be projected on a screen and discussed with the group as a whole. Given the limitations of time available within a school timetable, each evaluation was scheduled to only require twenty minutes at the end of the final session. After evaluations were completed in all four schools, Community Works produced a short report that summarised the findings.

We anticipate that our relationship with Cancer Council NT will continue into a further phase of work as the organisation scales up its work to reach more schools and students in the future.  

The Stronger Communities for Children Program Storybook

The Stronger Communities for Children Program Storybook

The Stronger Communities for Children Program Storybook

Stronger Communities for Children (SCfC) is a community development program in ten participating Aboriginal communities in the Northern Territory of Australia. The program supports safe and healthy communities, families and children. It ensures that local people are in control of local decision making.

The program has been operating since 2013, over which time the Local Community Boards in each community have made decisions on investments in a very diverse range of activities, depending on local needs and priorities for families and their children. Examples include education programs for parents, after-school support for children, health promotion and awareness activities, cooking and nutrition programs, support to strengthen the use of local languages in schools and social enterprises in skateboarding and hairdressing, as part of a wide array of initiatives across the ten communities.

A challenge for the program has been to document the impact of such widely differing activities across a vast geographical area and for communities that have distinct priorities. Working with Ninti One, the organisation with responsibility for supporting the program, we developed two strategies for providing a measure of impact across the program.

Stronger Communities for Children: Monitoring, evaluation and learning model "Wheel of Measures"

The second strategy was to collect impact stories for inclusion in a report we called the SCfC Storybook . We worked with each community to generate stories about the difference that their SCfC activities had made. This made the information generated different from information usually presented in reports, which share stories about what happened rather than the difference made or the impact achieved.

Stronger Communities for Children: Community activities

The result was the Storybook that we produced with Ninti One as a milestone publication for Stronger Communities for Children. It included the contributions of many people working for the program in each community, especially people delivering the activities and members of the Local Community Boards.

Please see the Community Works blog for reflections on the experience and what we learned for future impact assessment work.

Online workshops for Ninti One

Online workshops for Ninti One

Online workshops for Ninti One

Community Works has been a partner of Ninti One for several years. We have worked with the organisation as it has developed and managed programs that have created economic opportunity, improved service delivery and boosted the livelihoods of Aboriginal and Torres Strait Islander people across Australia.

An important part of our contribution has been to support to planning and training processes for organisations across Australia. Given the distances involved in reaching people living in the most remote and isolated parts of the country, online methods of work have always been a part of the mix of methods we have used.  Recently, we have translated more of the workshop-based planning and training materials to online access, a process that been very rewarding.

Three of the approaches we have adopted have been especially effective:

Online canvases

It has been valuable to share a single canvas with a group of people online in which all the content you wish to discuss is included. This means it needs to be a big space. Navigating around the canvas and focussing in on the relevant section enables a smooth transition from one topic to the next, with comments and points of discussion recorded on the canvas as we progress. We have found Mural to be a valuable platform for these kinds of processes (see the example on the right). Recent examples of session content includes in-depth research planning with three community organisations in the Northern Territory. 

Remotely-facilitated workshops

Facilitating a training or process workshop through remote video presents challenges, but they can be overcome with good planning in advance. Having the facilitators in one location and the participants in another means that the quality of the connection needs to be adequate, including the audio quality. Pacing the workshop in a way that prevents in turning into a lecture is critical, so that the participants are not worn down by the experience of watching the materials displayed on the screen. This means that breaking up for group exercises, posing questions to the group on a regular basis and inviting people to watch a video and then come up with their questions and comments are essential to the process.

Narrated presentations

Probably undervalued as a method, we have found narrated slides to be very effective as a flexible way for individuals to engage with material in a time and at a pace that suits them. We have developed online materials of this kind for the National Best Practice Unit for Tackling Indigenous Smoking, which is managed by Ninti One. The approach draws on the methods we have refined through the online masters course in cross-cultural conflict resolution we have delivered for James Cook University in recent years.

Our successful work with Ninti One is likely to see more online methods being developed for an increasingly wide range of topics including research, service improvement, evaluation, project management and various training courses.

Rheumatic Heart Disease Community Awareness Project

Rheumatic Heart Disease Community Awareness Project

Rheumatic Heart Disease Community Awareness Project

The Stronger Communities for Children (SCfC) is a community development program in ten sites in the Northern Territory that focuses on achieving the best possible start in life for children. It supports safe and healthy communities, families and children and it ensures that local people are in control of local decision making on services and activities for their children. The program is supported by the National Indigenous Australians Agency (NIAA).

Community Works has been engaged by Ninti One to support their work on the SCfC program since it commenced five years ago. In this example, the Ninti One SCfC team was invited by Mala’la Health Service Aboriginal Corporation in Maningrida to visit their community to help conduct impact assessments for an important initiatives supported by SCfC, the Rheumatic Heart Disease Awareness Project.

Rheumatic heart disease (RHD) is damage to one or more heart valves that remains after acute rheumatic fever (ARF), where the heart has become inflamed. According to the Menzies School of Health Research, the incidence of ARF and RHD falls dramatically with improved living conditions and increased hygiene standards, along with better access to appropriate health services and penicillin-based medications.

In Maningrida, many people are working to improve local awareness of ways to prevent the disease. The purpose of our work was to measure what difference this awareness-raising work is making. To achieve that, we used participatory action research methods. We trained five people from Maningrida to conduct surveys and focus groups.

Community Works helped Ninti One publish a storybook on the Rheumatic Heart Disease (RHD) awareness project. A short video was also produced by Ninti One.

In Maningrida, many people are working to improve local awareness of ways to prevent the disease. The purpose of our work was to measure what difference this awareness-raising work is making.

Program monitoring and evaluation in the Western Region of Nepal

Program monitoring and evaluation in the Western Region of Nepal

Program monitoring and evaluation in the Western Region of Nepal

Program monitoring and evaluation in the Western Region of Nepal

 

The Livelihood Education Development Society (LEADS) in Nepal manages a mental health and development program in partnership with BasicNeeds. The program focuses on improving access to community mental health services in two districts, Baglung and Myagdi, in the Western Region of the country. With support from the Department for International Development, the program has been operating since 2010.

Steve Fisher of Community Works conducted a monitoring visit to Pokhara, Nepal in April 2012 and worked with the team of LEADS to assess progress. He visited program partners and participants and reviewed the documentation for the program. Many individuals and families have benefitted from the work of LEADS including Mrs. Sunar, who lives on the fringes of Baglung in Nepal, on one of the hillsides overlooking the city.

Mrs. Sunar has faced many challenges and is working to overcome them. She works on a part-time basis doing light agricultural labour. She expressed a desire to start a small enterprise rearing chickens. With support from LEADS, she bought 23 chicks to keep around her house. Six months later, they are mature and she is benefitting from the sale of eggs, which the chickens produce at a rate of around ten per day, and chicken meat. Already she has built up a small fund that she keeps in a savings account to enable her to buy more, as well as to cover the costs of the upkeep.

 

The monitoring and evaluation process enabled LEADS to reflect on its work and plan for extending its activities to other districts. The needs for community mental health and development services in regional areas are very large. The work of LEADS and BasicNeeds makes an invaluable contribution to policy and practice.