Levels of Monitoring Community, District, National, Donor by Phil Bartle, PhD Workshop Handout. Monitoring methods differ at each level, and complement each other There is no universal vocabulary for varying levels of government and administration from the community level to the national level. Terminology varies from country to country. I can not, therefore, use a set of terms that can be applied in many countries, although the principles and methods of community empowerment are universally similar (with minor variations between countries). Since these training modules were mainly developed in Uganda, I am using the terminology of Uganda. When Museveni came to power, they ranged from Resistance Council Level One (community or village) up to Resistance Council Level Five (District). More recently, Uganda reverted to a former terminology with colonial vestiges: 1 = village, 2 = parish, 3 = sub-county, 4 = county and 5 = district. The precise terms are not important here; what is important is that there are monitoring roles that range from the village to the national level. Use whatever terms are applicable to your situation. Monitoring should be carried out by all stake holders at all levels. Each level, however, has specific objectives for monitoring, methods and therefore roles. For monitoring to be effective, there is need for a mechanism of giving feedback to all people involved at all levels (community, district, national and donor). Monitoring at Community Level: Community level is where implementation and utilisation of the benefits of the project take place. In most cases it is the village and parish level. At this level, the major purpose of monitoring is to improve the implementation and management of projects. The interest of the community as a whole in monitoring school construction, for example, is to ensure that the construction of the school (an output) is being done as planned. The specific objectives for monitoring at this level therefore include, (a) ensuring that the projects are implemented on time, (b) that they are of good quality and (c) that the project inputs are well utilised. Monitoring at this level involves: Identifying a community project. This should be identified in a participatory manner to reflect the community needs and stimulate people's interest in its implementation and monitoring. If the process of project identification is not well done and does not reflect community interests, it is likely that the communities will not participate in the monitoring of the implementation activities; Identifying the team(s) to spearhead the monitoring of the project in the community. The roles of each team, how they should carry out the monitoring process, the use and sharing of information generated with other groups within and without the community, should be specified and explained; Design a work plan that guides project monitoring. The work plan should specify the activities in the order that they will be executed and the individuals to execute them. This helps the people monitoring to know the activities that should be carried out by particular individuals in a given period of time. If the activities are not carried out, the people monitoring get guidance in coming up with solution(s); Determine the major activities from the work plan. Whereas all activities in the work plan are necessary and should be monitored, it is useful to identify the major activities on the basis of which objectives and indicators would be set. For example if the preparatory activities in a school construction project include, community mobilization, borrowing of hoes from the neighbouring village, digging of the soil and fetching of water for brick making, the major activity summarising all the sub-activities could be brick making. Determine the indicators for each activity objective. The indicators help the that team monitoring to tell how far they have gone in achieving the objectives of each activity. In our example, one indicator could be the number of bricks made. and Compare what is happening with what was planned should be done in the process to tell whether the project is on schedule and as planned. The monitors should check at the indicators to measure how far they have reached in achieving the objectives. This should involve looking at the quality of work to ensure that it is good. The monitoring team may need to involve a technical person like a local artisan or a technician from the district to ascertain the quality of the project (if it is of a construction). The monitoring team should then agree on how often they should visit the project site as a means of verifying what is taking place. For a community project, to avoid big deviations from the work plan, monitoring visits should be carried out at least once a week. During the project visits, the team should look at what is happening (observe) and talk to every body who is involved in the project; For each activity, the monitoring team should identify the objectives. For example the objective of brick making as an activity during the school construction project could be; to make ten thousand bricks by the end of February. Whenever a monitoring visit is carried out, those monitoring should write down what their findings. They can use a form attached in the annex or agree on any other reporting format that captures the findings of the exercise in relation to the work plan. The findings from the monitoring visits should be discussed with other members of the implementation committee. The monitoring and implementation teams should use the information collected to detect and solve the problems facing the project. The monitoring and implementation teams should store the information well and use it for future actions and to inform other stake holders. At each site there should be a file in which copies of monitoring reports and other documents related to the project are kept. Monitoring at District and Sub-County Level: The district and sub-county officials should get information from the community monitoring (monitoring performance in relation to turning the inputs into outputs). They should also monitor the outcome of the project (eg the effect of school construction on the enrolment levels). The district should also monitor the increase in strength, capacity and power of the target community to stimulate its own development. The objectives therefore include: supporting the improvement in project performance and measuring the applicability of the way the project was designed in relation to community strengthening. The methods for monitoring that can be adopted at this level include (a) routine monitoring and (b) qualitative support. Routine Monitoring and Supervisory Support: This requires the District Project Coordinator, Community Development Assistant, other technical staff and politicians at the district and sub-county to visit the project sites to ascertain what is happening in relation to what was planned. A copy of the work plan and community monitoring reports should be kept in the project site file. This will help whomever wants to compare progress with the work plan and get comments of the monitoring team to do so without necessarily tracing the members of the monitoring team who may not be readily available. During routine monitoring, discussions should be made with all the people involved in the implementation and monitoring of the project. Look at the manner in which each team performs its duties (as a means of verifying the increase in community capacity). Make and record comments about good and bad elements in the project. Recommend solutions showing who should undertake them, with financial, time and the negative effects that may accrue to the project if they are not taken. A copy of the comments should be left in the project site file/book and the other discussed and filed at the district. The sub-counties and districts should organize discussions of project progress at least once a month. Also file and submit a project progress report as part of the routine monthly reporting to the district and national office respectively. The major issues to look at during the district and sub-county routine monitoring include: . Levels of actual community, sub-county, district and donor contributions (including funds, materials, time and expertise); . Timely implementation and quality of projects; . Appropriate use and accountability of community and donor resources; . Level of community involvement in the project; . Commitment and performance of community committees; and . Timely use of information generated through the community routine monitoring. Qualitative Enquiry: The district, in liaison with the sub-county, should organize Focus Group Discussions, Key Informant Interviews, and Community Group Discussions, with communities and other key informants at least twice a year. These enquiries would help the district to: . Verify some of the information collected by the community and district; . Get information on issues that are not captured during the routine monitoring; . Discuss on spot with the communities on possible solutions to problems hindering project performance; and . Discuss with the community, learn from them, explain capacity building issues. These qualitative enquiries should be simple and involve the community members to reduce the costs and enable the community members to learn how to conduct them as a means of community strengthening. The outputs should be analysed in relation to the community and routine district findings and should also be used to discuss solutions. Findings should be well documented and shared at the national level in order to assist national level management information. The major issues during the qualitative enquiries include: . Establishing whether the projects were the community priorities (also the appropriateness of the project identification); . Community members' knowledge and appreciation of the project methodology, and their willingness to participate and contribute to the project activities; . Effectiveness of the community members during project monitoring; . Opinions of community members on quality and use of resources (accountability); . Skills (eg decision making capacity and negotiation skills), acquired by specific categories of people in the community during project implementation; and . Community knowledge of their rights and obligations. Before qualitative enquiries, each district and sub-county should identify and discuss any management information gaps to form periodic themes. Specific designs would also be agreed upon at this stage. Monitoring at National and Donor Level: Monitoring at the national and donor level is to find out if project inputs are well used (desired outputs are being realised), project design is appropriate, and for learning. The objectives of monitoring at this level include: . To ensure that the inputs for are efficiently and effectively utilised. . That the planned activities are being realised; . To measure the applicability of the methodology to community strengthening; and . To draw lessons from the project intervention for future projects in the country and beyond. The lessons will provide the basis for project methodology replication. The methods for monitoring at this level include: (a) routine monitoring, (b) action research and qualitative enquiries, and (c) surveys. Routine Monitoring: Routine monitoring should be done on a quarterly basis by project staff and the ministry's planning unit to check on the levels of activities and objectives. Since the national level gets information about the projects and activities through monthly district progress reports, national routine monitoring should be limited in scope. It should cover aspects that appear contradictory, problematic, very satisfactory or unique. These would enable the national office to provide the necessary support and draw lessons. Action Research and Qualitative Enquiries: The national office should carry out in-depth qualitative enquiries once a year. These should focus on drawing lessons from the project design and implementation experiences for replication. Therefore, the major issues at this level include: . The contribution of community projects on national and donor priorities; . Satisfaction derived by the communities (levels of service and facility utilisation); . Capacity of the community to operate and maintain the services and facilities; . Ability of the community members to pay for the services and facilities; . Appropriateness of the project methodology in light of national policies; . Leadership, authority and confidence within communities; . Capacity building and functioning of Local Governments and District personnel; . Representation (especially of women) in the community decision making process; . Replication of experiences in other projects and training institutions; . Capacity building of existing individuals and institutions; and . The functioning of the monitoring and management information systems. Surveys: Surveys should also be conducted to gather quantifiable data and supplement the information generated through other methods. These can be contracted to research institutions such as at universities. Monitoring Issues and Procedures at Different Levels: Monitoring issues and procedures are described here for each level. This is to emphasise that the stake holders should spearhead but not exclusively carry out all monitoring. In practice, the issues and procedures of the different stake holders overlap. Each stake holder should support others in monitoring responsibilities. Issues mentioned here are not exhaustive but indicate what should be done. Each level should therefore collect information on any other issues deemed relevant to the particular situations. These are presented as three tables (1) community level, (2) district level, and (3) national level, indicating the key issues at each level. Community Level: At the community level the three main actors who have a stake in the community strengthening intervention are the: CBO Executive or Implementing Committee (CIC) of the community project; Community mobilizers; and Parish Development Committee (PDC). The following table looks at the main issues of interest, monitoring indicators, means of observing, frequency, and suggested monitoring procedures, for each of these three stake holders. ================================================================================ Stake | Issue | Monitoring | Means of | Freq. | Monitoring holder | | Indicator | Observing | | Procedure ===========|=============|==============|=============|========|================ Executive | Timely | Number of | Routine | weekly | Members use Committee | implemen- | project | project | | routine | tation of | activities | visits | | monitoring | projects | implemented | | | form | | in time | | | |-------------|--------------|-------------|--------|---------------- | Appropriate | No | Routine | weekly | Members use | use of | materials | project | | routine | project | misused | visits. | | monitoring | resources | | Project | | form. | | | quality | | Check | | | checks | | quality using | | | | | technician's | | | | | guidelines |-------------|--------------|-------------|--------|---------------- | Proper | Percentage | Reviewing | weekly | Members of | collection | of projects | the project | | the project | and storage | with project | site files | | committee | of project | site files. | | | review the | information | Number of | | | project site | | reports in | | | file; reports | | site files | | | and comments ===========|=============|==============|=============|========|================ Community | Realistic | Number of | Compare | month- | mobilizers (1) Mobilizers | project | project | activities | ly | review sequ- | implementa- | work plans | in the work | | ence of project | tion work | with well | plan with | | work plans with | plan | sequenced | how they're | | a technical | | activities | implemented | | person, and (2) | | | | | conduct monthly | | | | | site visits |-------------|--------------|-------------|--------|---------------- | Community | Number of | Amount of | month- | Project site | particip- | persons | resources | ly | visits; | ation in | performing | provided by | | discussions | project | their roles. | the | | with people | activities | Number of | community | | about their | | activities | | | contributions ===========|=============|==============|=============|========|================ Parish | Accounta- | Percentage | Resource | quart- | PDC members use Developmnt | bility | of resources | accounta- | erly | project resourc Committee | of project | accounted | bility | | accountability | resources | for | form | | form ================================================================================ Sub-County and District Level: At the district and sub district (more than one community) level, the main actors who have a stake in the community strengthening intervention are the: Community Development Assistants (CDAs); Planning Unit; and District Project Coordinator, (DPC) who, if a ministry official, is usually a Community Development officer (CDO), or an NGO equivalent. The following table looks at the main issues of interest, monitoring indicators, means of observing, frequency, and suggested monitoring procedures, for each of these three stake holders. ================================================================================ Stake | Issue | Monitoring | Means of | Freq. | Monitoring holder | | Indicator | Verification | Procedure ===========|=============|==============|=============|========|================ Community | Functioning | Number of | Review of | twice | During Developmnt | of mobili- | committees | each | a | qualitative Assistant | sers and | performing | committee's | year | enquiries, CDAs | community | their roles | performance | | determine | committees | | | | performance ===========|=============|==============|=============|========|================ District | Identifi- | Number of | Review of | twice | Planning Unit Project | cation of | projects | project | a | reviews plans Coordina- | projects | under the | identifica- | year | from parishes tor and | under the | district | tion | | to establish Planning | district | plan | reports. | | if they fall Unit | plan and | | Project | | under district | national | | visits | | plan and | priorities | | | | nat. priorities |-------------|--------------|-------------|--------|---------------- | Community | Number of | Review of | twice | Planning Unit | Leaders | villages | project | a | conducts | Acquisi- | using | reports. | year | qualitative | tion | community | Focus group | | enquiries; | of | participation discussions | | checking if | Community | in planning & and other | | district | Management | implementing | qualitative | | specific | Skills | projects | enquiries | | procedures ================================================================================ National and Donor Level: At the national or country level, there are two main stake holders, (1) The ministry or agency that is implementing the intervention or project, and (2) any external national or international donors that are contributing to the intervention or project. ================================================================================ Stake | Issue | Monitoring | Means of | Freq. | Monitoring holder | | Indicator | Verification | Procedure ===========|=============|==============|=============|========|================ National | Community | Proportion | Surveys, | Annu- | Agency or Office | knowledge | of people | focus group | ally | ministry and | of | aware of | discussions | | design and donors | methodology | methodology | interviews | | conduct |-------------|--------------|-------------|--------|---------------- | Effective- | Percentage | Review of | Annu- | Agency or | ness of the | of project | project | ally | ministry | project | outputs | reports, | | design or | design | attained. | surveys, | | conduct | | % of design | focus group | | annual | | aspects | discussions | | studies | | appreciated | key informant | | | by community | inteviews | | |-------------|--------------|-------------|--------|---------------- | Adoption of | Proportion | National | Annu- | Agency or | implementa- | of the | and inter- | ally | ministry | tion experi- project | national | | conducts | ences by | design | discussions | | meetings with | other pro- | aspects | | | academic | jects and | adopted | | | institutions | institutions | | | & community | in country | | | | projects ================================================================================ --» «-- If you copy any text from this site, please link it back to www.scn.org/cmp/ Updated: 2003 May 8