Monitoring and Evaluation System of Brazil Social Protection and Promotion Programmes

Tamanho: px

Começar a partir da página:

Download "Monitoring and Evaluation System of Brazil Social Protection and Promotion Programmes"

José de Almada Tavares
7 Há anos
Visualizações:

1 Monitoring and Evaluation System of Brazil Social Protection and Promotion Programmes Brasília, August 27, 2008 Brazil Africa Cooperation Program on Social Protection and Promotion Study Tour on Social Protection and Promotion

2 Monitoring and Evaluation Systems Evaluation & Monitoring Conducting of Research - Definition of Object; - Methodological Design; - Hiring Process; - Coordination and implementation; - Analysis of results. Development of Operational Systems -Input with data from different programmes; -Organization, hierarquization, and information providing; -Data base management; -Identification of variables and indicators Feedback - Programme Improvement Dissemination and Transparency - Publications - Seminars - Micro data for Social Information Consortium Strategic Information Availability -SIS; - Prepare Reports and Technical Notes; - Support Decision Making Training -Management of Social Policies; -Monitoring and Evaluation; -Social Control

3 Evaluation Emphasis on results that explore the reach and adequacy of objectives; Allows the improvement of programs and actions, and provides subsidies to planning, programming and decision making; Conducted through specific studies such as: Identification of target group; Service supply analysis regarding: relevance efficiency effectiveness results Impacts Analysis of sustainability of programmes and policies.

4 Evaluation Cycle 1. Discussion 2. Terms of Reference 3. Contract SAGI/SF Selection of the evaluation design Relevance of the proposed study SAGI/SF Preparation of ToR by SAGI SF revises TOR SPOA and/or International Cooperation Agency ToR approval Preparation of Tender Recruiting of the Executing Institution (IE) that presents the best project 4. Meetings/Important Definitions 5. Follow up 6. Final Results SAGI/SF/IE Definition of relevant questions for the study Accessibility to necessary data for research SAGI/IE Development of research tools Field visits Evaluation and approval of partial reports and final report SAGI/SF/IE Evaluation Findings and Recommendation (IE) Meeting with Managers Monitoring feedback 7. Share Findings 8. Publication 9. Share Micro Data SAGI/SF/IE Presenting final results to MDS Open seminars to general public SAGI Study Papers Research reports Books SAGI Send research's micro data files to CIS SAGI = Evaluation and Information Management Secretariat / SPOA= Planning, Budget and Administration Secretariat SF = Line Secretariat / IE= Executing Agency / CIS = Social Information Consortium

5 Researches Secretariats Researches on hiring process Ongoing Researches Researches Concluded Total SENARC SESAN SAIP SNAS MDS (Gen) Total Types and Methodologies: Poll Impact Baseline Diagnostic Qualitative Quantitative

6 8 Researches on Hiring Process (second program) 1. PBF: Impact Evaluation Third Round 5. BPC: Update of Entry Data 2. PBF: Impact Evaluation of the participation of PBF at PlanSeQ Bolsa Família 3. ProJovem Adolescente: Impact Evaluation 4. ProJovem Adolescente: Evaluation of the Implementation 6. BPC: Impact Evaluation 7. PAA: Evaluation of the impact on the lives of farmers who are beneficiaries 8. MDS (General): Nutritional Calls for Highly Vulnerable Population

7 18 Ongoing Researches (second program) 1. PBF: Case Study on Social Control 10. Reservoir: Evaluation of Program One Million of Rural Reservoirs 2. PBF: Impact Evaluation - Second Round 11. Community Kitchens: Project Evaluation 3. PAIF: Qualitative and Quantitative Studies 12. CONSAD: Project Evaluation 4. Productive Inclusion: Evaluation of Promotion of Youth Productive Inclusion Program 5. Youth Centers: Evaluation Research of the Youth Centers financed by MDS 13. Community Restaurants: Opinion Poll among users 14. Specific Populations: Evaluation of Project Implementation of Structuring Actions at Quilombola Communities 6. PETI: Quantitative Evaluation 15. MDS (general): Diagnostic Evaluation of Quilombola Communities Access to MDS Programs 7. PETI: Qualitative Evaluation 16. MDS (general): Impact Evaluation of Social Programs at Vale do Jequitinhonha (MG) managed by MDS 8. MUNIC 2009: Research on the Municipality basic information on social assistance 9. PAA: Evaluation - Modalidade Leite (Milk Modality) 17. MDS (general): Opinion Poll MDS Programs - Second Round. 18. MDS (general): Opinion Poll MDS Programs - Third Round.

8 Some Evaluation Results (examples) Youth Agent (FEC/DATAUFF): Exemplify the feedback process intended by evaluation research: Identified the strong and weak spots of the program; Presented suggestions for program reformulation. Results incorporated by MDS Program reformulation Projovem Adolescente

9 Some Evaluation Results (examples) Reservoirs (Cisternas) (FAGRO/EMBRAPA): Given that of 396 analysis conducted, 177 were considered contaminated (44,7%), MDS is discussing a Partnership Agreement with the Ministry of Health, with the objective to regularly monitor families beneficiaries of the program by Community Health Agents (ACS); The ACS will provide information on the use of sodium hypoclorite as water decontaminant agent. They will also provide information on how to use hypoclorite and where to get it.

10 Some Evaluation Results (examples) BPC (Fundep/Cedeplar): If the current concept for family could be altered to IBGE Family the expenditure with social benefits for the elderly would be reduced in 50%, and for people with special needs would be reduced in 14%. Bolsa Família Among families living in extreme poverty, those who are beneficiaries of Bolsa Família have a higher total expenditure, being that the major part is used to purchase food (R$388,22/year) (Fundep/Cedeplar); Impact on the social condition of women (AGENDE): Visibility of the beneficiaries as consumers; Affirmation of authority of these women within their home; Access to civil documents; Awareness and exercising citizenship.

11 Adopted Monitoring Concept Emphasis on the implementation process follow up; Continuous follow up of the demand for services and actions, as well as the development of programs and polices; Program management function that allows the adoption of corrective measures; Prepared by using primary information or by using systematic analysis of secondary data.

12 Monitoring Actions 1 Building and/or systematization of data bases 2 Development of Indicators 3 Development of information tools i. Social Information Matrix MI Social ii. Dictionary of Variables, Indicators and Social Programs DICVip iii. Social Atlas iv. Monitoring Card of CRAS 4 Research Monitoring

13 Information Tools Social Information Matrix: Intranet With data to support the monitoring process of social programs Previous Analysis and data study Internet With validated data available to the public DiciVip Dictionary of Variables, Indicators and Social Programs Monitoring Cards CRAS Georreferencing families

14 Social Information Matrix MI SOCIAL is a computer tool that stores data, information and indicators of social programs. Data can be presented as tables, excel spreadsheet, graphics and maps.

15 Social Atlas

16 Monitoring Cards CRAS Web-based Questionnaire for checking the operation status of the Social Assistance Reference Centre, with a dynamic module for information management CRAS filled by the managers

17 Monitoring Cards CRAS

18 Georreferencing Families Concluded for Curitiba/PR OBJECTIVE: to study ways of georreferencing PBF families and crossing with census information from IBGE

20 Management of Information and Technological Resources Preparation for a Social Vulnerability Index Execution: This index has already been defined by NOB/SUAS. However, there is a need to accurately define its composition; Technological Transference of MI Social- Bahia and Acre; Municipal data mapping, provided by SENARC, with IDF and Single Entry indicators; Training on MI Social PA/PR/BA/AC for State and Municipalities Staffs and multiplier agents (multiplicadores); Statistic Support for Line Secretariats.

21 Training Program on Social Management with Quality Project I SAGI/SNAS/SENARC Training of Multipliers and Social Managers who work with non-contributive Social Protection and the National Network on Decentralized Training (ongoing) Project II SENARC/SAGI Web-based distance learning course for local SUAS and PBF agents. It is a module program with remote support and specialized tutoring for the participants, with a duration of 18 months. (ongoing/senarc) Project III SAGI/SNAS Training of Social Assistance Counsellors (on bidding process) Project IV SAGI/SNAS Training for managers and technical officers on ProJovem Adolescente (in preparation) Specialization in Evaluation of Social Programs SAGI/ENAP MDS technical officers and others - 2 editions

22 Publications Study Papers Books Research Reports / Manuals Folders

Documentos relacionados

Panel 3: Improving the Delivery Services

UNITED NATIONS PUBLIC SERVICE DAY AND AWARDS CEREMONY Technical Seminar on Innovation in the Delivery of Public Services Panel 3: Improving the Delivery Services IMPLEMENTATION OF THE SELF-SUSTAINABLE