Armenia - Water to Market Farmer Training 2007-2011, Independent Impact Evaluation

Primary tabs

The Farming Practices Survey (FPS) was commissioned by MCC to evaluate the impact of Water-to-Market (WtM) activities, particularly farmer training, on rural farmers in Armenia. Fielded by a consortium of AREG, an Armenia-based NGO, and Jen Consult, the FPS is a longitudinal survey of farming households interviewed at three points in time. FPS1 was conducted in 2007, before farmer training began. A second round was conducted one year after training began. Data from the second round is not included in this package. FPS3, the final round, was conducted three years after training began. This public-use file includes de-identified data from respondents to FPS3 and FPS1. Households were selected for FPS1 interviews based on their likelihood of participating in WtM training, as assessed by mayors using criteria provided by the survey team. This process was used so that the surveyed households would include a high proportion of WtM participants. Each round of the FPS asked each household about their cropping patterns, irrigation and agricultural practices, crop yields, agricultural revenues and costs, other household expenditures, household employment, and other sources of household income.

Type: 
Microdata
Acronym: 
MCC-WMFT 2007-11
Languages Supported: 
English
Topics: 
Topic not specified
Geographical Coverage: 
Armenia
Economy Coverage: 
Economy Coverage not specified
Release Date: 
May 28, 2015

Last Updated

Last Updated: 
July 30, 2020

Harvest System ID

Harvest System ID: 
Microdata

Harvest Source ID

Harvest Source ID: 
7495
Version Description: 
Version 1.3 (Nov 2013). This version uses an updated MCC metadata template. Version 2.0 (April 2015). Edited version based on Version 01 (DDI-MCC-ARM-MPR-FPS-2006-v1.3) that was done by Millennium Challenge Corporation. Version 3 (July 2020). This version provides description of the data
Version Production Date: 
Tuesday, July 28, 2020
Publisher Name: 

Mathematica Policy Research, Inc.

Funding Name, Abbreviation, Role: 
Millennium Challenge Corporation
Universe: 
The survey covered farming households in rural communities that were included in the evaluation sample for the Water-to-Market impact evaluation.
Primary Investigator Name, Affiliation: 
Mathematica Policy Research, Inc.
Sampling Procedure: 
The evaluation design for the WtM activities dictated the sampling frame and approach to the FPS. The target was to complete interviews with approximately 25 farmers in each of 189 village clusters that was selected to be in the evaluation of WtM training. Village clusters consist of up to 4 small, neighboring villages, and the 189 selected village clusters cover 211 villages. The village clusters are indicated in the variable "clusteringcode_b". The baseline survey did not randomly sample respondents from the village clusters. The field team identified respondents for the FPS by working with village mayors to identify farmers who were likely to participate in WtM training so that a high proportion of farmers who were interviewed would have participated in training. The criteria were designed to align with the characteristics of farmers participating in ACDI's training programs, most notably, being actively engaged in farming, having modest farm area, living in the community for several years, and being between 25 and 70 years old. AREG updated the sample list with the assistance of village mayors and marz officials, either at the marz offices or in the village itself. AREG and mayors targeted the households of farmers who were actively engaged in farming and had lived in the community for several years. Ultimately, a total of 4,715 farming households were interviewed for FPS1 in relevant communities. These same households were targeted for FPS3, which acheived a response rate of 75%.
Deviations from Sample Design: 
Three villages that were originally sampled for the FPS were not surveyed at final follow-up. Two villages that were surveyed at baseline were not surveyed at final follow-up because they were found to have almost no active farmers. A third village was not accessible for the baseline FPS due to heavy snow. The rest of the villages in these WUAs were surveyed at baseline and final follow-up according to the sample design. For FPS3, MCA-Armenia also added the objective of surveying recipients of MCA credit. As a result, the FPS3 was administered to 33 new farmers who had not been interviewed in FPS1 and had received MCA credit.
Response Rates: 
The FPS3 was administered to 3,547 households, 75 percent of households that participated in FPS1.
Weighting: 
Nonresponse weights were constructed to account for households that responded to FPS1 and did not respond to FPS3. The variable "nonresp_wt" contains these weights. The nonresponse weights were computed by first calculating the propensity of a household's nonresponse in the FPS3. The second step in creating nonresponse weights was to use the predicted values from the response propensity models to create weighting cells. Within each research group (treatment and control), five weighting cells were created that were determined by the size of the predicted likelihood that the household responded to the survey. This resulted in a total of 10 (5 x 2) weighting cells. The same nonresponse weight was assigned within each of these 10 cells. The third step was to create the nonresponse weight for each cell. The nonresponse weight was calculated by dividing the total number of households in each cell by the total number of households that responded to the survey in each cell. Finally, the weights were rescaled such that the sum of weights for the treatment group and the sum of weights for the control group each equal the original sample size of 4,715. Additional details of the calculations of nonresponse weights are provided in Appendix A of the Water-to-Market Evaluation report, which is provided as a resource document.
Questionnaires: 
There is one questionnaire for the FPS3. The FPS3 is based on the questionnaire used in FPS1 and the Integrated Survey of Living Standards (ISLS) implemented annually by the National Statistical Service of Armenia (NSS). The FPS3 is published in Armenian and English. It is intended to be administered to the person in the household with the most knowledge of farming activities on the household's land holdings. The FPS3 and FPS1 are provided as external resources. The FPS3 was designed with guidance from MCA-Armenia, MCC, and Mathematica. Relative to FPS1, FPS3 has some minor changes in structure and an additional section on agricultural credit. In addition to questions regarding agricultural credit, the FPS3 asks about various demographic and socioeconomic characteristics for each member of the household, including sex, age, relationship, education level, and occupation. At the household level, the FPS3 asks the respondent about agricultural trainings, land holdings, agricultural practices, production of major crops, agricultural sales and revenues, income, and expenses.
Data Collector(s) Name: 
Jen Finance, Engineering, and Management Consult Ltd. with AREG Scientific Cultural Youth Association Non-Governmental Organization
Supervision: 
The thirty interviewers were divided into 5 groups, each led by a field coordinator. The Administrative Assistant to the Team Leader at AREG supervised the fieldwork and observed several interviews in the field. The field coordinators reported at least weekly to the Team Leader, Senior Researcher, and Administrative Assistant to the Team Leader at AREG. The role of the Team Leader was to manage all aspects of the pre-test, sample verification, and data collection. The Team Leader also communicated the progress of the fieldwork with MCA-Armenia and MPR. The role of the Senior Researcher was to provide guidance on survey implementation, pre-tests, and revisions to the FPS3. The Senior Researcher was also responsible for interviewer training and developing the data processing and quality control approaches. The Administrative Assistant to the Team Leader was responsible for selecting the interviewers, scheduling interviewers, and supervising fieldwork coordinators, the sample verification team, and the quality control team.
Data Editing: 
After interviewers completed each questionnaire, the interviewers reviewed the questionnaire entries and submitted them to the field coordinator for cross-editing. During data entry in SPSS, mistakes were corrected using visual and program control. In the analysis phase, subsequent edits were made to logically impute data where appropriate.
Estimates of Sampling Error: 
Impacts of the WtM training program were estimated within a regression framework that controlled for baseline measures. Standard errors for the impact estimates were clustered at the village cluster level using Huber-White style "sandwich" estimators. Standard errors for key impact estimates are provided in Appendix B of the Water-to-Market Evaluation report, which is provided as a resource document.
Time Periods: 
August, 2017

No Visualizations Available.

Millennium Challenge Corporation, Farming Practices Survey 2006-07 (FPS1) and Farming Practices Survey 2010-11 (FPS3), Version 2.0 of the public use dataset (August 2012). www.mcc.gov

The Farming Practices Survey (FPS) was commissioned by MCC to evaluate the impact of Water-to-Market (WtM) activities, particularly farmer training, on rural farmers in Armenia. Fielded by a consortium of AREG, an Armenia-based NGO, and Jen Consult, the FPS is a longitudinal survey of farming households interviewed at three points in time. FPS1 was conducted in 2007, before farmer training began. A second round was conducted one year after training began. Data from the second round is not included in this package. FPS3, the final round, was conducted three years after training began. This public-use file includes de-identified data from respondents to FPS3 and FPS1. Households were selected for FPS1 interviews based on their likelihood of participating in WtM training, as assessed by mayors using criteria provided by the survey team. This process was used so that the surveyed households would include a high proportion of WtM participants. Each round of the FPS asked each household about their cropping patterns, irrigation and agricultural practices, crop yields, agricultural revenues and costs, other household expenditures, household employment, and other sources of household income.

FieldValue
Modified Date
2020-07-31
Release Date
Identifier
85c30a01-a38f-4ee5-92c2-42b494d529c2
License
License Not Specified
Contact Email
Rating: 
0
No votes yet
Acronym: 
MCC-WMFT 2007-11
Type: 
Languages Supported: 
Response Rates: 
The FPS3 was administered to 3,547 households, 75 percent of households that participated in FPS1.
Weighting: 
Nonresponse weights were constructed to account for households that responded to FPS1 and did not respond to FPS3. The variable "nonresp_wt" contains these weights. The nonresponse weights were computed by first calculating the propensity of a household's nonresponse in the FPS3. The second step in creating nonresponse weights was to use the predicted values from the response propensity models to create weighting cells. Within each research group (treatment and control), five weighting cells were created that were determined by the size of the predicted likelihood that the household responded to the survey. This resulted in a total of 10 (5 x 2) weighting cells. The same nonresponse weight was assigned within each of these 10 cells. The third step was to create the nonresponse weight for each cell. The nonresponse weight was calculated by dividing the total number of households in each cell by the total number of households that responded to the survey in each cell. Finally, the weights were rescaled such that the sum of weights for the treatment group and the sum of weights for the control group each equal the original sample size of 4,715. Additional details of the calculations of nonresponse weights are provided in Appendix A of the Water-to-Market Evaluation report, which is provided as a resource document.
Estimates of Sampling Error: 
Impacts of the WtM training program were estimated within a regression framework that controlled for baseline measures. Standard errors for the impact estimates were clustered at the village cluster level using Huber-White style "sandwich" estimators. Standard errors for key impact estimates are provided in Appendix B of the Water-to-Market Evaluation report, which is provided as a resource document.
Time Periods: 
August, 2017
Supervision: 
The thirty interviewers were divided into 5 groups, each led by a field coordinator. The Administrative Assistant to the Team Leader at AREG supervised the fieldwork and observed several interviews in the field. The field coordinators reported at least weekly to the Team Leader, Senior Researcher, and Administrative Assistant to the Team Leader at AREG. The role of the Team Leader was to manage all aspects of the pre-test, sample verification, and data collection. The Team Leader also communicated the progress of the fieldwork with MCA-Armenia and MPR. The role of the Senior Researcher was to provide guidance on survey implementation, pre-tests, and revisions to the FPS3. The Senior Researcher was also responsible for interviewer training and developing the data processing and quality control approaches. The Administrative Assistant to the Team Leader was responsible for selecting the interviewers, scheduling interviewers, and supervising fieldwork coordinators, the sample verification team, and the quality control team.
Economy Coverage: 
Primary Investigator Name, Affiliation: 
Mathematica Policy Research, Inc.
Publisher Name: 
Mathematica Policy Research, Inc.
Version Description: 
Version 1.3 (Nov 2013). This version uses an updated MCC metadata template. Version 2.0 (April 2015). Edited version based on Version 01 (DDI-MCC-ARM-MPR-FPS-2006-v1.3) that was done by Millennium Challenge Corporation. Version 3 (July 2020). This version provides description of the data
Subtitle: 
Independent Impact Evaluation
Universe: 
The survey covered farming households in rural communities that were included in the evaluation sample for the Water-to-Market impact evaluation.
Geographical Coverage: 
Data Classification of a Dataset: 
Version Production Date: 
Tuesday, July 28, 2020
Sampling Procedure: 
The evaluation design for the WtM activities dictated the sampling frame and approach to the FPS. The target was to complete interviews with approximately 25 farmers in each of 189 village clusters that was selected to be in the evaluation of WtM training. Village clusters consist of up to 4 small, neighboring villages, and the 189 selected village clusters cover 211 villages. The village clusters are indicated in the variable "clusteringcode_b". The baseline survey did not randomly sample respondents from the village clusters. The field team identified respondents for the FPS by working with village mayors to identify farmers who were likely to participate in WtM training so that a high proportion of farmers who were interviewed would have participated in training. The criteria were designed to align with the characteristics of farmers participating in ACDI's training programs, most notably, being actively engaged in farming, having modest farm area, living in the community for several years, and being between 25 and 70 years old. AREG updated the sample list with the assistance of village mayors and marz officials, either at the marz offices or in the village itself. AREG and mayors targeted the households of farmers who were actively engaged in farming and had lived in the community for several years. Ultimately, a total of 4,715 farming households were interviewed for FPS1 in relevant communities. These same households were targeted for FPS3, which acheived a response rate of 75%.
Deviations from Sample Design: 
Three villages that were originally sampled for the FPS were not surveyed at final follow-up. Two villages that were surveyed at baseline were not surveyed at final follow-up because they were found to have almost no active farmers. A third village was not accessible for the baseline FPS due to heavy snow. The rest of the villages in these WUAs were surveyed at baseline and final follow-up according to the sample design. For FPS3, MCA-Armenia also added the objective of surveying recipients of MCA credit. As a result, the FPS3 was administered to 33 new farmers who had not been interviewed in FPS1 and had received MCA credit.
Release Date: 
Thursday, May 28, 2015
Last Updated Date: 
Thursday, July 30, 2020
Questionnaires: 
There is one questionnaire for the FPS3. The FPS3 is based on the questionnaire used in FPS1 and the Integrated Survey of Living Standards (ISLS) implemented annually by the National Statistical Service of Armenia (NSS). The FPS3 is published in Armenian and English. It is intended to be administered to the person in the household with the most knowledge of farming activities on the household's land holdings. The FPS3 and FPS1 are provided as external resources. The FPS3 was designed with guidance from MCA-Armenia, MCC, and Mathematica. Relative to FPS1, FPS3 has some minor changes in structure and an additional section on agricultural credit. In addition to questions regarding agricultural credit, the FPS3 asks about various demographic and socioeconomic characteristics for each member of the household, including sex, age, relationship, education level, and occupation. At the household level, the FPS3 asks the respondent about agricultural trainings, land holdings, agricultural practices, production of major crops, agricultural sales and revenues, income, and expenses.
Data Editing: 
After interviewers completed each questionnaire, the interviewers reviewed the questionnaire entries and submitted them to the field coordinator for cross-editing. During data entry in SPSS, mistakes were corrected using visual and program control. In the analysis phase, subsequent edits were made to logically impute data where appropriate.
Harvest Source: 
Harvest System ID: 
7495
Citation Text: 
Millennium Challenge Corporation, Farming Practices Survey 2006-07 (FPS1) and Farming Practices Survey 2010-11 (FPS3), Version 2.0 of the public use dataset (August 2012). www.mcc.gov
Modified date: 
18473
Primary Dataset: 
Yes
Data Collector(s) Name: 

Jen Finance, Engineering, and Management Consult Ltd. with AREG Scientific Cultural Youth Association Non-Governmental Organization

Funding Name, Abbreviation, Role: 

Millennium Challenge Corporation

Data Access and Licensing

This dataset is classified as Public under the Access to Information Classification Policy. Users inside and outside the Bank can access this dataset.

This dataset is available from an external third-party website. Visit the website to obtain license information. More information

Share Metadata

The information on this page (the dataset metadata) is also available in these formats.

PRINT EMAIL JSON RDF