Purpose
The Survey Deliverables Assessment Sheet (SDAS) provides a structured framework for evaluating the quality, completeness, and compliance of surveybased deliverables. Version1.0 was released on 18February2022 to harmonise assessment practices across projects and to ensure that all stakeholders share a common understanding of expectations.
Scope
SDAS applies to any deliverable that originates from a datacollection effort using questionnaires, interviews, observation protocols, or electronic survey platforms. This includes:
- Final survey reports
- Data dictionaries
- Raw and processed data sets
- Methodology appendices
- Statistical analysis plans
The sheet is not intended for assessing nonsurvey artefacts such as design mockups, marketing collateral, or software code.
Structure of the Assessment Sheet
SDAS is organized into five major blocks, each addressing a distinct dimension of quality:
1. Documentation and Metadata
This block checks that the deliverable includes clear, versioncontrolled documentation, a comprehensive metadata record, and a traceability matrix linking data items to source questions.
2. Data Quality
Assessors verify completeness, validity, and consistency of the data set. Key indicators include missingvalue handling, range checks, and logical crossvalidation.
3. Methodological Rigor
Here the focus is on sampling design, response rate calculations, weighting procedures, and the justification of any methodological adjustments.
4. Analytical Transparency
Evaluates whether analytical steps are reproducible, code scripts are archived, and statistical assumptions are documented.
5. Presentation and Accessibility
Considers readability, use of visual aids, adherence to style guides, and the provision of accessible formats (e.g., machinereadable CSV files).
Scoring System
Each item within the five blocks is rated on a threepoint scale:
- Compliant (C) Fully meets the requirement.
- Partially Compliant (P) Meets the requirement in part; minor gaps exist.
- NonCompliant (N) Does not meet the requirement.
Scores are recorded in the table below. A cumulative compliance percentage is calculated for an overall assessment.
| Block | Item | Rating (C/P/N) | Comments |
|---|---|---|---|
| Documentation & Metadata | Version control applied | ||
| Complete data dictionary | |||
| Traceability matrix present | |||
| Data Quality | Missingvalue analysis performed | ||
| Logical consistency checks | |||
| Outlier detection documented | |||
| Imputation methodology justified | |||
| Methodological Rigor | Sampling frame described | ||
| Response rate calculated | |||
| Weighting procedures applied | |||
| Analytical Transparency | Analysis code archived | ||
| Assumptions clearly stated | |||
| Results reproducible | |||
| Presentation & Accessibility | Report follows style guide | ||
| Figures and tables labeled | |||
| Data files in open format |
Overall compliance is calculated as:
Overall % = (Number of C + 0.5 Number of P) / Total Items 100
How to Use the Sheet
- Preparation Ensure that the deliverable version under review is final and that all supporting files are accessible.
- Review One qualified assessor completes the rating columns, providing concise comments where necessary.
- Verification A second assessor validates the ratings. Discrepancies are resolved through discussion.
- Reporting The completed sheet is attached to the projects qualityassurance package and circulated to stakeholders.
Roles and Responsibilities
Lead Survey Analyst Oversees the preparation of documentation and ensures that raw data comply with the quality standards before the assessment.
Quality Assurance Officer Conducts the primary assessment using the SDAS, records findings, and escalates noncompliances.
Project Manager Reviews the completed sheet, decides on remedial actions, and signs off on final acceptance.
Common Findings and Remediation
Missing Metadata
Issue: Absence of variable labels or coding schemes.
Remedy: Populate the data dictionary with clear descriptions and code mappings before final submission.
Inadequate Response Rate Documentation
Issue: Response rate not calculated or missing denominator information.
Remedy: Include the total number of invitations, completed interviews, and the formula used for the response rate.
NonReproducible Analyses
Issue: Analysis scripts are not archived or lack comments.
Remedy: Store scripts in a versioncontrolled repository and add inline documentation.
Version History
- 1.0 (18Feb2022) Initial release; defines blocks, rating scale, and template.
- 1.1 (planned Q42022) Anticipated addition of a riskassessment column.
