Objective To develop a tool for use by non-clinical fieldworkers for assessing the quality of care delivered by community health workers providing comprehensive care in households in low- and middle-income countries.

Design We determined the content of the tool using multiple sources of information, including interactions with district managers, national training manuals and an exploratory study that included observations of 70 community health workers undertaking 518 household visits collected as part of a wider study. We also reviewed relevant literature, selecting relevant domains and quality markers. To refine the tool and manual we worked with the fieldworkers who had undertaken the observations. We constructed two scores summarising key aspects of care: (1) delivering messages and actions during household visit, and (2) communicating with the household; we also collected contextual data. The fieldworkers used the tool with community health workers in a different area to test feasibility.

Setting South Africa, where community health workers have been brought into the public health system to address the shortage of healthcare workers and limited access to healthcare. It was embedded in an intervention study to improve quality of community health worker supervision.

Primary and secondary outcomes Our primary outcome was the completion of a tool and user manual.

Results The tool consists of four sections, completed at different stages during community health worker household visits: before setting out, at entry to a household, during the household visit and after leaving the household. Following tool refinement, we found no problems on field-testing the tool.

Conclusions We have developed a tool for assessing quality of care delivered by community health workers at home visits, often an unobserved part of their role. The tool was developed for evaluating an intervention but could also be used to support training and management of community health workers.