{"id":29,"date":"2024-04-04T04:34:36","date_gmt":"2024-04-04T01:34:36","guid":{"rendered":"https:\/\/sisu.ut.ee\/water\/42-audit-design-matrices-selected-water-issues\/"},"modified":"2024-04-04T04:35:04","modified_gmt":"2024-04-04T01:35:04","slug":"42-audit-design-matrices-selected-water-issues","status":"publish","type":"page","link":"https:\/\/sisu.ut.ee\/water\/42-audit-design-matrices-selected-water-issues\/","title":{"rendered":"4.2. Audit design matrices for selected water issues"},"content":{"rendered":"

When the audit objective is decided, it is time start planning the audit. Deriving from audit focus, auditors have to phrase the audit objective<\/strong> (e.g. evaluate the effectiveness of protecting groundwater from diffuse pollution from agriculture).<\/p>\n

Next, one needs to think about audit questions<\/strong> which need to be answered in order to meet the audit objective. Audit questions are usually broken into sub-questions<\/strong>. It is common to use closed (yes\/no) questions in audit.\u00a0Sub-questions are selected in such way that, if they are answered positively, the main question is also answered positively.\u00a0<\/p>\n

\"42_1.png\"<\/p>\n

If necessary, open questions (why?) are added to better understand the reasons for problems under scrutiny.<\/p>\n

For evaluating the situation, each audit question is equipped with criteria<\/strong> \u2013 often deriving from legal acts, but also strategic documents and international agreements.\u00a0Due to its rather detailed nature, the Water Framework Directive serves as a good source of criteria for the audit offices of the EU countries.\u00a0<\/p>\n

\"42.png\"<\/p>\n

Criteria describe the desired situation and are the main basis for the auditor\u2019s evaluation. In case of absence of legal acts, auditors may use criteria which have been discussed and agreed upon with the auditee.<\/p>\n

At this point, auditors need to consider which methods<\/strong> are most suitable for collecting and analysing information.\u00a0Methods used in audits related to water management do not differ substantially from other performance audits. However, in case of a lack of data on water quality or the questionable quality of such data, external experts may be hired.<\/span><\/p>\n

Audit design matrix (ADM)<\/strong> is a common tool widely used by auditors for organising audit questions, criteria and selecting suitable audit methods. Below you can see two audit matrices.<\/p>\n

For more information on designing an ADM please visit MOOC: Introduction on Environmental Auditing<\/a>.<\/p>\n

Table 4: Example of an audit matrix\u00a0 \u00a0 \u00a0 \u00a0 \u00a0\u00a0<\/h4>\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
\n

Audit title: <\/strong>Protection of groundwater from agriculture<\/strong><\/p>\n<\/td>\n<\/tr>\n

\n

Audit objective: <\/strong>Evaluate the effectiveness of protecting groundwater from diffuse pollution from agriculture<\/p>\n<\/td>\n<\/tr>\n

\n

Audit question 1:\u00a0<\/strong>Has the quality of groundwater improved over time?<\/strong><\/p>\n<\/td>\n<\/tr>\n

\n

Sub-questions<\/em><\/strong><\/p>\n<\/td>\n

\n

Criteria<\/em><\/strong><\/p>\n<\/td>\n

\n

Methods (incl. information sources)<\/em><\/strong><\/p>\n<\/td>\n

\n

Expected findings<\/em><\/strong><\/p>\n<\/td>\n<\/tr>\n

1. Is the quality of groundwater monitored regularly?<\/td>\n\n
    \n
  • National monitoring programme includes monitoring of groundwater in C % of wells at least in D years.<\/li>\n<\/ul>\n<\/td>\n
\n

Review of monitoring data<\/p>\n<\/td>\n

\n

Water quality is monitored only in Z region.<\/p>\n<\/td>\n<\/tr>\n

\n
    <\/ol>\n

    2.\u00a0Is the quality of water maintained?<\/p><\/td>\n

\n
    \n
  • Water quality corresponds to the indicators of good water status<\/li>\n<\/ul>\n<\/td>\n
\n

Analysis of monitoring data<\/strong><\/p>\n<\/td>\n

\n

Water quality does not meet quality standards in all wells. Deterioration of water quality has been noticed in Y% of wells.<\/p>\n<\/td>\n<\/tr>\n

\n

Audit question 2:\u00a0<\/strong>Has the government established requirements for preventing diffuse pollution?<\/strong><\/p>\n<\/td>\n<\/tr>\n

1. Does the water law regulate diffuse pollution?\u00a0<\/td>\n\n
    \n
  • The water law is harmonised to WFD;<\/li>\n
  • water law includes provisions for preventing pollution from all households<\/li>\n<\/ul>\n<\/td>\n
\n

Legal analysis<\/p>\n<\/td>\n

\n

Water law regulates only pollution from large municipalities not from small households.<\/p>\n<\/td>\n<\/tr>\n

2.\u00a0\u00a0<\/strong>Does the RBMP include targets for reducing diffuse pollution?\u00a0\u00a0<\/strong><\/td>\n\n
    \n
  • Targets for reducing diffuse pollution as set in the RBMP<\/li>\n<\/ul>\n<\/td>\n
\n

Legal analysis<\/p>\n<\/td>\n

\n

Targets for major sources of diffuse pollution are outlined in the RBMP, but deadlines are very long (30 years).<\/p>\n<\/td>\n<\/tr>\n

3. Are there regulations for limiting the use of fertilisers and pesticides?\u00a0<\/td>\n\n
    \n
  • Legislation includes provisions for the use of pesticides and fertilisers according to the WFD<\/li>\n<\/ul>\n<\/td>\n
\n

Legal analysis<\/p>\n<\/td>\n

\n

There is a good practice guideline for farmers.<\/p>\n<\/td>\n<\/tr>\n

\n

Audit question 3:\u00a0<\/strong>Are the regulations for protecting groundwater enforced?<\/strong><\/p>\n<\/td>\n<\/tr>\n

1. Are the main polluters known to the government?<\/td>\n\n
    \n
  • Pollution sources are analysed in an inventory to prepare the RBMP;<\/li>\n
  • The environmental inspectorate is monitoring the pollution levels regularly and finds the pollution sources.<\/li>\n<\/ul>\n<\/td>\n
\n

Review of the RBMP and its planning documents;<\/p>\n

Interview with officials responsible for the RBMP;<\/p>\n

interview in the environmental inspectorate<\/p>\n<\/td>\n

\n

Some pollution sources that were recently discussed in the media were not known to the environmental inspectorate until its members got such information from newspaper sources.<\/p>\n<\/td>\n<\/tr>\n

2. Do farmers follow the good practice guideline?<\/td>\n\n
    \n
  • 90% of farmers follow the good practice guideline<\/li>\n<\/ul>\n<\/td>\n
\n

Online survey;<\/p>\n

Interviews with 10 farmers (selected based on the online survey).<\/p>\n<\/td>\n

\n

Some farmers follow the guideline; practice is varied.<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

\u00a0<\/p>\n

Table 5: Example 2 of an audit matrix<\/h4>\n\n\n\n\n\n\n\n\n\n\n
\n

Audit title: <\/strong>Drinking water management<\/strong><\/p>\n<\/td>\n<\/tr>\n

\n

Audit objective: <\/strong>Evaluate the effectiveness of the management of drinking water supply<\/p>\n<\/td>\n<\/tr>\n

\n

Main audit question:\u00a0 <\/strong>Is the provision of drinking water supply effectively organized?<\/strong><\/p>\n<\/td>\n<\/tr>\n

\n

Sub-questions<\/em><\/strong><\/p>\n<\/td>\n

\n

Criteria<\/em><\/strong><\/p>\n<\/td>\n

\n

Methods (incl. information sources)<\/em><\/strong><\/p>\n<\/td>\n

\n

Expected findings<\/em><\/strong><\/p>\n<\/td>\n<\/tr>\n

1. Have legal provisions and a policy framework related to drinking water supply been established?<\/td>\n\n
    \n
  • Systemic legal provisions and a policy framework are in place and address risks related to the supply and safety of drinking water;<\/li>\n
  • Responsible agencies have been identified along with clear roles and responsibilities, and activities are coordinated<\/li>\n<\/ul>\n<\/td>\n
\n

Analysis of relevant international and domestic legislation;<\/p>\n

Document analysis (e.g. water management plans);<\/p>\n

Interviews, questionnaires<\/p>\n<\/td>\n

\n

A coherent legal framework is missing, and the activities of various agencies need to be more coordinated; Objectives set in legislation need clear expression through policy and planning instruments.<\/p>\n<\/td>\n<\/tr>\n

2. Is monitoring of drinking water supply effective?<\/td>\n\n
    \n
  • Monitoring programmes have been established and are adequately funded;<\/li>\n
  • Identified shortcomings are addressed and eliminated;<\/li>\n
  • Quality standards for drinking water are met<\/li>\n<\/ul>\n<\/td>\n
\n

Analysis of relevant legislation and documentation;<\/p>\n

Interviews, questionnaires;<\/p>\n

Data collection (e.g. monitoring data, permits)<\/strong><\/p>\n<\/td>\n

\n

Monitoring arrangements are in place, but there are shortcomings in the regularity and comprehensiveness of quality testing. Facilities for water quality testing need investments.<\/p>\n<\/td>\n<\/tr>\n

3. Is access to safe drinking water services ensured?<\/td>\n\n
    \n
  • All public water supply systems meet quality standards;<\/li>\n
  • Information on non-compliance and potential risks connected to the quality of drinking water is publicly available;<\/li>\n
  • The price of drinking water is not an obstacle to drinking-water access<\/li>\n<\/ul>\n<\/td>\n
\n

Review of monitoring data on drinking water supply systems;<\/p>\n

Analysis of reasons for non-compliance (interviews with owners);<\/p>\n

Review of publicly available data<\/p>\n

Expert financial analysis of price of water<\/p>\n<\/td>\n

\n

X share of the population is connected to water supply systems in which the drinking water does not meet quality standards; Corresponding data needs to be publicly accessible.<\/p>\n<\/td>\n<\/tr>\n

4. Are the pricing principles established in a financially sustainable way?<\/td>\n\n
    \n
  • Service prices of water supply are set after evaluating required costs, and allow for necessary investments;<\/li>\n
  • Continuity of the operation of water suppliers is ensured<\/li>\n<\/ul>\n

    \u00a0<\/p>\n<\/td>\n

\n

Analysis of relevant legislation and documentation on pricing;<\/p>\n

Interviews;<\/p>\n

Data collection;<\/p>\n

Review of international (best) practices<\/p>\n<\/td>\n

\n

Tariffs must be revised as they will not cover the costs of water suppliers in the long term and rehabilitation of ageing supply systems may prove difficult without government subsidies.\u00a0<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/p>\n

Table 6: Example 3 of an audit matrix<\/h4>\n\n\n\n\n\n\n\n\n\n\n\n\n\n
\n

Audit title: <\/strong>Effectiveness of the financial programme X in protecting Y river basin<\/strong><\/p>\n<\/td>\n<\/tr>\n

\n

Audit objective:<\/strong> Evaluate whether the programme X for enhancing the status of water bodies in poor and bad status in Y river basin has been effective and efficient.<\/p>\n<\/td>\n<\/tr>\n

\n

Audit question 1:\u00a0 <\/strong>Has the status of water bodies, which were earlier in bad or poor status improved since the implementation of the programme X?<\/strong><\/p>\n<\/td>\n<\/tr>\n

\n

Sub-questions<\/em><\/p>\n<\/td>\n

\n

Criteria<\/em><\/p>\n<\/td>\n

\n

Methods (incl. information sources)<\/em><\/p>\n<\/td>\n

\n

Expected findings<\/em><\/p>\n<\/td>\n<\/tr>\n

\n

1.1\u00a0\u00a0 Was the programme designed according to the objectives of the Y river basin management plan?<\/p>\n<\/td>\n

\n
    \n
  • Objectives of the programme X derive from the Y river basin management plan<\/li>\n<\/ul>\n<\/td>\n
\n

Comparison of the objectives of the Y river basin management plan and programme X<\/p>\n<\/td>\n

\n

Most objectives follow the Y river basin management plan.Some objectives of Y river basin management plan were omitted; however, they should have been included.<\/p>\n<\/td>\n<\/tr>\n

\n

1.2\u00a0\u00a0 Has the chemical status of the water bodies improved?<\/p>\n<\/td>\n

\n
    \n
  • water quality is regularly monitored<\/li>\n
  • water quality has improved according to the standards established for chemical substances<\/li>\n<\/ul>\n<\/td>\n
\n

Analysis of monitoring data<\/p>\n

Interviews with experts<\/p>\n<\/td>\n

\n

Water quality has somewhat improved. The level of some chemicals in some water bodies has remained above the level of standard<\/p>\n<\/td>\n<\/tr>\n

\n

1.3\u00a0\u00a0 Has the ecological status of water bodies improved?<\/p>\n<\/td>\n

\n
    \n
  • Ecological characteristics are regularly monitored<\/li>\n<\/ul>\n

    Ecological status has improved according to the standards established for biological elements and physicochemical characteristics<\/p>\n<\/td>\n

\n

Analysis of monitoring data<\/p>\n

Interviews with experts<\/strong><\/p>\n<\/td>\n

\n

Ecological status has somewhat improved in some water bodies. Endangered species have not returned to water bodies under study.<\/p>\n<\/td>\n<\/tr>\n

\n

Audit question 2:\u00a0 <\/strong>Was money used efficiently for managing programme X?<\/p>\n

\u00a0<\/strong><\/p>\n<\/td>\n<\/tr>\n

\n

Sub-questions<\/em><\/p>\n<\/td>\n

\n

Criteria<\/em><\/p>\n<\/td>\n

\n

Methods (incl. information sources)<\/em><\/p>\n<\/td>\n

\n

Expected findings<\/em><\/p>\n<\/td>\n<\/tr>\n

\n

2.1\u00a0\u00a0 Were the projects selected according to the objectives of the programme?<\/p>\n<\/td>\n

\n
    \n
  • Project selection criteria reflected the objectives of the programme<\/li>\n
  • All project met the selection criteria<\/li>\n<\/ul>\n<\/td>\n
\n

Review of project documentation (programme, project proposals, protocols of selection committee meetings)<\/p>\n

\u00a0<\/p>\n<\/td>\n

\n

Most projects follow the objectives of the programme, but some projects fail to meet the objectives.<\/p>\n<\/td>\n<\/tr>\n

\n

2.2\u00a0\u00a0 Were the projects conducted according to conditions of the programme?<\/p>\n<\/td>\n

\n
    \n
  • All project activities were carried out according to the plan<\/li>\n
  • Money was used according to project plans<\/li>\n<\/ul>\n<\/td>\n
\n

Analysis of relevant documentation (project reports, financial reports)<\/p>\n

Interviews<\/p>\n

\u00a0<\/strong><\/p>\n<\/td>\n

\n

Most projects were carried out according to the plan. Some activities were not carried out in some projects.<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"excerpt":{"rendered":"

When the audit objective is decided, it is time start planning the audit. Deriving from audit focus, auditors have to phrase the audit objective (e.g. evaluate the effectiveness of protecting groundwater from diffuse pollution from agriculture). Next, one needs to …<\/p>\n","protected":false},"author":6,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"class_list":["post-29","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/sisu.ut.ee\/water\/wp-json\/wp\/v2\/pages\/29","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sisu.ut.ee\/water\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/sisu.ut.ee\/water\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/sisu.ut.ee\/water\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/sisu.ut.ee\/water\/wp-json\/wp\/v2\/comments?post=29"}],"version-history":[{"count":1,"href":"https:\/\/sisu.ut.ee\/water\/wp-json\/wp\/v2\/pages\/29\/revisions"}],"predecessor-version":[{"id":172,"href":"https:\/\/sisu.ut.ee\/water\/wp-json\/wp\/v2\/pages\/29\/revisions\/172"}],"wp:attachment":[{"href":"https:\/\/sisu.ut.ee\/water\/wp-json\/wp\/v2\/media?parent=29"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}