BioRisk 8: 34] 3 (20 | 3) Apeer-reviewed open-access journal doi: 10,3897 /biorisk.8.4036 RESEARCH ARTICLE & B lO R IS k www.pensoftonline.net/biorisk Tools for a scientifically rigorous and efficient monitoring of genetically modified organisms (GMOs) -VDI Guidelines to ensure high quality of GMO-monitoring data Wiebke Ziighart', Heike Beismann’, Winfried Schréder? | Bundesamt fiir Naturschutz, Konstantinstr. 110, 53179 Bonn 2 Westfilische Hochschule, Minsterstr. 265, 46397 Bocholt 3 Lehrstuhl fiir Landschaftsokologie, Universitat Vechta, Driverstr. 23, 49377 Vechta Corresponding author: Wiebke Ziighart (wiebke.zueghart@bfn.de) Academic editor: /. Settele | Received 25 September 2012 | Accepted 11 January 2013 | Published 8 August 2013 Citation: Ziighart W, Beismann H, Schréder W (2013) Tools for a scientifically rigorous and efficient monitoring of genetically modified organisms (GMOs) — VDI Guidelines to ensure high quality of GMO-monitoring data. BioRisk 8: 3-13. doi: 10.3897/biorisk.8.4036 Abstract The deliberate release of genetically modified organisms (GMOs) implies the potential occurrence of environmental impacts which are either unexpected or only partially predictable and, thus, necessitates development of appropriate monitoring methodology. Therefore, new challenges have to be met when implementing the post market environmental monitoring (PMEM) of genetically modified organ- isms (GMOs), which is mandatory according to the European legal framework. According to Directive 2001/18/EC PMEM has to follow standard methodologies, wherever available and appropriate. To pro- vide all involved parties with appropriate standard monitoring methods, the so called VDI Guidelines are developed by working groups established by the Association of German Engineers (VDI). These working groups are composed by external experts participating on a voluntary basis. The VDI is an independent technical standardisation body. All Guidelines are published in German and English and can therefore be used throughout Europe. VDI Guidelines are available in the field of exposure of the environment to GM plants (e.g. standardised sampling of pollen, standardised observation of hybrids or ferals), bio- molecular analyses (e.g. standardised extraction and detection of transgenes or their products in different environmental compartments), and the standardised monitoring of effects on non-target organisms (e.g. butterflies, wild bees, amphibians or soil organisms). The aim beyond this work is to facilitate genera- tion of reliable and comparable monitoring data and enable an effective and efficient PMEM with high acceptability to the scientific community as well as the general public. Copyright Wiebke Ziighart et al. This is an open access article distributed under the terms of the Creative Commons Attribution License 3.0 (CC-BY), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. 4 Wiebke Zighart et al. / BioRisk 8: 3-13 (2013) Keywords Genetically modified organisms, post market environmental monitoring, VDI Guidelines, environmental effects, GMO monitoring, non-target organism Introduction According to the European legal framework it is mandatory to conduct a post market environmental monitoring (PMEM) when approval for the commercial release of ge- netically modified organisms (GMO) has been granted (EC 2001, EC 2003). The aim of PMEM is to identify potential adverse effects of the organism and its use to human health and the environment after placing on the market. It should serve as an early warn- ing system and indicate the need of risk management measures and / or a reassessment of the released GMO. The monitoring results are the basis for subsequent regulatory decisions like the adaptation of monitoring plans or withdrawal of GMO approvals. The Directive 2001/18/EC (EC 2001) distinguishes two parts of PMEM. Case specific monitoring (CSM) is closely linked to the outcome of the environmental risk assessment (ERA). The aim of CSM is to check the assumptions made during the ERA and to ensure that the ERA conclusions are valid as regards the authorised use of the genetically modified organisms (GMO) (EFSA 2011a). The focus of General surveil- lance (GS) is on impacts, which were not anticipated in the ERA as well as on long- term and cumulative effects (EC 2001). Guidance on the general principles for PMEM and the development of an ap- propriate post-market monitoring plan is given in the Council Decision 2002/81 1/ EC supplementing Annex VII to Directive 2001/18/EC (EC 2002). One focus of this guidance is laid on the monitoring methodology. ‘Thus, the relevant parameters to be monitored have to be identified on a case by case basis and the methodology to moni- tor these parameters should be clearly identified and outlined, including techniques for sampling and analysis. The sampling methodology must be scientifically and statisti- cally sound (EC 2002). A main requirement to monitoring methodology is to collect and analyse data in exact and unbiased manner. Besides comparability, further funda- mental quality criteria are necessary such as correctness and reproducibility (Schroder et al. 1991, 2009). Technical data should be sufficiently reliable and able to stand up in court to serve as a basis for regulatory decision making. Accordingly, use of stand- ardised methodology for PMEM is advisable wherever such methodology is available and appropriate (EC 2002, EFSA 201 1a, BEN et al. 2011). Standardised methodology effectively represents these required high quality criteria, they create transparency and thus also acceptance (Plachter et al. 2002). For pollution control, soil conservation or pest control standard monitoring me- thods are already available and widely applied. In contrast, the monitoring of adverse environmental effects of genetically modified organisms lacks such standardisation (Berhorn et al. 2005). To fill this gap, working groups composed of experts from relevant scientific disciplines and the administration started to develop technical stand- Tools for a scientifically rigorous and efficient monitoring of genetically modified organisms... 5 ards (VDI Guidelines) for PMEM within the framework of the Association of German Engineers (VDI). The VDI is an independent, politically unaffiliated and non-profit technical stand- ardization body. The VDI covers a wide range of technical topics and communicates this knowledge through studies, technical discussions and congresses or the VDI Guidelines. The preparation of standards for environmental protection and environ- mental management has made a considerable contribution to today’s high level of environmental protection, e.g. in the field of air pollution protection. In the field of PMEM, external experts in cooperation with the VDI work on a body of regulations of specific methods for the monitoring of genetically modified plants (GMO Monitoring, VDI 4330 - VDI 4333, Table 2 and Table 3). This stand- ardisation project was initiated by the German Federal Ministry for the Environment, Nature Conservation and Nuclear Safety (BMU) and the Federal Agency for Nature Conservation (BfN). The aim of this guideline work is to provide relevant standard methodology in order to enable and support a scientifically rigorous, harmonised and thus efficient PMEM. Rules of guideline development The development of VDI Guidelines is an open and transparent process according to defined rules. Important criteria for the development process are the participation of the public and an obligatory review after publication. Due to this open process VDI Guidelines are accepted as important for the German technical progress. VDI Guide- lines also have a particular legal importance, especially when cited in legal acts, ordi- nances, decrees or regulations. ‘This is comparable to the influence of ISO standards on an international level. A project proposal can be made by any stakeholder to the VDI. Before starting a new project in the VDI, an evaluation is carried out by the responsible Advisory Board, in which the current need, the compliance with general criteria and the interest of the parties involved is inquired (Fig. 1). Furthermore, parallel work of other standardizing bodies (CEN, ISO, other national regulators) must be excluded. The involved external experts participate on a voluntary basis in their own capacity and not as representa- tives of their organizations. They are appointed personally to a corresponding working group after the project proposal has been checked and agreed by the responsible Advi- sory Board. The work of these working groups is organized and supported by the VDI. The constituted working group for a new standardization project develops an in- ternal preliminary working draft (Fig. 1). The draft is the result of broad discussions between the experts, based on their expert knowledge. After a detailed review within the responsible Advisory Board, the draft can be published as so called “green print”. This draft is printed and available internationally at the Beuth publishing house (www. beuth.de) and its distribution network. The draft will be subjected to an approval procedure which is open to the general public. The time span to make objections 6 Wiebke Zighart et al. / BioRisk 8: 3-13 (2013) Internal approval procedure Publication e Project e VDI Proposal Guideline ¢ Working Draft e VDI Constitution of a working group involving all interested parties Guideline Draft as f Public scrutiny with subsequent consensus- based approval Figure |. Simplified flowchart of the approval process of a technical standard. is typically 3-4 months, and all received objections must be discussed and handled within the corresponding working group. After all objections have been dealt with and the draft is revised by the issuing working group and after report in the responsible Advisory Board, the final VDI Guideline can be passed and will be published as so called “white print”. The aim of this procedure is to incorporate the publicity in a very transparent way and to reach a consensus as extensive as possible. At the latest five years after its publication, a VDI Guideline must be checked for its validity and, if necessary, revised or withdrawn. The process of determining a technical standard — especially the direct participa- tion of the public during the consultation phase — guarantees a high level of trans- parence and acceptance. The results of the standardization are generally accepted as state-of-the-art and may be consulted for guidance during implementation of legal regulations. Thus, it is made possible to assess and thus increase the quality of tenders for measuring and monitoring programs and expert’s reports considerably, to provide legal certainty for the user and to ensure comparability of the data. PMEM strategy and determination of monitoring objectives Appropriately addressing identified as well as unanticipated effects of GMOs to the environment during PMEM is highly challenging. Effects may occur on different eco- logical levels like organisms, biocoenosis, ecosystems or landscapes, and may appear in the different environmental compartments air, soil and water (Ziighart and Breck- ling 2003). Furthermore, impacts may not be temporally and spatially limited. They may be direct or indirect and may happen immediately or after a long time of the onset of GMO release. When different GMOs are released concurrently in the same area, combined effects may occur. ‘This indicates the need of a monitoring strategy that meets both, a targeted monitoring approach that takes into account specific causal interrelationships as well as a more general observation of the environment (Ziighart et al. 2008). For GM plants (GMP) the monitoring approach will comprise a set of Tools for a scientifically rigorous and efficient monitoring of genetically modified organisms... 7 mainly sectoral monitoring objectives and methodologies to complement one another accordingly, depending on plant species, inserted traits, intended use and the receiving environment. The formulation of cause-effect hypotheses derived from the ERA, biosafety re- search results as well as from existing knowledge of ecology and ecosystem theory will be the main tool for the identification of potential adverse effects of a certain GMP and the determination of relevant monitoring objectives (BfN et al. 2011). Furthermore, the selection of indicators representing safeguard objects and protectin goals in the relevant environment could complement the PMEM approach. Table 1 gives an over- view about a broad spectrum of possible effects of GM crops on items to be protected Table |. Protection goals, checkpoints and background data relevant for PMEM (source: VDI 4330 Part 1). Items to be protected and protection targets Terrestrial ecosystems Flora and fauna Conservation of the biological diversity ¢ Genetic variability ¢ Diversity of species and their functions ¢ Diversity of habitats/ ecosystems Conservation of especially endangered or protected species, habitats and ecosystems Checkpoints / Assessment endpoints Dispersal and fate of the transgenes (e.g. pollen, dusts, plants, compost, sewage, sludge, stomach and intestinal contents or excretions from wild animals) Flora and fauna of farmland Flora and fauna of field margins Feralisation and dispersal behaviour of GMPs Occurrence of natural cross-breed partners Cross breeding with wild flora, establishment and ecological behaviour of hybrids and transgenic wild plants Toxic effects of specific GMP constituents (direct and indirect) on non-target organisms Herbicide/metabolite residues Changes in population density and behaviour of endangered and protected species and ecological key species of different stages of the trophic web Diversity, dominance structures and functions of ecosystems, in particular in protected habitats Alterations of landscape structures and properties Soil Conservation of soil functions (soil fertility, biochemical and geochemical material and energy fluxes as well as filtering, buffering and cultivation properties, ecosystem function) Conservation of the soil biocoenosis Avoidance of erosion/compaction Dispersal and fate of the transgenes (e.g. soil, compost, sewage sludge, silage) Feralisation and dispersal behaviour of GMPs Changes in chemical and physical parameters of the soil Horizontal gene transfer to microorganisms Detection of recombinant DNA Toxic effects of specific GMP constituents (direct and indirect) on non-target organisms Herbicide/metabolite residues Changes in population density and behaviour of endangered and protected species and ecological key species of different stages of the trophic web Soil microbiological parameters Diversity, dominance structures and function of soil organisms Degradation processes Soil erosion/compaction 8 Wiebke Ziighart et al. / BioRisk 8: 3-13 (2013) Items to be protected and rotection targets Checkpoints / Assessment endpoints Aquatic ecosystems Dispersal and fate of the transgenes (e.g. water body, sediments) Conservation of the biological Feralisation and dispersal behaviour of GMPs diversity Occurrence of natural cross-breed partners Cross breeding with wild flora, establishment and ecological behaviour of hybrids and transgenic wild plants Changes in chemical and physical parameters of the water Toxic effects of specific GMP constituents (direct and indirect) on non-target organisms Herbicide/metabolite residues Changes in population density and behaviour of endangered and ¢ Genetic variability ¢ Diversity of species and their functions ¢ Diversity of habitats/ ecosystems Conservation of especially endangered or protected species, habitats and ecosystems protected species and ecological key species of different stages of Avoidance of adverse effects the trophic web to bodies of water (ecosystem Diversity, dominance structures and function of water biocoenosis function, water quality) especially in protected habitats Air Protection of the atmosphere Air pollution prevention Chemical composition (greenhouse gases, VOCs (volatile organic hydrocarbons)) Dispersal of transgenes (in particular pollen and aerosols) Non-specific background data of the items to be protected Spatial and temporal dispersal of the GMP cultivation Climate and weather Data on the monitoring area (e.g. topographical data, soil class, characteristics of the cultivation area and the field margins, cultivation and landscape-care measures) and relevant checkpoints related to them. The checkpoints have been derived from the case studies herbicide-resistant rape, insect-resistant maize, virus-resistant sugar-beet and potato with modified starch content. The table can be used as a source for the con- ception of PMEM. Ifa checkpoint is rated as relevant, the next step would be to derive monitoring parameters and/or indicators (VDI 4330 Part 1, Table 2). Availability of methodologies for PMEM The methods applied in a monitoring program should be chosen according to their abil- ity to generate appropriate data to address the selected monitoring objectives (McComb et al. 2010; Legg and Nagy 2006). In the case of PMEM of GM crops, for some key features already approved monitoring methods may be available, but for most parts of PMEM rather new developments or modifications are necessary (Berhorn et al. 2005). In the last decade, increased efforts were made to develop or optimise methods for the detection of dispersal of GM crops, inserted transgenes and transgene products as well as for the detection of environmental impacts caused by GM plants or their use. This includes methods for the detection of GM pollen dispersal and deposition (Hofmann et al. 2005, 2011), the quantification of Bt protein contents in plants (Nguyen and Jehle 2009), or the detection of adverse impacts on non-target organisms (Prasifka et al. 2005, Rauschen et al. 2008, Lang and Bihler 2012). At present, these novel methodologies are Tools for a scientifically rigorous and efficient monitoring of genetically modified organisms... 9 mainly applied in research projects and experimental field studies, and their applicability for PMEM purposes often needs to be verified. Basically, the implementation of relevant and appropriate methods for PMEM into referenced standards like VDI Guidelines proved to be a suitable approach for promoting the use of harmonised and state-of-the- art methodologies, eventually enabling and facilitating an effective monitoring. VDI Guidelines for PMEM The VDI working groups discussed and decided on needs and priorities for standard- ised methods for PMEM. Table 2 gives an overview on the VDI Guidelines already published and Table 3 on guidelines still in progress. All described methods focus on the detection of ecological effects of GM crops on the environment and do not address effects on human health. As a first step a general guideline on basic principles and strategies of PMEM was provided (Table 2, VDI 4330 Part 1). This framework guideline sets the context and supports the other guide- lines which mainly describe detailed methods. A major topic of VDI 4330 Part 1 is the description of scientific requirements for a monitoring concept, that include planning and implementation criteria, protection goals and checkpoints that have to be taken into account (Table 1), criteria for the selection of methods and monitoring areas as well as requirements regarding quality assurance and data management (Schréder and Schmidt 2012, Schroder and Schmidt (2013), this issue). The priorities for standardisations of detailed methods were set initially in the field of exposure of the environment to GM crops and bio-molecular analyses. The Table 2. Standard methods for the environmental monitoring of genetically modified organisms (final- ised). Guideline He se : : ; ans Monitoring the effects of genetically modified organisms VDI 4330 Monitoring the ecological effects of genetically modified organisms; aes Genetically modified plants; Basic principles and strategies Dorks Pollen monitoring; Technical pollen sampling using pollen mass filter (PMF) and Sig- ma-2 sampler Part 4 Biological sampling of pollen; Bee hives as biological pollen samplers Part 5 Guidelines for the collection and preparation of plant samples for molecular biological analysis Panky, PCR-methods for the detection of genetically engineered nucleic acids in the environment Part 9 Assessment of the diversity of ferns and flowering plants; Vegetation survey Part 10 Floristic mapping of genetically modified plants, their crossing partners and their hybrid offspring Part 11 Immunochemical detection of insecticidal Bt proteins from genetically modified crops in soil samples and plant residues pas Standardised monitoring of butterflies and moths (Lepidoptera); Transect method, light trap, and larval survey 10 Wiebke Ziighart et al. / BioRisk 8: 3-13 (2013) Table 3. Standard methods for the environmental monitoring of genetically modified organisms (in progress). Guideline series Monitoring the effects of genetically modified organisms VDI 4330 Patt? Sampling for pollen monitoring VDI 4331 Part 1 Effects of GMO on soil organisms Part 2 Macroarthropods Part 3 Microarthropods Part 4 Lumbricina Part 5 Enchytraeus Part 6 Nematodes Part 7 Microbial communities VDI 4332 Standardised detection of Wild bees VDI 4333 Standardised detection of Amphibians focus was on standardised sampling of pollen, standardised extraction and detection of transgenes and their products, and on standardised observation of plant hybrids and ferals (Sukopp and Schmitz (2013), this issue). With the increasing cultivation of Bt-maize in Europe, standard methodologies to monitor effects on non-target organisms like butterflies and moths (Lang et al. 2013, this issue) or soil organisms (Ruf et al. 2013, this issue) become more important. Further- more, wild bees (Schindler et al. 2013, this issue) and amphibians (Boll et al. 2013, this issue) were identified as sensitive species and thus important indicators in agricultural landscapes (Lang 2007). The experts identified particularly with regard to the availability and appropriateness of PMEM methodologies for non-target organisms substantial gaps. Though monitoring methods may exist for those groups, approaches specifically adapted to PMEM monitoring of GMOs are missing and / or are not harmonised and standard- ised. This applies to species already covered by VDI Guidelines (Table 2, Table 3) as well as to further species groups with relevance for PMEM (Lang 2007). The VDI Guidelines include detailed instructions on sampling methods, sampling strategies, sampling designs, detection methods, statistical evaluation, data manage- ment and quality control. For non target organisms like butterflies or amphibians, relevant species and developmental stages (e.g. adults, larvae) are determined to be monitored. In the case of soil organisms, a selection matrix that supports the choice of appropriate animal groups to be sampled is provided. The VDI Guidelines do not dif- ferentiate between Case specific monitoring and General surveillance, because the meth- odologies itself basically are applicable for both. Conclusions With the current set of VDI Guidelines for PMEM a first step was taken to address es- sential requirements to facilitate an effective PMEM. Initial PMEM reports of the cul- Tools for a scientifically rigorous and efficient monitoring of genetically modified organisms... 11 tivation of MON810 maize (MON810 2010) and Amflora potatoes (Amflora 2011) in Europe have indicated the relevance of high quality scientific monitoring method- ology for obtaining valid and reliable monitoring results (EFSA 2011b, EFSA 2012). Appropriate and standardized methodology is a key element to enable an effective and efficient PMEM. Preferably such methods should be available prior to the implemen- tation of monitoring plans (EC 2002). VDI Guidelines are published in German and English, and therefore accessible to all European stakeholders. Consideration of these standards by e.g. applicants, regula- tors, European Food Safety Authority (EFSA) and the European Commission would be a step forward in achieving a harmonised and reliable PMEM. VDI Guidelines can thereby serve as basic documents in the European stand- ardization process (Beismann et al. 2007). The technical standards on pollen moni- toring (VDI 4330 Part 3 and Part 4) are the first VDI Guidelines for PMEM, which are transferred to the European Standardization Body (CEN) and are developed as European Technical Specifications for PMEM, to facilitate comparability of PMEM surveys at the European level (Peichl and Finck 2003). Acknowledgement The project was funded by the Federal Ministry for the Environment, Nature Conser- vation and Nuclear Safety (BMU) and the Federal Agency for Nature Conservation (BEN). We thank the VDI for the excellent cooperation and in particular all voluntary experts who contributed to this work. References Amflora (2011) Post-Market Monitoring Report for the cultivation of Amylopectin Potato H92-527-1 Variety Amflora in 2010 submitted by BASF Plant Science Company GmbH. March 2011. Beismann H, Finck M, Seitz H (2007) Standardisation of methods for GMO Monitoring on a European level. Journal ftir Verbraucherschutz und Lebensmittelsicherheit. J. Verbr. Lebensm. 2 Supplement 1: 76-78. doi: 10.1007/s00003-007-024 1-4 Berhorn F, Seitz H, Finck M (2005) Methodenstandards fiir ein Monitoring gentechnisch veranderter Organismen. Natur und Landschaft 7 (80), 324-327. BfN, FOEN, EEA (2011) Monitoring of genetically modified organisms. A policy paper repre- senting the view of the National Environment Agencies in Austria and Switzerland and the Federal Agency for Nature Conservation in Germany. Report 0305, Vienna. Boll S, Schmidt BR, Veith M, Wagner N, Rédder D, Weimann C, Kirschey T, Lotters S (2013) Anuran amphibians as indicators of changes in aquatic and terrestrial ecosystems follow- ing GM crop cultivation: a monitoring guideline. BioRisk 8: 39-51. doi: 10.3897/bior- isk.8.3251 12 Wiebke Zighart et al. / BioRisk 8: 3-13 (2013) EC — European Commission (2001) Directive 2001/18/EC of the European Parliament and of the Council of 12 March 2001 on the deliberate release into the environment of genetically modified organisms and repealing Council Directive 90/220/EEC. Official Journal of the European Communities, L 106/1. EC — European Commission (2002) Council Decision of 3 October 2002 establishing guid- ance notes supplementing Annex VII to Directive 2001/18/EC or the European Parlia- ment and of the Council on the deliberate release into the environment of genetically modified organisms and repealing Council Directive 90/220/EEC. Official Journal of the European Communities, L 280/27. EC — European Commission (2003) Regulation No 1829/2003 of the European Parliament and of the Council of 22 September 2003 on genetically modified food and feed. Official Journal of the European Union, L 268/1. EFSA — European Food Safety Authority (201 1a) Scientific opinion on guidance on the Post-Market Environmental Monitoring (PMEM) of genetically modified plants. EFSA Journal 9 (8): 2316. EFSA — European Food Safety Authority (2011b) Scientific Opinion on the annual Post- Market Environmental Monitoring (PMEM) report from Monsanto Europe S.A. on the cultivation of genetically modified maize MON810 in 2009. EFSA Journal 2011; 9 GL0)12376. EFSA — European Food Safety Authority (2012) Scientific Opinion on the annual Post-Market Environmental Monitoring (PMEM) report from Monsanto Europe S.A. on the cultiva- tion of genetically modified maize MON 810 in 2010. EFSA Journal 2012, 10(4): 2610. Hofmann F, Otto M, Kuhn U, Ober S, Schlechtriemen U, Vogel R (2011) A new method for in Situ measurement of Bt-maize pollen deposition on host-plant leaves. Insects (2), 12-21. Hofmann F, Schlechtriemen U, Wosniok W, Foth M (2005) GVO-Pollenmonitoring. Tech- nische und biologische Pollenakkumulatoren und PCR-Screening ftir ein Monitoring von gentechnisch veranderten Organismen. BfN-Skripten 139. www.bfn.de Lang A (2007) Bedarf an standardisierten Erhebungsmethoden fiir ein GVO-Monitoring. Gu- tachten. www.bfn.de Lang A, Bithler C (2012) Estimation or required sampling effort for monitoring the possible effects of transgenic crops on butterflies: Lessons from long-term monitoring schemes in Switzerland. Ecological Indicators 13, 29-36. doi: 10.1016/j.ecolind.2011.05.004 Lang A, TheifSen B, Dolek M (2013) Standardised methods for the GMO monitoring of but- terflies and moths: the whys and hows. BioRisk 8: 15-38. doi: 10.3897/biorisk.8.3244 Lege C, Nagy L (2006) Why most conservation monitoring is, but need not be, a waste of time. Journal of Environmental Management 78, 194-199. doi: 10.1016/j.jenv- man.2005.04.016 McComb B, Zuckerberg B, Vesely D, Jordan C (2010) Monitoring animal populations and their habitats. A practioner’s guide. CRC Press, Taylor and Francis Group. MON810 (2010) Annual monitoring report on the cultivation of MON 810 in 2010 Czech Republic, Poland, Portugal, Romania, Slovakia, and Spain submitted by MONSANTO EUROPE S.A. Nguyen HT, Jehle J A (2009) Expression of CRY3Bb1 in transgenic corn MON88017. Jour- nal for Agriculture and Food Chemistry 57 (21), 9990-9996. doi: 10.1021/jf901115m Tools for a scientifically rigorous and efficient monitoring of genetically modified organisms... 13 Peichl L, Finck M (2003) Monitoring ékologischer Auswirkungen gentechnisch veranderter Pflanzen: Harmonisierungs- und Standardisierungsbedarf. Gefahrstofte Reinhaltung der Luft 63, 223-224. Plachter H, Bernotat D, Miissner R, Rieken U (2002) Entwicklung und Festlegung von Metho- denstandards im Naturschutz. Schriftenreihe fiir Landschaftspflege und Naturschutz, Heft 70. Prasifka JR, Hellmich RL, Dively GP, Lewis LC (2005) Assessing the effects of pest management in non-target Arthropods: The influence of plot size and isolation. Environmental Entomol- ogy 34 (5), 1181-1192. doi: 10.1603/0046-225X(2005)034[1181:ATEOPM]2.0.CO;2 Rauschen S, Eckert J, Schaarschmidt F, Schuphan I, Gathmann A (2008) An evaluation of methods for assessing the impacts of Bt-maize MON810 cultivation and pyrethroid insec- ticide use on Auchenorrhyncha (planthoppers and leafhoppers). Agricultural and Forest Entomology 10 (4), 331-339. doi: 10.1111/j.1461-9563.2008.00394.x Ruf A, Beylich A, Blick T, Biichs W, Glante F, Héss S, Rof’-Nickoll M, Ruef$ L, Russell DJ, Rombke J, Seitz H, TheifSen B, Toschki A, Weimann C, Ziighart W (2013) Soil organis- ms as an essential element of a monitoring plan to identify the effects of GMO cultiva- tion. Requirements — Methodology — Standardisation. BioRisk 8: 73-87. doi: 10.3897/ biorisk.8.3255 Schindler M, Diestelhorst O, Hartel S, Saure C, Schanowski A, Schwenninger HR (2013) Mo- nitoring agricultural ecosystems by using wild bees as environmental indicators. BioRisk 8: 53-71. doi: 10.3897/biorisk.8.3600 Schroder W, Garbe-Schénberg CD, Franzle O (1991) Die Validitat von Umweltdaten - Kri- terien fiir ihre Zuverlassigkeit: Reprasentativitat, Qualitatssicherung und -kontrolle. Um- weltwissenschaften und Schadstoff-Forschung. Zeitschrift fiir Umweltchemie und Okoto- xikologie 3 (7): 237-241. doi: 10.1007/BF02936814 Schréder W, Pesch R, Matter Y, Goritz A, Genssler L, Dieffenbach-Fries H (2009) Trend der Schwermetall-Bioakkumulation 1990 bis 2005: Qualitatssicherung bei Probenahme, Analy- tik, geostatistischer Auswertung. Umweltwissenschaften und Schadstoff-Forschung-Zeitschrift fur Umweltchemie und Okotoxikologie 21 (6), 549-574. doi: 10.1007/s12302-009-0087-8 Schréder W, Schmidt G (2012) Overview of principles and implementations to deal with spatial issues in monitoring environmental effects of genetically modified organisms. Envi- ronmental Sciences Europe, 24-6. Schroder W, Schmidt G (2013) Supporting monitoring effects of genetically modified organisms by GIS-technologies and geodata — an overview. BioRisk 8: 111—120. doi: 10.3897/biorisk.8.4038 Sukopp U, Schmitz U (2013) How to track genetically modified (GM) plants in the field? The VDI standard method of floristic mapping of GM plants as an efficient tool. BioRisk 8: 89-110. doi: 10.3897/biorisk.8.4035 Ziighart W, Benzler A, Berhorn F, Sukopp U, Graef F (2008) Determining indicators, meth- ods and sites for monitoring potential adverse effects of genetically modified plants to the environment: the legal and conceptional framework for implementation. Euphytica 164, 845-852. doi: 10.1007/s10681-007-9475-6 Ziighart W, Breckling B (2003) Konzeptionelle Entwicklung eines Monitoring von Umweltwirkun- gen transgener Kulturpflanzen. Teil 1 und 2. UBA-Texte 50/03, Umweltbundesamt, Berlin.