Book a Demo!
CoCalc Logo Icon
StoreFeaturesDocsShareSupportNewsAboutPoliciesSign UpSign In
Download
29548 views
1
2
3
4
5
7.1 TYPES OF DILUTION WATER
6
7
7.1.1 The type of dilution water used in effluent toxicity
8
tests will depend largely on the objectives of the study.
9
10
11
7.1.1.1
12
If the objective of the test is to estimate the absolute
13
chronic toxicity of the effluent, a synthetic (standard) dilution
14
water is used. If the test organisms have been cultured in water
15
which is different from the test dilution water, a second set of
16
controls, using culture water, should be included in the
17
test.
18
19
20
7.1.1.2
21
If the objective of the test is to estimate the chronic
22
toxicity of the effluent in uncontaminated receiving water, the
23
test may be conducted using dilution water consisting of a single
24
grab sample of receiving water (if non-toxic), collected either
25
upstream and outside the influence of the outfall, or with other
26
uncontaminated natural water (ground or surface water) or standard
27
dilution water having approximately the same characteristics
28
(hardness, alkalinity, and conductivity) as the receiving water.
29
Seasonal variations in the quality of receiving waters may affect
30
effluent toxicity. Therefore, the pH, alkalinity, hardness, and
31
conductivity of receiving water samples should be determined before
32
each use. If the test organisms have been cultured in water which
33
is different from the test dilution water, a second set of
34
controls, using culture water, should be included in the
35
test.
36
37
38
7.1.1.3
39
If the objective of the test is to determine the additive
40
or mitigating effects of the discharge on already contaminated
41
receiving water, the test is performed using dilution water
42
consisting of receiving water collected immediately upstream or
43
outside the influence of the outfall. A second set of controls,
44
using culture water, should be included in the test.
45
46
47
7.1.2
48
An acceptable dilution water is one which is appropriate
49
for the objectives of the test; supports adequate performance of
50
the test organisms with respect to survival, growth, reproduction,
51
or other responses that may be measured in the test (i.e.,
52
consistently meets test acceptability criteria for control
53
responses); is consistent in quality; and does not contain
54
contaminants that could produce toxicity. Receiving waters,
55
synthetic waters, or synthetic waters adjusted to approximate
56
receiving water characteristics may be used for dilution provided
57
that the water meets the above listed qualifications for an
58
acceptable dilution water. USEPA (2000a) provides additional
59
guidance on selecting appropriate dilution waters.
60
61
62
7.1.3
63
When dual controls (one control using culture water and
64
one control using dilution water) are used (see Subsections 7.1.1.1
65
- 7.1.1.3 above), the dilution water control should be used to
66
determine test acceptability. It is also the dilution water control
67
that should be compared to effluent treatments in the calculation
68
and reporting of test results. The culture water control should be
69
used to evaluate the appropriateness of the dilution water source.
70
Significant differences between organism responses in culture water
71
and dilution water controls could indicate toxicity in the dilution
72
water and may suggest an alternative dilution water source. USEPA
73
(2000a) provides additional guidance on dual controls.
74
75
76
7.2
77
STANDARD, SYNTHETIC DILUTION WATER
78
79
80
81
82
7.2.1
83
Standard, synthetic dilution water is prepared with
84
deionized water and reagent grade chemicals or mineral water
85
(Tables 3 and 4). The source water for the deionizer can be ground
86
water or tap water.
87
88
89
7.2.2
90
DEIONIZED WATER USED TO PREPARE STANDARD, SYNTHETIC,
91
DILUTION WATER
92
93
94
7.2.2.1 Deionized water is obtained from a MILLIPORE® MILLI-Q®,
95
MILLIPORE® QPAK™2 or equivalent system. It is advisable to provide
96
a preconditioned (deionized) feed water by using a Culligan®,
97
Continental®, or equivalent system in front of the MILLIPORE®
98
System to extend the life of the MILLIPORE® cartridges (see Section
99
5, Facilities, Equipment, and Supplies).
100
101
102
7.2.2.2
103
The recommended order of the cartridges in a
104
four-cartridge deionizer (i.e., MILLI-Q® System or equivalent) is
105
(1) ion exchange, (2) ion exchange, (3) carbon, and (4) organic
106
cleanup (such as ORGANEX-Q®, or equivalent) followed by a final
107
bacteria filter. The QPAK™2 water system is a sealed system which
108
does not allow for the rearranging of the cartridges. However, the
109
final cartridge is an ORGANEX-Q® filter, followed by a final
110
bacteria filter. Commercial laboratories using this system have not
111
experienced any difficulty in using the water for culturing or
112
testing. Reference to the MILLI-Q® systems throughout the remainder
113
of the manual includes all MILLIPORE® or equivalent
114
systems.
115
116
117
7.2.3
118
STANDARD, SYNTHETIC FRESHWATER
119
120
121
7.2.3.1 To prepare 20 L of synthetic, moderately hard,
122
reconstituted water, use the reagent grade chemicals in Table 3 as
123
follows:
124
125
126
1.
127
Place 19 L of MILLI-Q®, or equivalent, water in a
128
properly cleaned plastic carboy.
129
130
131
2.
132
Add 1.20 g of MgSO4, 1.92 g NaHCO3, and 0.080g KCl to the
133
carboy.
134
135
136
3.
137
Aerate overnight.
138
139
140
4.
141
Add 1.20 g of CaSO4•2H20 to 1 L of MILLI-Q® or equivalent
142
deionized water in a separate flask. Stir on magnetic stirrer until
143
calcium sulfate is dissolved, add to the 19 L above, and mix
144
well.
145
146
147
5.
148
For Ceriodaphnia dubia culturing and testing, add
149
sufficient sodium selenate (Na2SeO4) to provide 2 mg selenium per
150
liter of final dilution water.
151
152
153
6.
154
Aerate the combined solution vigorously for an additional
155
24 h to dissolve the added chemicals and stabilize the
156
medium.
157
158
159
7.
160
The measured pH, hardness, etc., should be as listed in
161
Table 3.
162
163
164
TABLE 3. PREPARATION OF SYNTHETIC FRESHWATER USING REAGENT GRADE
165
CHEMICALS1
166
167
1
168
Taken in part from Marking and Dawson (1973).
169
2
170
Add reagent grade chemicals to deionized water.
171
3
172
Approximate equilibrium pH after 24 h of aeration.
173
4
174
Expressed as mg CaCO3/L.
175
176
177
7.2.3.2
178
If large volumes of synthetic reconstituted water will be
179
needed, it may be advisable to mix 1 L portions of concentrated
180
stock solutions of NaHCO3, MgSO4, and KCl for use in preparation of
181
the reconstituted waters.
182
183
184
7.2.3.3
185
To prepare 20 L of standard, synthetic, moderately hard,
186
reconstituted water, using mineral water such as PERRIER® Water, or
187
equivalent (Table 4), follow the instructions below.
188
189
190
191
192
1.
193
Place 16 L of MILLI-Q® or equivalent water in a properly
194
cleaned plastic carboy.
195
196
197
2.
198
Add 4 L of PERRIER® Water, or equivalent.
199
200
201
3.
202
Aerate vigorously for 24 h to stabilize the
203
medium.
204
205
206
4.
207
The measured pH, hardness and alkalinity of the aerated
208
water will be as indicated in Table 4.
209
210
211
5.
212
This synthetic water is referred to as diluted mineral
213
water (DMW) in the toxicity test methods.
214
215
216
TABLE 4. PREPARATION OF SYNTHETIC FRESHWATER USING MINERAL
217
WATER1
218
Approximate Final Water Quality
219
220
1
221
From Mount et al. (1987), and data provided by Philip Lewis,
222
EMSL-Cincinnati, OH.
223
2
224
Add mineral water to Milli-Q® water, or equivalent, to prepare
225
Diluted Mineral Water (DMW).
226
3
227
Approximate equilibrium pH after 24 h of aeration.
228
4
229
Expressed as mg CaCO3/L.
230
5
231
Dilutions of PERRIER® Water form a
232
precipitate when concentrations equivalent to "very hard water" are
233
aerated.
234
7.3 USE OF RECEIVING WATER AS DILUTION WATER
235
236
237
7.3.1
238
If the objectives of the test require the use of
239
uncontaminated receiving water as dilution water, and the receiving
240
water is uncontaminated, it may be possible to collect a sample of
241
the receiving water upstream of, or close to, but outside of the
242
zone influenced by the effluent. However, if the receiving water is
243
contaminated, it may be necessary to collect the sample in an area
244
"remote" from the discharge site, matching as closely as possible
245
the physical and chemical characteristics of the receiving water
246
near the outfall.
247
248
249
7.3.2
250
The sample should be collected immediately prior to the
251
test, but never more than 96 h before the test begins. Except where
252
it is used within 24 h, or in the case where large volumes are
253
required for flow through tests, the sample should be chilled to
254
0-6°C during or immediately following collection, and maintained at
255
that temperature prior to use in the test.
256
257
258
7.3.3
259
Receiving water containing debris or indigenous organisms
260
that may be confused with or attack the test organisms should be
261
filtered through a sieve having 60 mm mesh openings prior to
262
use.
263
264
265
7.3.4
266
Where toxicity-free dilution water is required in a test,
267
the water is considered acceptable if test organisms show the
268
required survival, growth, and reproduction in the controls during
269
the test.
270
271
272
7.3.5
273
The regulatory authority may require that the hardness of
274
the dilution water be comparable to the receiving water at the
275
discharge site. This requirement can be satisfied by collecting an
276
uncontaminated receiving water with a suitable hardness, or
277
adjusting the hardness of an otherwise suitable receiving water by
278
addition of reagents as indicated in Table 3.
279
280
281
7.4
282
USE OF TAP WATER AS DILUTION WATER
283
284
285
286
287
7.4.1
288
The use of tap water as dilution water is discouraged
289
unless it is dechlorinated and passed through a deionizer and
290
carbon filter. Tap water can be dechlorinated by deionization,
291
carbon filtration, or the use of sodium thiosulfate. Use of 3.6
292
mg/L (anhydrous) sodium thiosulfate will reduce 1.0 mg chlorine/L
293
(APHA, 1992). Following dechlorination, total residual chlorine
294
should not exceed 0.01 mg/L. Because of the possible toxicity of
295
thiosulfate to test organisms, a control lacking thiosulfate should
296
be included in toxicity tests utilizing thiosulfatedechlorinated
297
water.
298
299
300
7.4.2
301
To be adequate for general
302
laboratory use following dechlorination, the tap water is passed
303
through a deionizer and carbon filter to remove toxic metals and
304
organics, and to control hardness and alkalinity.
305
306
307
7.5
308
DILUTION WATER HOLDING
309
310
311
7.5.1 A given batch of dilution water should not be used for
312
more than 14 days following preparation because of the possible
313
build-up of bacterial, fungal, or algal slime growth and the
314
problems associated with it. The container should be kept covered
315
and the contents should be protected from light.
316
SECTION 8
317
EFFLUENT AND RECEIVING WATER SAMPLING, SAMPLE HANDLING, AND
318
SAMPLE PREPARATION FOR TOXICITY TESTS
319
8.1 EFFLUENT SAMPLING
320
321
322
8.1.1
323
The effluent sampling point should be the same as that
324
specified in the NPDES discharge permit (USEPA, 1988a). Conditions
325
for exception would be: (l) better access to a sampling point
326
between the final treatment and the discharge outfall; (2) if the
327
processed waste is chlorinated prior to discharge, it may also be
328
desirable to take samples prior to contact with the chlorine to
329
determine toxicity of the unchlorinated effluent; or (3) in the
330
event there is a desire to evaluate the toxicity of the influent to
331
municipal waste treatment plants or separate wastewater streams in
332
industrial facilities prior to their being combined with other
333
wastewater streams or non-contact cooling water, additional
334
sampling points may be chosen.
335
336
337
8.1.2
338
The decision on whether to collect grab or composite
339
samples is based on the objectives of the test and an understanding
340
of the short and long-term operations and schedules of the
341
discharger. If the effluent quality varies considerably with time,
342
which can occur where holding times are short, grab samples may
343
seem preferable because of the ease of collection and the potential
344
of observing peaks (spikes) in toxicity. However, the sampling
345
duration of a grab sample is so short that full characterization of
346
an effluent over a 24-h period would require a prohibitively large
347
number of separate samples and tests. Collection of a 24-h
348
composite sample, however, may dilute toxicity spikes, and average
349
the quality of the effluent over the sampling period. Sampling
350
recommendations are provided below (also see USEPA,
351
2002a).
352
353
354
8.1.3
355
Aeration during collection and transfer of effluents
356
should be minimized to reduce the loss of volatile
357
chemicals.
358
359
360
8.1.4
361
Details of date, time, location, duration, and procedures
362
used for effluent sample and dilution water collection should be
363
recorded.
364
365
366
8.2
367
EFFLUENT SAMPLE TYPES
368
369
370
8.2.1 The advantages and disadvantages of effluent grab and
371
composite samples are listed below:
372
8.2.1.1 GRAB SAMPLES Advantages:
373
374
375
1.
376
Easy to collect; require a minimum of equipment and
377
on-site time.
378
379
380
2.
381
Provide a measure of instantaneous toxicity. Toxicity
382
spikes are not masked by dilution. Disadvantages:
383
384
385
1. Samples are collected over a very short period of time and on
386
a relatively infrequent basis. The chances of detecting a spike in
387
toxicity would depend on the frequency of sampling and the
388
probability of missing a spike is high.
389
8.2.1.2 COMPOSITE SAMPLES Advantages:
390
391
392
1.
393
A single effluent sample is collected over a 24-h
394
period.
395
396
397
2.
398
The sample is collected over a much longer period of time
399
than a single grab sample and contains all toxicity
400
spikes.
401
402
403
Disadvantages:
404
405
406
1.
407
Sampling equipment is more sophisticated and expensive,
408
and must be placed on-site for at least 24 h.
409
410
411
2.
412
Toxicity spikes may not be detected because they are
413
masked by dilution with less toxic wastes.
414
415
416
8.3 EFFLUENT SAMPLING RECOMMENDATIONS
417
418
419
8.3.1
420
When tests are conducted on-site, test solutions can be
421
renewed daily with freshly collected samples, except for the green
422
alga, Selenastrum capricornutum, test which is not
423
renewed.
424
425
426
8.3.2
427
When tests are conducted off-site, a minimum of three
428
samples are collected. If these samples are collected on Test Days
429
1, 3, and 5, the first sample would be used for test initiation,
430
and for test solution renewal on Day 2. The second sample would be
431
used for test solution renewal on Days 3 and 4. The third sample
432
would be used for test solution renewal on Days 5, 6, and
433
7.
434
435
436
8.3.3
437
Sufficient sample volume must be collected to perform the
438
required toxicity and chemical tests. A 4-L (1gal) CUBITAINER® will
439
provide sufficient sample volume for most tests.
440
441
442
8.3.4
443
THE FOLLOWING EFFLUENT SAMPLING METHODS ARE
444
RECOMMENDED:
445
446
447
8.3.4.1 Continuous Discharges
448
449
450
8.3.4.1.1
451
If the facility discharge is continuous, a single 24-h
452
composite sample is to be taken.
453
454
455
8.3.4.2
456
Intermittent discharges
457
458
459
460
461
8.3.4.2.1
462
If the facility discharge is intermittent, a composite
463
sample is to be collected for the duration of the discharge but not
464
more than 24 hours.
465
466
467
8.4
468
RECEIVING WATER SAMPLING
469
470
471
472
473
8.4.1
474
Logistical problems and difficulty in securing sampling
475
equipment generally preclude the collection of composite receiving
476
water samples for toxicity tests. Therefore, based on the
477
requirements of the test, a single grab sample or daily grab sample
478
of receiving water is collected for use in the test.
479
480
481
8.4.2
482
The sampling point is determined by the objectives of the
483
test. In rivers, samples should be collected from mid-stream and at
484
mid-depth, if accessible. In lakes the samples are collected at
485
mid-depth.
486
487
488
8.4.3
489
To determine the extent of the zone of toxicity in the
490
receiving water downstream from the outfall, receiving water
491
samples are collected at several distances downstream from the
492
discharge. The time required for the effluent-receiving-water
493
mixture to travel to sampling points downstream from the outfall,
494
and the rate and degree of mixing, may be difficult to ascertain.
495
Therefore, it may not be possible to correlate downstream toxicity
496
with effluent toxicity at the discharge point unless a dye study is
497
performed. The toxicity of receiving water samples from five
498
stations downstream from the discharge point can be evaluated using
499
the same number of test vessels and test organisms as used in one
500
effluent toxicity test with five effluent dilutions.
501
502
503
8.5
504
EFFLUENT AND RECEIVING WATER SAMPLE HANDLING,
505
PRESERVATION, AND SHIPPING
506
507
508
509
510
8.5.1
511
Unless the samples are used in an on-site toxicity test
512
the day of collection (or hand delivered to the testing laboratory
513
for use on the day of collection), they should be chilled and
514
maintained at 0-6°C until used to inhibit microbial degradation,
515
chemical transformations, and loss of highly volatile toxic
516
substances.
517
518
519
8.5.2
520
Composite samples should be chilled as they are
521
collected. Grab samples should be chilled immediately following
522
collection.
523
524
525
8.5.3
526
If the effluent has been chlorinated, total residual
527
chlorine must be measured immediately following sample
528
collection.
529
530
531
8.5.4
532
Sample holding time begins when the last grab sample in a
533
series is taken (i.e., when a series of four grab samples are taken
534
over a 24-h period), or when a 24-h composite sampling period is
535
completed. If the data from the samples are to be acceptable for
536
use in the NPDES Program, the lapsed time (holding time) from
537
sample collection to first use of each grab or composite sample
538
must not exceed 36 h. EPA believes that 36 h is adequate time to
539
deliver the samples to the laboratories performing the test in most
540
cases. In the isolated cases, where the permittee can document that
541
this delivery time cannot be met, the permitting authority can
542
allow an option for onsite testing or a variance for an extension
543
of shipped sample holding time. The request for a variance in
544
sample holding time, directed to the USEPA Regional Administrator
545
under 40 CFR 136.3(e) should include supportive data which show
546
that the toxicity of the effluent sample is not reduced (e.g.,
547
because of volatilization and/or sorption of toxics on the sample
548
container surfaces) by extending the holding time beyond more than
549
36 h. However, in no case should more than 72 h elapse between
550
collection and first use of the sample. In static-renewal tests,
551
each grab or composite sample may also be used to prepare test
552
solutions for renewal at 24 h, 48 h, and/or 72 h after first use,
553
if stored at 0-6°C, with minimum head space, as described in
554
Subsection 8.5. If shipping problems (e.g., unsuccessful Saturday
555
delivery) are encountered with renewal samples after a test has
556
been initiated, the permitting authority may allow the continued
557
use of the most recently used sample for test renewal. Guidance for
558
determining the persistence of the sample is provided in Subsection
559
8.7.
560
561
562
8.5.5
563
To minimize the loss of toxicity due to volatilization of
564
toxic constituents, all sample containers should be "completely"
565
filled, leaving no air space between the contents and the
566
lid.
567
568
569
8.5.6
570
SAMPLES USED IN ON-SITE TESTS
571
572
573
574
575
8.5.6.1
576
Samples collected for on-site tests should be used within
577
24 h.
578
579
580
8.5.7
581
SAMPLES SHIPPED TO OFF-SITE FACILITIES
582
583
584
585
586
8.5.7.1
587
Samples collected for off-site toxicity testing are to be
588
chilled to 0-6°C during or immediately after collection, and
589
shipped iced to the performing laboratory. Sufficient ice should be
590
placed with the sample in the shipping container to ensure that ice
591
will still be present when the sample arrives at the laboratory and
592
is unpacked. Insulating material should not be placed between the
593
ice and the sample in the shipping container unless required to
594
prevent breakage of glass sample containers.
595
596
597
8.5.7.2
598
Samples may be shipped in one or more 4-L (l-gal)
599
CUBITAINERS® or new plastic "milk" jugs. All sample containers
600
should be rinsed with source water before being filled with sample.
601
After use with receiving water or effluents, CUBITAINERS® and
602
plastic jugs are punctured to prevent reuse.
603
604
605
8.5.7.3
606
Several sample shipping options are available, including
607
Express Mail, air express, bus, and courier service. Express Mail
608
is delivered seven days a week. Saturday and Sunday shipping and
609
receiving schedules of private carriers vary with the
610
carrier.
611
612
613
8.6
614
SAMPLE RECEIVING
615
616
617
618
619
8.6.1
620
Upon arrival at the laboratory, samples are logged in and
621
the temperature is measured and recorded. If the samples are not
622
immediately prepared for testing, they are stored at 0-6°C until
623
used.
624
625
626
8.6.2
627
Every effort must be made to initiate the test with an
628
effluent sample on the day of arrival in the laboratory, and the
629
sample holding time should not exceed 36 h unless a variance has
630
been granted by the NPDES permitting authority.
631
632
633
8.7
634
PERSISTENCE OF EFFLUENT TOXICITY DURING SAMPLE SHIPMENT
635
AND HOLDING
636
637
638
639
640
8.7.1
641
The persistence of the toxicity of
642
an effluent prior to its use in a toxicity test is of interest in
643
assessing the validity of toxicity test data, and in determining
644
the possible effects of allowing an extension of the holding time.
645
Where a variance in holding time (> 36 h, but # 72 h) is
646
requested by a permittee, (see Subsection 8.5.4 above), information
647
on the effects of the extension in holding time on the toxicity of
648
samples must be obtained by comparing the results of
649
multi-concentration chronic toxicity tests performed on effluent
650
samples held 36 h with toxicity test results using the same samples
651
after they were held for the requested, longer period. The portion
652
of the sample set aside for the second test should be held under
653
the same conditions as during shipment and holding.
654
655
656
8.8
657
PREPARATION OF EFFLUENT AND RECEIVING WATER SAMPLES FOR
658
TOXICITY TESTS
659
660
661
662
663
8.8.1
664
When aliquots are removed from the sample container, the
665
head space above the remaining sample should be held to a minimum.
666
Air which enters a container upon removal of sample should be
667
expelled by compressing the container before reclosing, if possible
668
(i.e., where a CUBITAINER® is used), or by using an appropriate
669
discharge valve (spigot).
670
671
672
8.8.2
673
With the daphnid, Ceriodaphnia dubia, and fathead minnow,
674
Pimephales promelas, tests, effluents and receiving waters should
675
be filtered through a 60-µm plankton net to remove indigenous
676
organisms that may attack or be confused with the test organisms
677
(see the daphnid, Ceriodaphnia dubia, test method for details).
678
Receiving waters used in green alga, Selenastrum capricornutum,
679
toxicity tests must be filtered through a 0.45-µm pore diameter
680
filter before use. It may be necessary to first coarse-filter the
681
dilution and/or waste water through a nylon sieve having 2- to 4-mm
682
mesh openings to remove debris and/or break up large floating or
683
suspended solids. Because filtration may increase the dissolved
684
oxygen (DO) in the effluent, the DO should be checked both before
685
and after filtering. Low dissolved oxygen concentrations will
686
indicate a potential problem in performing the test. Caution:
687
filtration may remove some toxicity.
688
689
690
8.8.3
691
If the samples must be warmed to bring them to the
692
prescribed test temperature, supersaturation of the dissolved
693
oxygen and nitrogen may become a problem. To avoid this problem,
694
samples may be warmed slowly in open test containers. If DO is
695
still above 100% saturation after warming to test temperature,
696
samples should be aerated moderately (approximately 500 mL/min) for
697
a few minutes using an airstone. If DO is below 4.0 mg/L after
698
warming to test temperature, the solutions must be aerated
699
moderately (approximately 500 mL/min) for a few minutes, using an
700
airstone, until the DO is within the prescribed range ($4.0 mg/L).
701
Caution: avoid excessive aeration.
702
703
704
8.8.4
705
The DO concentration in the samples should be near
706
saturation prior to use. Aeration may be used to bring the DO and
707
other gases into equilibrium with air, minimize oxygen demand, and
708
stabilize the pH. However, aeration during collection, transfer,
709
and preparation of samples should be minimized to reduce the loss
710
of volatile chemicals.
711
712
713
714
715
8.8.4.1
716
Aeration during the test may alter the results and should
717
be used only as a last resort to maintain the required DO. Aeration
718
can reduce the apparent toxicity of the test solutions by stripping
719
them of highly volatile toxic substances, or increase their
720
toxicity by altering pH. However, the DO in the test solutions
721
should not be allowed to fall below 4.0 mg/L.
722
723
724
8.8.4.2
725
In static tests (renewal or non-renewal), low DOs may
726
commonly occur in the higher concentrations of wastewater. Aeration
727
is accomplished by bubbling air through a pipet at a rate of 100
728
bubbles/min. If aeration is necessary, all test solutions must be
729
aerated. It is advisable to monitor the DO closely during the first
730
few hours of the test. Samples with a potential DO problem
731
generally show a downward trend in DO within 4 to 8 h after the
732
test is started. Unless aeration is initiated during the first 8 h
733
of the test, the DO may be exhausted during an unattended period,
734
thereby invalidating the test.
735
736
737
8.8.5
738
At a minimum, pH, conductivity, and total residual
739
chlorine are measured in the undiluted effluent or receiving water,
740
and pH and conductivity are measured in the dilution
741
water.
742
743
744
745
746
8.8.5.1
747
It is recommended that total alkalinity and total
748
hardness also be measured in the undiluted effluent test water,
749
receiving water, and the dilution water.
750
751
752
8.8.6
753
Total ammonia is measured in effluent and receiving water
754
samples where toxicity may be contributed by unionized ammonia
755
(i.e., where total ammonia $ 5 mg/L). The concentration (mg/L) of
756
un-ionized (free) ammonia in a sample is a function of temperature
757
and pH, and is calculated using the percentage value obtained from
758
Table 5, under the appropriate pH and temperature, and multiplying
759
it by the concentration (mg/L) of total ammonia in the
760
sample.
761
762
763
8.8.7
764
Effluents and receiving waters can be dechlorinated using
765
6.7 mg/L anhydrous sodium thiosulfate to reduce 1 mg/L chlorine
766
(APHA, 1992). Note that the amount of thiosulfate required to
767
dechlorinate effluents is greater than the amount needed to
768
dechlorinate tap water (see Section 7, Dilution Water, Subsection
769
7.4.1). Since thiosulfate may contribute to sample toxicity, a
770
thiosulfate control should be used in the test in addition to the
771
normal dilution water control.
772
773
774
8.8.8
775
Mortality or impairment of growth or reproduction due to
776
pH alone may occur if the pH of the sample falls outside the range
777
of 6.0 - 9.0. Thus, the presence of other forms of toxicity (metals
778
and organics) in the sample may be masked by the toxic effects of
779
low or high pH. The question about the presence of other toxicants
780
can be answered only by performing two parallel tests, one with an
781
adjusted pH, and one without an adjusted pH. Freshwater samples are
782
adjusted to pH 7.0 by adding 1N NaOH or 1N HCl dropwise, as
783
required, being careful to avoid overadjustment.
784
785
786
787
788
1
789
Table provided by Teresa Norberg-King, ERL, Duluth, Minnesota.
790
Also see Emerson et al. (1975), Thurston et al. (1974), and USEPA
791
(1985a).
792
8.9 PRELIMINARY TOXICITY RANGE-FINDING TESTS
793
794
795
8.9.1
796
USEPA Regional and State personnel generally have
797
observed that it is not necessary to conduct a toxicity
798
range-finding test prior to initiating a static, chronic,
799
definitive toxicity test. However, when preparing to perform a
800
static test with a sample of completely unknown quality, or before
801
initiating a flow-through test, it is advisable to conduct a
802
preliminary toxicity range-finding test.
803
804
805
8.9.2
806
A toxicity range-finding test ordinarily consists of a
807
down-scaled, abbreviated static acute test in which groups of five
808
organisms are exposed to several widely-spaced sample dilutions in
809
a logarithmic series, such as
810
811
812
100%, 10.0%, 1.00%, and 0.100%, and a control, for 8-24 h.
813
Caution: if the sample must also be used for the fullscale
814
definitive test, the 36-h limit on holding time (see Subsection
815
8.5.4) must not be exceeded before the definitive test is
816
initiated.
817
8.9.3 It should be noted that the toxicity
818
(LC50) of a sample observed in a range-finding test may be
819
significantly different from the toxicity observed in the follow-up
820
chronic definitive test because: (1) the definitive test is longer;
821
and (2) the test may be performed with a sample collected at a
822
different time, and possibly differing significantly in the level
823
of toxicity.
824
8.10 MULTI-CONCENTRATION (DEFINITIVE) EFFLUENT TOXICITY
825
TESTS
826
827
828
8.10.1
829
The tests recommended for use in determining discharge
830
permit compliance in the NPDES program are multi-concentration, or
831
definitive, tests which provide (1) a point estimate of effluent
832
toxicity in terms of an IC25, IC50, or LC50, or (2) a
833
no-observed-effect-concentration (NOEC) defined in terms of
834
mortality, growth, reproduction, and/or teratogenicity and obtained
835
by hypothesis testing. The tests may be static renewal or static
836
non-renewal.
837
838
839
8.10.2
840
The tests consist of a control and a minimum of five
841
effluent concentrations. USEPA recommends the use of a $0.5
842
dilution factor for selecting effluent test concentrations.
843
Effluent test concentrations of 6.25%, 12.5%, 25%, 50%, and 100%
844
are commonly used, however, test concentrations should be selected
845
independently for each test based on the objective of the study,
846
the expected range of toxicity, the receiving water concentration,
847
and any available historical testing information on the effluent.
848
USEPA (2000a) provides additional guidance on choosing appropriate
849
test concentrations.
850
851
852
8.10.3
853
When these tests are used in determining compliance with
854
permit limits, effluent test concentrations should be selected to
855
bracket the receiving water concentration. This may be achieved by
856
selecting effluent test concentrations in the following manner: (1)
857
100% effluent, (2) [RWC + 100]/2, (3) RWC, (4) RWC/2, and (5)
858
RWC/4. For example, where the RWC = 50%, appropriate effluent
859
concentrations may be 100%, 75%, 50%, 25%, and 12.5%.
860
861
862
8.10.4
863
If acute/chronic ratios are to be
864
determined by simultaneous acute and short-term chronic tests with
865
a single species, using the same sample, both types of tests must
866
use the same test conditions, i.e., pH, temperature, water
867
hardness, salinity, etc.
868
869
870
8.11
871
RECEIVING WATER TESTS
872
873
874
875
876
8.11.1
877
Receiving water toxicity tests generally consist of 100%
878
receiving water and a control. The total hardness of the control
879
should be comparable to the receiving water.
880
881
882
8.11.2
883
The data from the two treatments are analyzed by
884
hypothesis testing to determine if test organism survival in the
885
receiving water differs significantly from the control. Four
886
replicates and 10 organisms per replicate are required for each
887
treatment (see Summary of Test Conditions and Test Acceptability
888
Criteria in the specific test method).
889
890
891
8.11.3
892
In cases where the objective of the test is to estimate
893
the degree of toxicity of the receiving water, a multiconcentration
894
test is performed by preparing dilutions of the receiving water,
895
using a $ 0.5 dilution series, with a suitable control
896
water.
897
898
899
SECTION 9
900
CHRONIC TOXICITY TEST ENDPOINTS AND DATA
901
ANALYSIS
902
9.1 ENDPOINTS
903
9.1.1 The objective of chronic aquatic toxicity tests with
904
effluents and pure compounds is to estimate the highest "safe" or
905
"no-effect concentration" of these substances. For practical
906
reasons, the responses observed in these tests are usually limited
907
to hatchability, gross morphological abnormalities, survival,
908
growth, and reproduction, and the results of the tests are usually
909
expressed in terms of the highest toxicant concentration that has
910
no statistically significant observed effect on these responses,
911
when compared to the controls. The terms currently used to define
912
the endpoints employed in the rapid, chronic and sub-chronic
913
toxicity tests have been derived from the terms previously used for
914
full life-cycle tests. As shorter chronic tests were developed, it
915
became common practice to apply the same terminology to the
916
endpoints. The terms used in this manual are as follows:
917
918
919
9.1.1.1
920
Safe Concentration - The highest concentration of
921
toxicant that will permit normal propagation of fish and other
922
aquatic life in receiving waters. The concept of a "safe
923
concentration" is a biological concept, whereas the
924
"no-observed-effect concentration" (below) is a statistically
925
defined concentration.
926
927
928
9.1.1.2
929
No-Observed-Effect-Concentration (NOEC) - The highest
930
concentration of toxicant to which organisms are exposed in a full
931
life-cycle or partial life-cycle (short-term) test, that causes no
932
observable adverse effects on the test organisms (i.e., the highest
933
concentration of toxicant in which the values for the observed
934
responses are not statistically significantly different from the
935
controls). This value is used, along with other factors, to
936
determine toxicity limits in permits.
937
938
939
9.1.1.3
940
Lowest-Observed-Effect-Concentration (LOEC) - The lowest
941
concentration of toxicant to which organisms are exposed in a
942
life-cycle or partial life-cycle (short-term) test, which causes
943
adverse effects on the test organisms (i.e., where the values for
944
the observed responses are statistically significantly different
945
from the controls).
946
947
948
9.1.1.4
949
Effective Concentration (EC) - A point estimate of the
950
toxicant concentration that would cause an observable adverse
951
affect on a quantal, "all or nothing," response (such as death,
952
immobilization, or serious incapacitation) in a given percent of
953
the organisms, calculated by point estimation techniques. If the
954
observable effect is death or immobility, the term, Lethal
955
Concentration (LC), should be used (see Subsection 9.1.1.5). A
956
certain EC or LC value might be judged from a biological standpoint
957
to represent a threshold concentration, or lowest concentration
958
that would cause an adverse effect on the observed
959
response.
960
961
962
9.1.1.5
963
Lethal Concentration (LC) - The toxicant concentration
964
that would cause death in a given percent of the test population.
965
Identical to EC when the observed adverse effect is death. For
966
example, the LC50 is the concentration of toxicant that would cause
967
death in 50% of the test population.
968
969
970
9.1.1.6
971
Inhibition Concentration (IC) - The toxicant
972
concentration that would cause a given percent reduction in a
973
non-quantal biological measurement for the test population. For
974
example, the IC25 is the concentration of toxicant that would cause
975
a 25% reduction in mean young per female or in growth for the test
976
population, and the IC50 is the concentration of toxicant that
977
would cause a 50% reduction.
978
979
980
9.2
981
RELATIONSHIP BETWEEN ENDPOINTS DETERMINED BY HYPOTHESIS
982
TESTING AND POINT ESTIMATION TECHNIQUES
983
984
985
9.2.1 If the objective of chronic aquatic toxicity tests with
986
effluents and pure compounds is to estimate the highest "safe or
987
no-effect concentration" of these substances, it is imperative to
988
understand how the statistical endpoints of these tests are related
989
to the "safe" or "no-effect" concentration. NOECs and LOECs are
990
determined by hypothesis testing (Dunnett's Test, a t test with the
991
Bonferroni adjustment, Steel's Many-one Rank Test, or the Wilcoxon
992
Rank Sum Test with the Bonferroni adjustment), whereas LCs, ICs,
993
and ECs are determined by point estimation techniques (Probit
994
Analysis, Spearman-Karber Method, Trimmed Spearman-Karber Method,
995
Graphical Method or Linear Interpolation Method). There are
996
inherent differences between the use of a NOEC or LOEC derived from
997
hypothesis testing to estimate a "safe" concentration, and the use
998
of a LC, EC, IC, or other point estimates derived from curve
999
fitting, interpolation, etc.
1000
1001
1002
9.2.2
1003
Most point estimates, such as the LC, IC, or EC, are
1004
derived from a mathematical model that assumes a continuous
1005
dose-response relationship. By definition, any LC, IC, or EC value
1006
is an estimate of some amount of adverse effect. Thus the
1007
assessment of a "safe" concentration must be made from a biological
1008
standpoint rather than with a statistical test. In this instance,
1009
the biologist must determine some amount of adverse effect that is
1010
deemed to be "safe", in the sense that from a practical biological
1011
viewpoint it will not affect the normal propagation of fish and
1012
other aquatic life in receiving waters.
1013
1014
1015
9.2.3
1016
The use of NOECs and LOECs, on the other hand, assumes
1017
either (1) a continuous dose-response relationship, or (2) a
1018
non-continuous (threshold) model of the dose-response
1019
relationship.
1020
1021
1022
1023
1024
9.2.3.1
1025
In the case of a continuous dose-response relationship,
1026
it is also assumed that adverse effects that are not "statistically
1027
observable" are also not important from a biological standpoint,
1028
since they are not pronounced enough to test as statistically
1029
significant against some measure of the natural variability of the
1030
responses.
1031
1032
1033
9.2.3.2
1034
In the case of non-continuous dose-response
1035
relationships, it is assumed that there exists a true threshold, or
1036
concentration below which there is no adverse effect on aquatic
1037
life, and above which there is an adverse effect. The purpose of
1038
the statistical analysis in this case is to estimate as closely as
1039
possible where that threshold lies.
1040
1041
1042
9.2.3.3
1043
In either case, it is important to realize that the
1044
amount of adverse effect that is statistically observable (LOEC) or
1045
not observable (NOEC) is highly dependent on all aspects of the
1046
experimental design, such as the number of concentrations of
1047
toxicant, number of replicates per concentration, number of
1048
organisms per replicate, and use of randomization. Other factors
1049
that affect the sensitivity of the test include the choice of
1050
statistical analysis, the choice of an alpha level, and the amount
1051
of variability between responses at a given
1052
concentration.
1053
1054
1055
9.2.3.4
1056
Where the assumption of a continuous dose-response
1057
relationship is made, by definition some amount of adverse effect
1058
might be present at the NOEC, but is not great enough to be
1059
detected by hypothesis testing.
1060
1061
1062
9.2.3.5
1063
Where the assumption of a non-continuous dose-response
1064
relationship is made, the NOEC would indeed be an estimate of a
1065
"safe" or "no-effect" concentration if the amount of adverse effect
1066
that appears at the threshold is great enough to test as
1067
statistically significantly different from the controls in the face
1068
of all aspects of the experimental design mentioned above. If,
1069
however, the amount of adverse effect at the threshold were not
1070
great enough to test as statistically different, some amount of
1071
adverse effect might be present at the NOEC. In any case, the
1072
estimate of the NOEC with hypothesis testing is always dependent on
1073
the aspects of the experimental design mentioned above. For this
1074
reason, the reporting and examination of some measure of the
1075
sensitivity of the test (either the minimum significant difference
1076
or the percent change from the control that this minimum difference
1077
represents) is extremely important.
1078
1079
1080
9.2.4
1081
In summary, the assessment of a "safe" or "no-effect"
1082
concentration cannot be made from the results of statistical
1083
analysis alone, unless (1) the assumptions of a strict threshold
1084
model are accepted, and (2) it is assumed that the amount of
1085
adverse effect present at the threshold is statistically detectable
1086
by hypothesis testing. In this case, estimates obtained from a
1087
statistical analysis are indeed estimates of a "no-effect"
1088
concentration. If the assumptions are not deemed tenable, then
1089
estimates from a statistical analysis can only be used in
1090
conjunction with an assessment from a biological standpoint of what
1091
magnitude of adverse effect constitutes a "safe" concentration. In
1092
this instance, a "safe" concentration is not necessarily a truly
1093
"no-effect" concentration, but rather a concentration at which the
1094
effects are judged to be of no biological significance.
1095
1096
1097
9.2.5
1098
A better understanding of the relationship between
1099
endpoints derived by hypothesis testing (NOECs) and point
1100
estimation techniques (LCs, ICs, and ECs) would be very helpful in
1101
choosing methods of data analysis. Norberg-King (1991) reported
1102
that the IC25s were comparable to the NOECs for 23 effluent and
1103
reference toxicant data sets analyzed. The data sets included
1104
short-term chronic toxicity tests for the fathead minnow,
1105
Pimephales promelas, and the daphnid, Ceriodaphnia dubia. Birge et
1106
al. (1985) reported that LC1s derived from Probit Analysis of data
1107
from short-term embryo-larval tests with reference toxicants were
1108
comparable to NOECs for several organisms. Similarly, USEPA (1988d)
1109
reported that the IC25s were comparable to the NOECs for a set of
1110
daphnid, Ceriodaphnia dubia, chronic tests with a single reference
1111
toxicant. However, the scope of these comparisons was very limited,
1112
and sufficient information is not yet available to establish an
1113
overall relationship between these two types of endpoints,
1114
especially when derived from effluent toxicity test
1115
data.
1116
1117
1118
9.3
1119
PRECISION
1120
1121
1122
9.3.1 HYPOTHESIS TESTS
1123
1124
1125
9.3.1.1
1126
When hypothesis tests are used to analyze toxicity test
1127
data, it is not possible to express precision in terms of a
1128
commonly used statistic. The results of the test are given in terms
1129
of two endpoints, the No-Observed- Effect Concentration (NOEC) and
1130
the Lowest-Observed-Effect Concentration (LOEC). The NOEC and LOEC
1131
are limited to the concentrations selected for the test. The width
1132
of the NOEC-LOEC interval is a function of the dilution series, and
1133
differs greatly depending on whether a dilution factor of 0.3 or
1134
0.5 is used in the test design. Therefore, USEPA recommends the use
1135
of the $ 0.5 dilution factor (see Section 4, Quality Assurance). It
1136
is not possible to place confidence limits on the NOEC and LOEC
1137
derived from a given test, and it is difficult to quantify the
1138
precision of the NOEC-LOEC endpoints between tests. If the data
1139
from a series of tests performed with the same toxicant, toxicant
1140
concentrations, and test species, were analyzed with hypothesis
1141
tests, precision could only be assessed by a qualitative comparison
1142
of the NOEC-LOEC intervals, with the understanding that maximum
1143
precision would be attained if all tests yielded the same NOEC-LOEC
1144
interval. In practice, the precision of results of repetitive
1145
chronic tests is considered acceptable if the NOECs vary by no more
1146
than one concentration interval above or below a central tendency.
1147
Using these guidelines, the "normal" range of NOECs from toxicity
1148
tests using a 0.5 dilution factor (two-fold difference between
1149
adjacent concentrations), would be four-fold.
1150
1151
1152
9.3.2
1153
POINT ESTIMATION TECHNIQUES
1154
1155
1156
9.3.2.1 Point estimation techniques have the advantage of
1157
providing a point estimate of the toxicant concentration causing a
1158
given amount of adverse (inhibiting) effect, the precision of which
1159
can be quantitatively assessed
1160
(1) within tests by calculation of 95% confidence limits, and
1161
(2) across tests by calculating a standard deviation and
1162
coefficient of variation.
1163
1164
1165
9.3.2.2
1166
It should be noted that software used to calculate point
1167
estimates occasionally may not provide associated 95% confidence
1168
intervals. This situation may arise when test data do not meet
1169
specific assumptions required by the statistical methods, when
1170
point estimates are outside of the test concentration range, and
1171
when specific limitations imposed by the software are encountered.
1172
USEPA (2000a) provides guidance on confidence intervals under these
1173
circumstances.
1174
1175
1176
9.4
1177
DATA ANALYSIS
1178
1179
1180
9.4.1 ROLE OF THE STATISTICIAN
1181
1182
1183
9.4.1.1
1184
The use of the statistical methods described in this
1185
manual for routine data analysis does not require the assistance of
1186
a statistician. However, the interpretation of the results of the
1187
analysis of the data from any of the toxicity tests described in
1188
this manual can become problematic because of the inherent
1189
variability and sometimes unavoidable anomalies in biological data.
1190
If the data appear unusual in any way, or fail to meet the
1191
necessary assumptions, a statistician should be consulted. Analysts
1192
who are not proficient in statistics are strongly advised to seek
1193
the assistance of a statistician before selecting the method of
1194
analysis and using any of the results.
1195
1196
1197
9.4.1.2
1198
The statistical methods recommended in this manual are
1199
not the only possible methods of statistical analysis. Many other
1200
methods have been proposed and considered. Certainly there are
1201
other reasonable and defensible methods of statistical analysis for
1202
this kind of toxicity data. Among alternative hypothesis tests
1203
some, like Williams' Test, require additional assumptions, while
1204
others, like the bootstrap methods, require computerintensive
1205
computations. Alternative point estimation approaches most probably
1206
would require the services of a statistician to determine the
1207
appropriateness of the model (goodness of fit), higher order linear
1208
or nonlinear models, confidence intervals for estimates generated
1209
by inverse regression, etc. In addition, point estimation or
1210
regression approaches would require the specification by biologists
1211
or toxicologists of some low level of adverse effect that would be
1212
deemed acceptable or safe. The statistical methods contained in
1213
this manual have been chosen because they are (1) applicable to
1214
most of the different toxicity test data sets for which they are
1215
recommended, (2) powerful statistical tests, (3) hopefully "easily"
1216
understood by nonstatisticians, and (4) amenable to use without a
1217
computer, if necessary.
1218
1219
1220
9.4.2
1221
PLOTTING THE DATA
1222
1223
1224
1225
1226
9.4.2.1
1227
The data should be plotted, both as a preliminary step to
1228
help detect problems and unsuspected trends or patterns in the
1229
responses, and as an aid in interpretation of the results. Further
1230
discussion and plotted sets of data are included in the methods and
1231
the Appendices.
1232
1233
1234
9.4.3
1235
DATA TRANSFORMATIONS
1236
1237
1238
1239
1240
9.4.3.1
1241
Transformations of the data, (e.g., arc sine square root
1242
and logs), are used where necessary to meet assumptions of the
1243
proposed analyses, such as the requirement for normally distributed
1244
data.
1245
1246
1247
9.4.4
1248
INDEPENDENCE, RANDOMIZATION, AND OUTLIERS
1249
1250
1251
1252
1253
9.4.4.1
1254
Statistical independence among observations is a critical
1255
assumption in all statistical analysis of toxicity data. One of the
1256
best ways to insure independence is to properly follow rigorous
1257
randomization procedures. Randomization techniques should be
1258
employed at the start of the test, including the randomization of
1259
the placement of test organisms in the test chambers and
1260
randomization of the test chamber location within the array of
1261
chambers. Discussions of statistical independence, outliers and
1262
randomization, and a sample randomization scheme, are included in
1263
Appendix A.
1264
1265
1266
9.4.5
1267
REPLICATION AND SENSITIVITY
1268
1269
1270
1271
1272
9.4.5.1
1273
The number of replicates employed for each toxicant
1274
concentration is an important factor in determining the sensitivity
1275
of chronic toxicity tests. Test sensitivity generally increases as
1276
the number of replicates is increased, but the point of diminishing
1277
returns in sensitivity may be reached rather quickly. The level of
1278
sensitivity required by a hypothesis test or the confidence
1279
interval for a point estimate will determine the number of
1280
replicates, and should be based on the objectives for obtaining the
1281
toxicity data.
1282
1283
1284
9.4.5.2
1285
In a statistical analysis of toxicity data, the choice of
1286
a particular analysis and the ability to detect departures from the
1287
assumptions of the analysis, such as the normal distribution of the
1288
data and homogeneity of variance, is also dependent on the number
1289
of replicates. More than the minimum number of replicates may be
1290
required in situations where it is imperative to obtain optimal
1291
statistical results, such as with tests used in enforcement cases
1292
or when it is not possible to repeat the tests. For example, when
1293
the data are analyzed by hypothesis testing, the nonparametric
1294
alternatives cannot be used unless there are at least four
1295
replicates at each toxicant concentration.
1296
1297
1298
9.4.6
1299
RECOMMENDED ALPHA LEVELS
1300
1301
1302
9.4.6.1 The data analysis examples included in the manual
1303
specify an alpha level of 0.01 for testing the assumptions of
1304
hypothesis tests and an alpha level of 0.05 for the hypothesis
1305
tests themselves. These levels are common and well accepted levels
1306
for this type of analysis and are presented as a recommended
1307
minimum significance level for toxicity test data analysis.
1308
9.5 CHOICE OF ANALYSIS
1309
1310
1311
9.5.1
1312
The recommended statistical analysis of most data from
1313
chronic toxicity tests with aquatic organisms follows a decision
1314
process illustrated in the flowchart in Figure 2. An initial
1315
decision is made to use point estimation techniques (the Probit
1316
Analysis, the Spearman-Karber Method, the Trimmed Spearman-Karber
1317
Method, the Graphical Method, or Linear Interpolation Method)
1318
and/or to use hypothesis testing (Dunnett's Test, the t test with
1319
the Bonferroni adjustment, Steel's Many-one Rank Test, or the
1320
Wilcoxon Rank Sum Test with the Bonferroni adjustment). NOTE: For
1321
the NPDES Permit Program, the point estimation techniques are the
1322
preferred statistical methods in calculating end points for
1323
effluent toxicity tests. If hypothesis testing is chosen,
1324
subsequent decisions are made on the appropriate procedure for a
1325
given set of data, depending on the results of the tests of
1326
assumptions, as illustrated in the flowchart. A specific flow chart
1327
is included in the analysis section for each test.
1328
1329
1330
9.5.2
1331
Since a single chronic toxicity test might yield
1332
information on more than one parameter (such as survival, growth,
1333
and reproduction), the lowest estimate of a "no-observed-effect
1334
concentration" for any of the responses would be used as the
1335
"no-observed-effect concentration" for each test. It follows
1336
logically that in the statistical analysis of the data,
1337
concentrations that had a significant toxic effect on one of the
1338
observed responses would not be subsequently tested for an effect
1339
on some other response. This is one reason for excluding
1340
concentrations that have shown a statistically significant
1341
reduction in survival from a subsequent hypothesis test for effects
1342
on another parameter such as reproduction. A second reason is that
1343
the exclusion of such concentrations usually results in a more
1344
powerful and appropriate statistical analysis. In performing the
1345
point estimation techniques recommended in this manual, an all-data
1346
approach is used. For example, data from concentrations above the
1347
NOEC for survival are included in determining ICp estimates using
1348
the Linear Interpolation Method.
1349
1350
1351
9.5.3
1352
ANALYSIS OF GROWTH AND REPRODUCTION DATA
1353
1354
1355
1356
1357
9.5.3.1
1358
Growth data from the fathead minnow, Pimephales promelas,
1359
larval survival and growth test are analyzed using hypothesis
1360
testing or point estimation techniques according to the flowchart
1361
in Figure 2. The above mentioned growth data may also be analyzed
1362
by generating a point estimate with the Linear Interpolation
1363
Method. Data from effluent concentrations that have tested
1364
significantly different from the control for survival are excluded
1365
from further hypothesis tests concerning growth effects. Growth is
1366
defined as the dry weight per original number of test organisms
1367
when group weights are obtained. When analyzing the data using
1368
point estimation techniques, data from all concentrations are
1369
included in the analysis.
1370
1371
1372
9.5.3.2
1373
Reproduction data from the daphnid, Ceriodaphnia dubia,
1374
survival and reproduction test are analyzed using hypothesis
1375
testing or point estimation techniques according to the flowchart
1376
in Figure 2. In hypothesis testing, data from effluent
1377
concentrations that have significantly lower survival than the
1378
control, as determined by Fisher's Exact test, are not included in
1379
the hypothesis tests for reproductive effects. Data from all
1380
concentrations are included when using point estimation
1381
techniques.
1382
1383
1384
9.5.4
1385
ANALYSIS OF ALGAL GROWTH RESPONSE DATA
1386
1387
1388
1389
1390
9.5.4.1
1391
The growth response data from the green alga, Selenastrum
1392
capricornutum, toxicity test, after an appropriate transformation,
1393
if necessary, to meet the assumptions of normality and homogeneity
1394
of variance, may be analyzed by hypothesis testing according to the
1395
flowchart in Figure 2. Point estimates, such as the IC25 and IC50,
1396
would also be appropriate in analyzing algal growth
1397
data.
1398
1399
1400
9.5.5
1401
ANALYSIS OF MORTALITY DATA
1402
1403
1404
1405
1406
9.5.5.1
1407
Mortality data are analyzed by Probit Analysis, if
1408
appropriate, or other point estimation techniques (i.e., the
1409
Spearman-Karber Method, the Trimmed Spearman-Karber Method, or the
1410
Graphical Method) (see Appendices I-L and the discussion below).
1411
The mortality data can also be analyzed by hypothesis testing,
1412
after an arc sine square root transformation (see Appendix B-F),
1413
according to the flowchart in Figure 2.
1414
1415
1416
9.5.5.2
1417
Mortality data from the daphnid, Ceriodaphnia dubia,
1418
survival and reproduction test are analyzed by Fisher's Exact Test
1419
(Appendix G) prior to the analysis of the reproduction data. The
1420
mortality data may also be analyzed by Probit Analysis, if
1421
appropriate or other methods (see Subsection 9.5.5.1).
1422
1423
1424
9.6
1425
HYPOTHESIS TESTS
1426
1427
1428
1429
9.6.1 DUNNETT'S PROCEDURE
1430
1431
1432
9.6.1.1
1433
Dunnett's Procedure is used to determine the NOEC. The
1434
procedure consists of an analysis of variance (ANOVA) to determine
1435
the error term, which is then used in a multiple comparison
1436
procedure for comparing each of the treatment means with the
1437
control mean, in a series of paired tests (see Appendix C). Use of
1438
Dunnett's Procedure requires at least three replicates per
1439
treatment to check the assumptions of the test. In cases where the
1440
numbers of data points (replicates) for each concentration are not
1441
equal, a t test may be performed with Bonferroni's adjustment for
1442
multiple comparisons (see Appendix D), instead of using Dunnett's
1443
Procedure.
1444
1445
1446
9.6.1.2
1447
The assumptions upon which the use of Dunnett's Procedure
1448
is contingent are that the observations within treatments are
1449
normally distributed, with homogeneity of variance. Before
1450
analyzing the data, these assumptions must be tested using the
1451
procedures provided in Appendix B.
1452
1453
1454
9.6.1.3
1455
If, after suitable transformations have been carried out,
1456
the normality assumptions have not been met, Steel's Many-one Rank
1457
Test should be used if there are four or more data points
1458
(replicates) per toxicant concentration. If the numbers of data
1459
points for each toxicant concentration are not equal, the Wilcoxon
1460
Rank Sum Test with Bonferroni's adjustment should be used (see
1461
Appendix F).
1462
1463
1464
9.6.1.4
1465
Some indication of the sensitivity of the analysis should
1466
be provided by calculating (1) the minimum difference between means
1467
that can be detected as statistically significant, and (2) the
1468
percent change from the control mean that this minimum difference
1469
represents for a given test.
1470
1471
1472
9.6.1.5
1473
A step-by-step example of the use of Dunnett's Procedure
1474
is provided in Appendix C.
1475
1476
1477
9.6.2
1478
T TEST WITH THE BONFERRONI ADJUSTMENT
1479
1480
1481
1482
1483
9.6.2.1
1484
A t test with Bonferroni's adjustment is used as an
1485
alternative to Dunnett's Procedure when the number of replicates is
1486
not the same for all concentrations. This test sets an upper bound
1487
of alpha on the overall error rate, in contrast to Dunnett's
1488
Procedure, for which the overall error rate is fixed at alpha. Thus
1489
Dunnett's Procedure is a more powerful test.
1490
1491
1492
9.6.2.2
1493
The assumptions upon which the use of the t test with
1494
Bonferroni's adjustment is contingent are that the observations
1495
within treatments are normally distributed, with homogeneity of
1496
variance. These assumptions must be tested using the procedures
1497
provided in Appendix B.
1498
1499
1500
9.6.2.3
1501
The estimate of the safe concentration derived from this
1502
test is reported in terms of the NOEC. A step-by-step example of
1503
the use of the t test with Bonferroni's adjustment is provided in
1504
Appendix D.
1505
1506
1507
9.6.3
1508
STEEL'S MANY-ONE RANK TEST
1509
1510
1511
1512
1513
9.6.3.1
1514
Steel's Many-one Rank Test is a multiple comparison
1515
procedure for comparing several treatments with a control. This
1516
method is similar to Dunnett's Procedure, except that it is not
1517
necessary to meet the assumption of normality. The data are ranked,
1518
and the analysis is performed on the ranks rather than on the data
1519
themselves. If the data are normally or nearly normally
1520
distributed, Dunnett's Procedure would be more sensitive (would
1521
detect smaller differences between the treatments and control). For
1522
data that are not normally distributed, Steel's Many-one Rank Test
1523
can be much more efficient (Hodges and Lehmann, 1956).
1524
1525
1526
9.6.3.2
1527
It is necessary to have at least four replicates per
1528
toxicant concentration to use Steel's test. Unlike Dunnett's
1529
procedure, the sensitivity of this test cannot be stated in terms
1530
of the minimum difference between treatment means and the control
1531
mean that can be detected as statistically significant.
1532
1533
1534
9.6.3.3
1535
The estimate of the safe concentration is reported as the
1536
NOEC. A step-by-step example of the use of Steel's Many-one Rank
1537
Test is provided in Appendix E.
1538
1539
1540
9.6.4
1541
WILCOXON RANK SUM TEST WITH THE BONFERRONI
1542
ADJUSTMENT
1543
1544
1545
1546
1547
9.6.4.1
1548
The Wilcoxon Rank Sum Test with the Bonferroni Adjustment
1549
is a nonparametric test for comparing treatments with a control.
1550
The data are ranked and the analysis proceeds exactly as in Steel's
1551
Test except that Bonferroni's adjustment for multiple comparisons
1552
is used instead of Steel's tables. When Steel's test can be used
1553
(i.e., when there are equal numbers of data points per toxicant
1554
concentration), it will be more powerful (able to detect smaller
1555
differences as statistically significant) than the Wilcoxon Rank
1556
Sum Test with Bonferroni's adjustment.
1557
1558
1559
9.6.4.2
1560
The estimate of the safe concentration is reported as the
1561
NOEC. A step-by-step example of the use of the Wilcoxon Rank Sum
1562
Test with Bonferroni Adjustment is provided in Appendix
1563
F.
1564
1565
1566
9.6.5
1567
A CAUTION IN THE USE OF HYPOTHESIS TESTING
1568
1569
1570
1571
1572
9.6.5.1
1573
If in the calculation of an NOEC by
1574
hypothesis testing, two tested concentrations cause statistically
1575
significant adverse effects, but an intermediate concentration did
1576
not cause statistically significant effects, the results should be
1577
used with extreme caution.
1578
1579
1580
9.7
1581
POINT ESTIMATION TECHNIQUES
1582
1583
1584
9.7.1 PROBIT ANALYSIS
1585
1586
1587
9.7.1.1
1588
Probit Analysis is used to estimate the LC1, LC50, EC1,
1589
or EC50 and the associated 95% confidence interval. The analysis
1590
consists of adjusting the data for mortality in the control, and
1591
then using a maximum likelihood technique to estimate the
1592
parameters of the underlying log tolerance distribution, which is
1593
assumed to have a particular shape.
1594
1595
1596
9.7.1.2
1597
The assumption upon which the use of Probit Analysis is
1598
contingent is a normal distribution of log tolerances. If the
1599
normality assumption is not met, and at least two partial
1600
mortalities are not obtained, Probit Analysis should not be used.
1601
It is important to check the results of Probit Analysis to
1602
determine if use of the analysis is appropriate. The chi-square
1603
test for heterogeneity provides one good test of appropriateness of
1604
the analysis. The computer program (see Appendix I) checks the
1605
chi-square statistic calculated for the data set against the
1606
tabular value, and provides an error message if the calculated
1607
value exceeds the tabular value.
1608
1609
1610
9.7.1.3
1611
A discussion of Probit Analysis, and examples of computer
1612
program input and output, are found in Appendix I.
1613
1614
1615
9.7.1.4
1616
In cases where Probit Analysis is not appropriate, the
1617
LC50 and associated confidence interval may be estimated by the
1618
Spearman-Karber Method (Appendix J) or the Trimmed Spearman-Karber
1619
Method (Appendix K). If the test results in 100% survival and 100%
1620
mortality in adjacent treatments (all or nothing effect), the LC50
1621
may be estimated using the Graphical Method (Appendix
1622
1623
L).
1624
1625
1626
9.7.2
1627
LINEAR INTERPOLATION METHOD
1628
1629
1630
1631
1632
9.7.2.1
1633
The Linear Interpolation Method (see Appendix M) is a
1634
procedure to calculate a point estimate of the effluent or other
1635
toxicant concentration [Inhibition Concentration, (IC)] that causes
1636
a given percent reduction (e.g., 25%, 50%, etc.) in the
1637
reproduction or growth of the test organisms. The procedure was
1638
designed for general applicability in the analysis of data from
1639
short-term chronic toxicity tests.
1640
1641
1642
9.7.2.2
1643
Use of the Linear Interpolation Method is based on the
1644
assumptions that the responses (1) are monotonically non-increasing
1645
(the mean response for each higher concentration is less than or
1646
equal to the mean response for the previous concentration), (2)
1647
follow a piecewise linear response function, and (3) are from a
1648
random, independent, and representative sample of test data. The
1649
assumption for piecewise linear response cannot be tested
1650
statistically, and no defined statistical procedure is provided to
1651
test the assumption for monotonicity. Where the observed means are
1652
not strictly monotonic by examination, they are adjusted by
1653
smoothing. In cases where the responses at the low toxicant
1654
concentrations are much higher than in the controls, the smoothing
1655
process may result in a large upward adjustment in the control
1656
mean.
1657
1658
1659
9.7.2.3
1660
The inability to test the monotonicity and piecewise
1661
linear response assumptions for this method makes it difficult to
1662
assess when the method is, or is not, producing reliable results.
1663
Therefore, the method should be used with caution when the results
1664
of a toxicity test approach an "all or nothing" response from one
1665
concentration to the next in the concentration series, and when it
1666
appears that there is a large deviation from monotonicity. See
1667
Appendix M for a more detailed discussion of the use of this method
1668
and a computer program available for performing
1669
calculations.
1670
1671
1672
SECTION 10
1673
REPORT PREPARATION AND TEST REVIEW
1674
10.1 REPORT PREPARATION
1675
The following general format and content are recommended for the
1676
report:
1677
10.1.1 INTRODUCTION
1678
1679
1680
1.
1681
Permit number
1682
1683
1684
2.
1685
Toxicity testing requirements of permit
1686
1687
1688
3.
1689
Plant location
1690
1691
1692
4.
1693
Name of receiving water body
1694
1695
1696
1697
5.
1698
Contract Laboratory (if the tests are performed under
1699
contract) a Name of firm
1700
1701
1702
1703
b.
1704
Phone number
1705
1706
1707
c.
1708
Address
1709
1710
1711
1712
1713
6. Objective of test
1714
10.1.2 PLANT OPERATIONS
1715
1716
1717
1.
1718
Product(s)
1719
1720
1721
2.
1722
Raw materials
1723
1724
1725
3.
1726
Operating schedule
1727
1728
1729
4.
1730
Description of waste treatment
1731
1732
1733
5.
1734
Schematic of waste treatment
1735
1736
1737
6.
1738
Retention time (if applicable)
1739
1740
1741
7.
1742
Volume of waste flow (MGD, CFS, GPM)
1743
1744
1745
8.
1746
Design flow of treatment facility at time of
1747
sampling
1748
1749
1750
10.1.3 SOURCE OF EFFLUENT, RECEIVING WATER, AND DILUTION
1751
WATER
1752
1. Effluent Samples
1753
1754
1755
a.
1756
Sampling point (including latitude and
1757
longitude)
1758
1759
1760
b.
1761
Collection dates and times
1762
1763
1764
c.
1765
Sample collection method
1766
1767
1768
d.
1769
Physical and chemical data
1770
1771
1772
e.
1773
Mean daily discharge on sample collection date
1774
1775
1776
f.
1777
Lapsed time from sample collection to delivery
1778
1779
1780
g.
1781
Sample temperature when received at the
1782
laboratory
1783
1784
1785
2. Receiving Water Samples
1786
1787
1788
a.
1789
Sampling point (including latitude and
1790
longitude)
1791
1792
1793
b.
1794
Collection dates and times
1795
1796
1797
c.
1798
Sample collection method
1799
1800
1801
d.
1802
Physical and chemical data
1803
1804
1805
e.
1806
Streamflow (at time of sampling)
1807
1808
1809
f.
1810
Sample temperature when received at the laboratory g
1811
Lapsed time from sample collection to delivery
1812
1813
1814
3. Dilution Water Samples
1815
1816
1817
a.
1818
Source
1819
1820
1821
b.
1822
Collection date(s) and time(s)
1823
1824
1825
c.
1826
Pretreatment
1827
1828
1829
d.
1830
Physical and chemical characteristics
1831
1832
1833
10.1.4 TEST METHODS
1834
1835
1836
1.
1837
Toxicity test method used (title, number,
1838
source)
1839
1840
1841
2.
1842
Endpoint(s) of test
1843
1844
1845
3.
1846
Deviation(s) from reference method, if any, and the
1847
reason(s)
1848
1849
1850
4.
1851
Date and time test started
1852
1853
1854
5.
1855
Date and time test terminated
1856
1857
1858
6.
1859
Type and volume of test chambers
1860
1861
1862
7.
1863
Volume of solution used per chamber
1864
1865
1866
8.
1867
Number of organisms per test chamber
1868
1869
1870
9.
1871
Number of replicate test chambers per
1872
treatment
1873
1874
1875
10.
1876
Acclimation of test organisms (temperature mean and
1877
range)
1878
1879
1880
11.
1881
Test temperature (mean and range)
1882
1883
1884
12.
1885
Specify if aeration was needed
1886
1887
1888
13.
1889
Feeding frequency, and amount and type of food
1890
1891
1892
14.
1893
Specify if (and how) pH control measures were
1894
implemented
1895
1896
1897
10.1.5 TEST ORGANISMS
1898
1899
1900
1.
1901
Scientific name and how determined
1902
1903
1904
2.
1905
Age
1906
1907
1908
3.
1909
Life stage
1910
1911
1912
4.
1913
Mean length and weight (where applicable)
1914
1915
1916
5.
1917
Source
1918
1919
1920
6.
1921
Diseases and treatment (where applicable)
1922
1923
1924
7.
1925
Taxonomic key used for species identification
1926
1927
1928
10.1.6 QUALITY ASSURANCE
1929
1930
1931
1.
1932
Reference toxicant used routinely; source
1933
1934
1935
2.
1936
Date and time of most recent reference toxicant test,
1937
test results, and current control chart
1938
1939
1940
3.
1941
Dilution water used in reference toxicant test
1942
1943
1944
4.
1945
Results (NOEC or, where applicable, LOEC, LC50, EC50,
1946
IC25 and/or IC50); report percent minimum significant difference
1947
(PMSD) calculated for sublethal endpoints determined by hypothesis
1948
testing in reference toxicant test
1949
1950
1951
5.
1952
Physical and chemical methods used
1953
1954
1955
10.1.7 RESULTS
1956
1957
1958
1.
1959
Provide raw toxicity data in tabular form, including
1960
daily records of affected organisms in each concentration
1961
(including controls) and replicate, and in graphical form (plots of
1962
toxicity data)
1963
1964
1965
2.
1966
Provide table of LC50s, NOECs, IC25, IC50, etc. (as
1967
required in the applicable NPDES permit)
1968
1969
1970
3.
1971
Indicate statistical methods used to calculate
1972
endpoints
1973
1974
1975
4.
1976
Provide summary table of physical and chemical
1977
data
1978
1979
1980
5.
1981
Tabulate QA data
1982
1983
1984
6.
1985
Provide percent minimum significant difference (PMSD)
1986
calculated for sublethal endpoints
1987
1988
1989
10.1.8 CONCLUSIONS AND RECOMMENDATIONS
1990
1991
1992
1.
1993
Relationship between test endpoints and permit
1994
limits
1995
1996
1997
2.
1998
Actions to be taken
1999
2000
2001
10.2 TEST REVIEW
2002
2003
2004
2005
10.2.1
2006
Test review is an important part of an overall quality
2007
assurance program (Section 4) and is necessary for ensuring that
2008
all test results are reported accurately. Test review should be
2009
conducted on each test by both the testing laboratory and the
2010
regulatory authority.
2011
2012
2013
10.2.2
2014
SAMPLING AND HANDLING
2015
2016
2017
2018
2019
10.2.2.1
2020
The collection and handling of samples are reviewed to
2021
verify that the sampling and handling procedures given in Section 8
2022
were followed. Chain-of-custody forms are reviewed to verify that
2023
samples were tested within allowable sample holding times
2024
(Subsection 8.5.4). Any deviations from the procedures given in
2025
Section 8 should be documented and described in the data report
2026
(Subsection 10.1).
2027
2028
2029
10.2.3
2030
TEST ACCEPTABILITY CRITERIA
2031
2032
2033
2034
2035
10.2.3.1
2036
Test data are reviewed to verify that test acceptability
2037
criteria (TAC) requirements for a valid test have been met. Any
2038
test not meeting the minimum test acceptability criteria is
2039
considered invalid. All invalid tests must be repeated with a newly
2040
collected sample.
2041
2042
2043
10.2.4
2044
TEST CONDITIONS
2045
2046
2047
2048
2049
10.2.4.1
2050
Test conditions are reviewed and compared to the
2051
specifications listed in the summary of test condition tables
2052
provided for each method. Physical and chemical measurements taken
2053
during the test (e.g., temperature, pH, and DO) also are reviewed
2054
and compared to specified ranges. Any deviations from
2055
specifications should be documented and described in the data
2056
report (Subsection 10.1).
2057
2058
2059
10.2.4.2
2060
The summary of test condition tables presented for each
2061
method identify test conditions as required or recommended. For WET
2062
test data submitted under NPDES permits, all required test
2063
conditions must be met or the test is considered invalid and must
2064
be repeated with a newly collected sample. Deviations from
2065
recommended test conditions must be evaluated on a case-by-case
2066
basis to determine the validity of test results. Deviations from
2067
recommended test conditions may or may not invalidate a test result
2068
depending on the degree of the departure and the objective of the
2069
test. The reviewer should consider the degree of the deviation and
2070
the potential or observed impact of the deviation on the test
2071
result before rejecting or accepting a test result as valid. For
2072
example, if dissolved oxygen is measured below 4.0 mg/L in one test
2073
chamber, the reviewer should consider whether any observed
2074
mortality in that test chamber corresponded with the drop in
2075
dissolved oxygen.
2076
2077
2078
10.2.4.3
2079
Whereas slight deviations in test conditions may not
2080
invalidate an individual test result, test condition deviations
2081
that continue to occur frequently in a given laboratory may
2082
indicate the need for improved quality control in that
2083
laboratory.
2084
2085
2086
10.2.5
2087
STATISTICAL METHODS
2088
2089
2090
10.2.5.1 The statistical methods used for analyzing test data
2091
are reviewed to verify that the recommended flowcharts for
2092
statistical analysis were followed. Any deviation from the
2093
recommended flowcharts for selection of statistical methods should
2094
be noted in the data report. Statistical methods other than those
2095
recommended in the statistical flowcharts may be appropriate (see
2096
Subsection 9.4.1.2), however, the laboratory must document the use
2097
of and provide the rationale for the use of any alternate
2098
statistical method. In all cases (flowchart recommended methods or
2099
alternate methods), reviewers should verify that the necessary
2100
assumptions are met for the statistical method used.
2101
10.2.6 CONCENTRATION-RESPONSE RELATIONSHIPS
2102
2103
2104
10.2.6.1
2105
The concept of a concentration-response, or more
2106
classically, a dose-response relationship is "the most fundamental
2107
and pervasive one in toxicology" (Casarett and Doull, 1975). This
2108
concept assumes that there is a causal relationship between the
2109
dose of a toxicant (or concentration for toxicants in solution) and
2110
a measured response. A response may be any measurable biochemical
2111
or biological parameter that is correlated with exposure to the
2112
toxicant. The classical concentration-response relationship is
2113
depicted as a sigmoidal shaped curve, however, the particular shape
2114
of the concentration-response curve may differ for each coupled
2115
toxicant and response pair. In general, more severe responses (such
2116
as acute effects) occur at higher concentrations of the toxicant,
2117
and less severe responses (such as chronic effects) occur at lower
2118
concentrations. A single toxicant also may produce multiple
2119
responses, each characterized by a concentration-response
2120
relationship. A corollary of the concentration-response concept is
2121
that every toxicant should exhibit a concentration-response
2122
relationship, given that the appropriate response is measured and
2123
given that the concentration range evaluated is appropriate. Use of
2124
this concept can be helpful in determining whether an effluent
2125
possesses toxicity and in identifying anomalous test
2126
results.
2127
2128
2129
10.2.6.2
2130
The concentration-response relationship generated for
2131
each multi-concentration test must be reviewed to ensure that
2132
calculated test results are interpreted appropriately. USEPA
2133
(2000a) provides guidance on evaluating concentration-response
2134
relationships to assist in determining the validity of WET test
2135
results. All WET test results (from multi-concentration tests)
2136
reported under the NPDES program should be reviewed and reported
2137
according to USEPA guidance on the evaluation of
2138
concentration-response relationships (USEPA, 2000a). This guidance
2139
provides review steps for 10 different concentration-response
2140
patterns that may be encountered in WET test data. Based on the
2141
review, the guidance provides one of three determinations: that
2142
calculated effect concentrations are reliable and should be
2143
reported, that calculated effect concentrations are anomalous and
2144
should be explained, or that the test was inconclusive and the test
2145
should be repeated with a newly collected sample. It should be
2146
noted that the determination of a valid concentration-response
2147
relationship is not always clear cut. Data from some tests may
2148
suggest consultation with professional toxicologists and/or
2149
regulatory officials. Tests that exhibit unexpected
2150
concentration-response relationships also may indicate a need for
2151
further investigation and possible retesting.
2152
2153
2154
10.2.7
2155
REFERENCE TOXICANT TESTING
2156
2157
2158
2159
2160
10.2.7.1
2161
Test review of a given effluent or receiving water test
2162
should include review of the associated reference toxicant test and
2163
current control chart. Reference toxicant testing and control
2164
charting is required for documenting the quality of test organisms
2165
(Subsection 4.7) and ongoing laboratory performance (Subsection
2166
4.16). The reviewer should verify that a quality control reference
2167
toxicant test was conducted according to the specified frequency
2168
required by the permitting authority or recommended by the method
2169
(e.g., monthly). The test acceptability criteria, test conditions,
2170
concentration-response relationship, and test sensitivity of the
2171
reference toxicant test are reviewed to verify that the reference
2172
toxicant test conducted was a valid test. The results of the
2173
reference toxicant test are then plotted on a control chart (see
2174
Subsection 4.16) and compared to the current control chart limits
2175
(± 2 standard deviations).
2176
2177
2178
10.2.7.2
2179
Reference toxicant tests that fall outside of recommended
2180
control chart limits are evaluated to determine the validity of
2181
associated effluent and receiving water tests (see Subsection
2182
4.16). An out of control reference toxicant test result does not
2183
necessarily invalidate associated test results. The reviewer should
2184
consider the degree to which the reference toxicant test result
2185
fell outside of control chart limits, the width of the limits, the
2186
direction of the deviation (toward increasing test organism
2187
sensitivity or toward decreasing test organism sensitivity), the
2188
test conditions of both the effluent test and the reference
2189
toxicant test, and the objective of the test. More frequent and/or
2190
concurrent reference toxicant testing may be advantageous if recent
2191
problems (e.g., invalid tests, reference toxicant test results
2192
outside of control chart limits, reduced health of organism
2193
cultures, or increased within-test variability) have been
2194
identified in testing.
2195
2196
2197
10.2.8
2198
TEST VARIABILITY
2199
2200
2201
2202
2203
10.2.8.1
2204
The within-test variability of individual tests should be
2205
reviewed. Excessive within-test variability may invalidate a test
2206
result and warrant retesting. For evaluating within-test
2207
variability, reviewers should consult EPA guidance on upper and
2208
lower percent minimum significant difference (PMSD) bounds (USEPA,
2209
2000b).
2210
2211
2212
10.2.8.2
2213
When NPDES permits require sublethal hypothesis testing
2214
endpoints from Methods 1000.0,1002.0, or 1003.0 (e.g., growth or
2215
reproduction NOECs and LOECs), within-test variability must be
2216
reviewed and variability criteria must be applied as described in
2217
this section (10.2.8.2). When the methods are used for
2218
non-regulatory purposes, the variability criteria herein are
2219
recommended but are not required, and their use (or the use of
2220
alternative variability criteria) may depend upon the intended uses
2221
of the test results and the requirements of any applicable data
2222
quality objectives and quality assurance plan.
2223
2224
2225
2226
2227
10.2.8.2.1
2228
To measure test variability, calculate the percent
2229
minimum significant difference (PMSD) achieved in the test. The
2230
PMSD is the smallest percentage decrease in growth or reproduction
2231
from the control that could be determined as statistically
2232
significant in the test. The PMSD is calculated as 100 times the
2233
minimum significant difference (MSD) divided by the control mean.
2234
The equation and examples of MSD calculations are shown in Appendix
2235
C. PMSD may be calculated legitimately as a descriptive statistic
2236
for within-test variability, even when the hypothesis test is
2237
conducted using a non-parametric method. The PMSD bounds were based
2238
on a representative set of tests, including tests for which a
2239
non-parametric method was required for determining the NOEC or
2240
LOEC. The conduct of hypothesis testing to determine test results
2241
should follow the statistical flow charts provided for each method.
2242
That is, when test data fail to meet assumptions of normality or
2243
heterogeneity of variance, a nonparametric method (determined
2244
following the statistical flowchart for the method) should be used
2245
to calculate test results, but the PMSD may be calculated as
2246
described above (using parametric methods) to provide a measure of
2247
test variability.
2248
2249
2250
10.2.8.2.2
2251
Compare the PMSD measured in the test with the upper PMSD
2252
bound variability criterion listed in Table 6. When the test PMSD
2253
exceeds the upper bound, the variability among replicates is
2254
unusually large for the test method. Such a test should be
2255
considered insufficiently sensitive to detect toxic effects on
2256
growth or reproduction of substantial magnitude. A finding of
2257
toxicity at a particular concentration may be regarded as
2258
trustworthy, but a finding of "no toxicity" or "no statistically
2259
significant toxicity" at a particular concentration should not be
2260
regarded as a reliable indication that there is no substantial
2261
toxic effect on growth or reproduction at that
2262
concentration.
2263
2264
2265
10.2.8.2.3
2266
If the PMSD measured for the test is less than or equal
2267
to the upper PMSD bound variability criterion in Table 6, then the
2268
test's variability measure lies within normal bounds and the effect
2269
concentration estimate (e.g., NOEC or LOEC) would normally be
2270
accepted unless other test review steps raise serious doubts about
2271
its validity.
2272
2273
2274
10.2.8.2.4
2275
If the PMSD measured for the test exceeds the upper PMSD
2276
bound variability criterion in Table 6, then one of the following
2277
two cases applies (10.2.8.2.4.1, 10.2.8.2.4.2).
2278
2279
2280
2281
2282
10.2.8.2.4.1
2283
If toxicity is found at the permitted receiving water
2284
concentration (RWC) based upon the value of the effect
2285
concentration estimate (NOEC or LOEC), then the test shall be
2286
accepted and the effect concentration estimate may be reported,
2287
unless other test review steps raise serious doubts about its
2288
validity.
2289
2290
2291
10.2.8.2.4.2
2292
If toxicity is not found at the permitted RWC based upon
2293
the value of the effect concentration estimate (NOEC or LOEC) and
2294
the PMSD measured for the test exceeds the upper PMSD bound, then
2295
the test shall not be accepted, and a new test must be conducted
2296
promptly on a newly collected sample.
2297
2298
2299
10.2.8.2.5
2300
To avoid penalizing laboratories that achieve unusually
2301
high precision, lower PMSD bounds shall also be applied when a
2302
hypothesis test result (e.g., NOEC or LOEC) is reported. Lower PMSD
2303
bounds, which are based on the 10th percentiles of national PMSD
2304
data, are presented in Table 6. The 10th percentile PMSD represents
2305
a practical limit to the sensitivity of the test method because few
2306
laboratories are able to achieve such precision on a
2307
2308
2309
regular basis and most do not achieve it even occasionally. In
2310
determining hypothesis test results (e.g., NOEC or LOEC), a test
2311
concentration shall not be considered toxic (i.e., significantly
2312
different from the control) if the relative difference from the
2313
control is less than the lower PMSD bounds in Table 6. See USEPA,
2314
2000b for specific examples of implementing lower PMSD bounds.
2315
10.2.8.3 To assist in reviewing within-test variability, EPA
2316
recommends maintaining control charts of PMSDs calculated for
2317
successive effluent tests (USEPA, 2000b). A control chart of PMSD
2318
values characterizes the range of variability observed within a
2319
given laboratory, and allows comparison of individual test PMSDs
2320
with the laboratory's typical range of variability. Control charts
2321
of other variability and test performance measures, such as the
2322
MSD, standard deviation or CV of control responses, or average
2323
control response, also may be useful for reviewing tests and
2324
minimizing variability. The log of PMSD will provide an
2325
approximately normal variate useful for control charting.
2326
TABLE 6. VARIABILITY CRITERIA (UPPER AND LOWER PMSD BOUNDS) FOR
2327
SUBLETHAL HYPOTHESIS TESTING ENDPOINTS SUBMITTED UNDER NPDES
2328
PERMITS.1
2329
2330
1 Lower and upper PMSD bounds were determined from the 10th and
2331
90th percentile, respectively, of PMSD data from EPA's WET
2332
Interlaboratory Variability Study (USEPA, 2001a; USEPA, 2001b).
2333
2334
2335
2336
2337
2338