aboutsummaryrefslogtreecommitdiff
path: root/data/nist/Kirby2.dat
blob: 04df17679fd30b38c9a47f8fb59760f6ae92f44a (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
NIST/ITL StRD
Dataset Name:  Kirby2            (Kirby2.dat)

File Format:   ASCII
               Starting Values   (lines 41 to  45)
               Certified Values  (lines 41 to  50)
               Data              (lines 61 to 211)

Procedure:     Nonlinear Least Squares Regression

Description:   These data are the result of a NIST study involving
               scanning electron microscope line with standards.


Reference:     Kirby, R., NIST (197?).  
               Scanning electron microscope line width standards.








Data:          1 Response  (y)
               1 Predictor (x)
               151 Observations
               Average Level of Difficulty
               Observed Data

Model:         Rational Class (quadratic/quadratic)
               5 Parameters (b1 to b5)

               y = (b1 + b2*x + b3*x**2) /
                   (1 + b4*x + b5*x**2)  +  e

 
          Starting values                  Certified Values
 
        Start 1     Start 2           Parameter     Standard Deviation
  b1 =    2           1.5          1.6745063063E+00  8.7989634338E-02
  b2 =   -0.1        -0.15        -1.3927397867E-01  4.1182041386E-03
  b3 =    0.003       0.0025       2.5961181191E-03  4.1856520458E-05
  b4 =   -0.001      -0.0015      -1.7241811870E-03  5.8931897355E-05
  b5 =    0.00001     0.00002      2.1664802578E-05  2.0129761919E-07

Residual Sum of Squares:                    3.9050739624E+00
Residual Standard Deviation:                1.6354535131E-01
Degrees of Freedom:                               146
Number of Observations:                           151









Data:   y             x
       0.0082E0      9.65E0
       0.0112E0     10.74E0
       0.0149E0     11.81E0
       0.0198E0     12.88E0
       0.0248E0     14.06E0
       0.0324E0     15.28E0
       0.0420E0     16.63E0
       0.0549E0     18.19E0
       0.0719E0     19.88E0
       0.0963E0     21.84E0
       0.1291E0     24.00E0
       0.1710E0     26.25E0
       0.2314E0     28.86E0
       0.3227E0     31.85E0
       0.4809E0     35.79E0
       0.7084E0     40.18E0
       1.0220E0     44.74E0
       1.4580E0     49.53E0
       1.9520E0     53.94E0
       2.5410E0     58.29E0
       3.2230E0     62.63E0
       3.9990E0     67.03E0
       4.8520E0     71.25E0
       5.7320E0     75.22E0
       6.7270E0     79.33E0
       7.8350E0     83.56E0
       9.0250E0     87.75E0
      10.2670E0     91.93E0
      11.5780E0     96.10E0
      12.9440E0    100.28E0
      14.3770E0    104.46E0
      15.8560E0    108.66E0
      17.3310E0    112.71E0
      18.8850E0    116.88E0
      20.5750E0    121.33E0
      22.3200E0    125.79E0
      22.3030E0    125.79E0
      23.4600E0    128.74E0
      24.0600E0    130.27E0
      25.2720E0    133.33E0
      25.8530E0    134.79E0
      27.1100E0    137.93E0
      27.6580E0    139.33E0
      28.9240E0    142.46E0
      29.5110E0    143.90E0
      30.7100E0    146.91E0
      31.3500E0    148.51E0
      32.5200E0    151.41E0
      33.2300E0    153.17E0
      34.3300E0    155.97E0
      35.0600E0    157.76E0
      36.1700E0    160.56E0
      36.8400E0    162.30E0
      38.0100E0    165.21E0
      38.6700E0    166.90E0
      39.8700E0    169.92E0
      40.0300E0    170.32E0
      40.5000E0    171.54E0
      41.3700E0    173.79E0
      41.6700E0    174.57E0
      42.3100E0    176.25E0
      42.7300E0    177.34E0
      43.4600E0    179.19E0
      44.1400E0    181.02E0
      44.5500E0    182.08E0
      45.2200E0    183.88E0
      45.9200E0    185.75E0
      46.3000E0    186.80E0
      47.0000E0    188.63E0
      47.6800E0    190.45E0
      48.0600E0    191.48E0
      48.7400E0    193.35E0
      49.4100E0    195.22E0
      49.7600E0    196.23E0
      50.4300E0    198.05E0
      51.1100E0    199.97E0
      51.5000E0    201.06E0
      52.1200E0    202.83E0
      52.7600E0    204.69E0
      53.1800E0    205.86E0
      53.7800E0    207.58E0
      54.4600E0    209.50E0
      54.8300E0    210.65E0
      55.4000E0    212.33E0
      56.4300E0    215.43E0
      57.0300E0    217.16E0
      58.0000E0    220.21E0
      58.6100E0    221.98E0
      59.5800E0    225.06E0
      60.1100E0    226.79E0
      61.1000E0    229.92E0
      61.6500E0    231.69E0
      62.5900E0    234.77E0
      63.1200E0    236.60E0
      64.0300E0    239.63E0
      64.6200E0    241.50E0
      65.4900E0    244.48E0
      66.0300E0    246.40E0
      66.8900E0    249.35E0
      67.4200E0    251.32E0
      68.2300E0    254.22E0
      68.7700E0    256.24E0
      69.5900E0    259.11E0
      70.1100E0    261.18E0
      70.8600E0    264.02E0
      71.4300E0    266.13E0
      72.1600E0    268.94E0
      72.7000E0    271.09E0
      73.4000E0    273.87E0
      73.9300E0    276.08E0
      74.6000E0    278.83E0
      75.1600E0    281.08E0
      75.8200E0    283.81E0
      76.3400E0    286.11E0
      76.9800E0    288.81E0
      77.4800E0    291.08E0
      78.0800E0    293.75E0
      78.6000E0    295.99E0
      79.1700E0    298.64E0
      79.6200E0    300.84E0
      79.8800E0    302.02E0
      80.1900E0    303.48E0
      80.6600E0    305.65E0
      81.2200E0    308.27E0
      81.6600E0    310.41E0
      82.1600E0    313.01E0
      82.5900E0    315.12E0
      83.1400E0    317.71E0
      83.5000E0    319.79E0
      84.0000E0    322.36E0
      84.4000E0    324.42E0
      84.8900E0    326.98E0
      85.2600E0    329.01E0
      85.7400E0    331.56E0
      86.0700E0    333.56E0
      86.5400E0    336.10E0
      86.8900E0    338.08E0
      87.3200E0    340.60E0
      87.6500E0    342.57E0
      88.1000E0    345.08E0
      88.4300E0    347.02E0
      88.8300E0    349.52E0
      89.1200E0    351.44E0
      89.5400E0    353.93E0
      89.8500E0    355.83E0
      90.2500E0    358.32E0
      90.5500E0    360.20E0
      90.9300E0    362.67E0
      91.2000E0    364.53E0
      91.5500E0    367.00E0
      92.2000E0    371.30E0