Squid server optimizing information:

Statistics from Sat Mar 8 01:44:11 2003 to Fri Mar 14 15:06:39 2003

Squeezer is a tool for gathering different statistical information from Squid web cache server to tune it fine. The tool is destined basically for web cache operators, but can be obtained and used for any other purpose. The software has been written in PERL and as Squid itself and PERL - it's free. But you use it at your own risk! There are several sections that are disabled by default but can be enabled by editing the script and enabling them. The problems with having them all enabled are: it slows the processing WAY down, and it makes this report very large. If you don't use siblings, there are also a few sections that can be disabled by editing the script, these are "Sibling efficiency" and "By Peer Status"

General:

All values given to you by squeezer are related to the period, limited by the times described here.
Start Date Sat Mar 8 01:44:11 2003
End DateFri Mar 14 15:06:39 2003
Total Time (hh:mm:ss)157:22:28.773
kBytes Per Hour
Cached kBytes/Hour19,204.94
Direct kBytes/Hour164,892.16
Total kBytes/Hour184,097.11
Reqs Per Hour
Cached Reqs/Hour6,762.47
Direct Reqs/Hour24,371.46
Total Reqs/Hour31,133.93
Average Object Size
Average Cached Object Size 2.84 kbytes
Average Direct Object Size 6.77 kbytes
Average Object Size 5.91 kbytes
Other
Hit Rate21.72%
Bandwidth Savings Total3,022,371.45 kbytes
Bandwidth Savings Percent10.43%
Average Speed Increase 3.14%

Output and it's interpretation:

The output contains several profiles of information with several different positions (categories) in each. Each category is characterized with several values which are described below:

Cache Statistics:

This is an overview of the cache, it shows whether it is doing you any good to have this server running.
  Requests kBytes B/s kB % kB Graph kB Times
to Direct
kB Times
Graph
Cached_Local 1,060,668 2,998,681.41 5,496.48 10.35 |||||||||| 1.42 |||||||||||||||||||||||||||||||||||
Cached_Other 3,574 23,690.04 3,248.51 0.08 0.84 ||||||||||||||||||||
Cached_Total 1,064,242 3,022,371.45 5,466.83 10.43 |||||||||| 1.41 |||||||||||||||||||||||||||||||||||
Direct 3,835,450 25,949,848.06 3,869.02 89.57 ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 1.00 |||||||||||||||||||||||||
Total 4,899,692 28,972,219.51 3,990.69 100.00 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 1.03 |||||||||||||||||||||||||

Total Requests:

This table is the total of all requests served by this caching server.
  Cached
Requests
Cached
Req/s
Cached
% of Reqs
Cached
Reqs Graph
  Requests Req/s Req % Req Graph   Cached
Bytes
Cached
B/s
Cached
% of B
Cached
Bytes Graph
  kBytes B/s kB % kB Graph   Time Time % Time Graph   Largest Cached Item Largest Item
Total 1,064,242 1.88 21.72 ||||||||||||||||||||| Total 4,899,692 0.66 100.00 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| Total 3,022,371.45 5,466.83 10.43 |||||||||| Total 28,972,219.51 3,990.69 100.00 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| Total 2065:03:05.790 100.00 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| Total 15,621,830 60,119,885

By Caching Server:

This shows how many requests were served for each caching server.
  Requests Req/s Req % Req Graph   kBytes B/s kB % kB Graph   Time Time % Time Graph   Largest Cached Item Largest Item
Direct 3,835,450 0.56 78.28 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| Direct 25,949,848.06 3,869.02 89.57 ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| Direct 1907:47:40.811 92.38 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| Direct 60,119,885
Total 1,064,242 1.88 21.72 ||||||||||||||||||||| Total 3,022,371.45 5,466.83 10.43 |||||||||| Total 157:15:24.979 7.62 ||||||| Total 15,621,830 15,621,830
Local 1,060,668 1.90 21.65 ||||||||||||||||||||| Local 2,998,681.41 5,496.48 10.35 |||||||||| Local 155:10:57.368 7.51 ||||||| Local 15,621,830 15,621,830
rrlhccrq1001.lhc.redrivernet.com 3,574 0.48 0.07 rrlhccrq1001.lhc.redrivernet.com 23,690.04 3,248.51 0.08 rrlhccrq1001.lhc.redrivernet.com 02:04:27.611 0.10 rrlhccrq1001.lhc.redrivernet.com 2,099,284 2,099,284
Remote 3,574 0.48 0.07 Remote 23,690.04 3,248.51 0.08 Remote 02:04:27.611 0.10 Remote 2,099,284 2,099,284

By Peer Status:

The basic stuff showing you advantages/disadvantages of using parent and sibling relationship. Use with caution! Remember that your parents and siblings could be available via lines of different speed and quality. Using those aggregates for analysis may cause false conclusions.
The strong point of this stuff is opportunity to compare cache digests versus ICP, if there are siblings communicating both ways in similar environment.
No idea how to use that more:( Any suggestions?
  Requests Req/s Req % Req Graph   kBytes B/s kB % kB Graph   Time Time % Time Graph   Largest Cached Item Largest Item
DIRECT 3,001,772 0.60 61.26 ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| DIRECT 18,971,006.43 3,885.38 65.48 ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| DIRECT 1388:50:54.561 67.25 ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| DIRECT 14,466,465 59,770,629
TIMEOUT_DIRECT 998,227 0.80 20.37 |||||||||||||||||||| TIMEOUT_DIRECT 8,081,244.02 6,662.64 27.89 ||||||||||||||||||||||||||| TIMEOUT_DIRECT 345:00:29.299 16.71 |||||||||||||||| TIMEOUT_DIRECT 60,119,885
NONE 894,157 0.87 18.25 |||||||||||||||||| NONE 1,894,077.68 1,880.83 6.54 |||||| NONE 286:26:50.484 13.87 ||||||||||||| NONE 15,621,830 15,621,830
SIBLING_HIT 3,574 0.48 0.07 SIBLING_HIT 23,690.04 3,248.51 0.08 SIBLING_HIT 02:04:27.611 0.10 SIBLING_HIT 2,099,284 2,099,284
TIMEOUT_NONE 1,962 0.01 0.04 TIMEOUT_NONE 2,201.34 14.67 0.01 TIMEOUT_NONE 42:40:23.835 2.07 || TIMEOUT_NONE 1,765

By cache result codes:

This table shows the characteristics for different cache result codes. The only useful information I have found is the difference between TCP_MEM_HIT (which are objects fetched from squid's RAM buffer) against TCP_HIT (which are fetched from disk buffer). Low value for TCP_HIT displays the need for dedicate more RAM for Squid and/or rearranging the cache_dir layout - spreading several cache directories over several disk/controllers or any further disk performance improvement.
  Requests Req/s Req % Req Graph   kBytes B/s kB % kB Graph   Time Time % Time Graph   Largest Cached Item Largest Item
TCP_MISS 3,107,724 0.48 63.43 ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| TCP_MISS 24,394,790.03 3,829.92 84.20 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| TCP_MISS 1811:46:35.724 87.74 ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| TCP_MISS 2,099,284 60,119,885
TCP_HIT 241,787 0.86 4.93 |||| TCP_HIT 1,591,286.10 5,764.31 5.49 ||||| TCP_HIT 78:31:23.780 3.80 ||| TCP_HIT 15,621,830 15,621,830
TCP_REFRESH_HIT 691,871 1.69 14.12 |||||||||||||| TCP_REFRESH_HIT 1,239,410.71 3,100.20 4.28 |||| TCP_REFRESH_HIT 113:42:59.249 5.51 ||||| TCP_REFRESH_HIT 14,466,465 14,466,465
TCP_CLIENT_REFRESH_MISS 128,210 0.96 2.62 || TCP_CLIENT_REFRESH_MISS 767,955.28 5,885.54 2.65 || TCP_CLIENT_REFRESH_MISS 37:06:53.332 1.80 | TCP_CLIENT_REFRESH_MISS 5,353,285
TCP_REFRESH_MISS 85,205 1.22 1.74 | TCP_REFRESH_MISS 684,604.36 10,018.59 2.36 || TCP_REFRESH_MISS 19:26:13.385 0.94 TCP_REFRESH_MISS 3,470,662
TCP_IMS_HIT 587,584 38.52 11.99 ||||||||||| TCP_IMS_HIT 175,414.18 11,775.77 0.61 TCP_IMS_HIT 04:14:13.705 0.21 TCP_IMS_HIT 415,475 415,475
TCP_MEM_HIT 50,174 153.23 1.02 | TCP_MEM_HIT 97,558.24 305,085.52 0.34 TCP_MEM_HIT 00:05:27.448 0.00 TCP_MEM_HIT 17,631 17,631
TCP_NEGATIVE_HIT 6,069 28.35 0.12 TCP_NEGATIVE_HIT 18,758.33 89,738.50 0.06 TCP_NEGATIVE_HIT 00:03:34.500 0.00 TCP_NEGATIVE_HIT 55,658 55,658
TCP_SWAPFAIL_MISS 1,068 3.09 0.02 TCP_SWAPFAIL_MISS 2,442.28 7,246.51 0.01 TCP_SWAPFAIL_MISS 00:05:45.117 0.00 TCP_SWAPFAIL_MISS 10,172 89,205

By hours:

This shows cache statistics by hour of day. This is in the local time zone for the log file.
  Cached
Requests
Cached
Req/s
Cached
% of Reqs
Cached
Reqs Graph
  Requests Req/s Req % Req Graph   Cached
Bytes
Cached
B/s
Cached
% of B
Cached
Bytes Graph
  kBytes B/s kB % kB Graph   Time Time % Time Graph   Largest Cached Item Largest Item
1 14,428 2.75 20.46 |||||||||||||||||||| 1 70,510 0.61 1.44 | 1 55,885.44 10,889.99 10.53 |||||||||| 1 530,630.92 4,686.39 1.83 | 1 32:12:25.490 1.56 | 1 10,452,056 47,050,711
2 12,675 1.00 21.70 ||||||||||||||||||||| 2 58,406 0.70 1.19 | 2 44,876.82 3,625.13 12.08 |||||||||||| 2 371,427.54 4,575.42 1.28 | 2 23:05:27.103 1.12 | 2 576,021 13,156,713
3 7,948 2.17 17.95 ||||||||||||||||| 3 44,268 0.54 0.90 3 28,992.19 8,088.56 10.34 |||||||||| 3 280,325.90 3,479.24 0.97 3 22:55:04.713 1.11 | 3 741,207 14,842,190
4 6,825 3.66 13.76 ||||||||||||| 4 49,596 0.80 1.01 | 4 18,525.17 10,170.58 5.40 ||||| 4 343,333.28 5,655.12 1.19 | 4 17:16:09.560 0.84 4 462,365 6,996,980
5 14,226 1.74 16.05 |||||||||||||||| 5 88,610 0.94 1.81 | 5 46,473.96 5,811.62 8.38 |||||||| 5 554,506.38 5,993.58 1.91 | 5 26:18:57.197 1.27 | 5 1,755,979 8,363,654
6 30,244 0.90 19.21 ||||||||||||||||||| 6 157,413 0.84 3.21 ||| 6 78,010.20 2,384.99 8.72 |||||||| 6 895,084.79 4,901.07 3.09 ||| 6 51:56:53.539 2.52 || 6 1,540,625 8,465,746
7 44,529 1.52 20.33 |||||||||||||||||||| 7 219,038 0.71 4.47 |||| 7 113,062.21 3,939.50 9.39 ||||||||| 7 1,204,135.73 3,972.31 4.16 |||| 7 86:13:27.677 4.18 |||| 7 1,974,188 15,332,123
8 53,868 2.25 21.30 ||||||||||||||||||||| 8 252,847 0.62 5.16 ||||| 8 145,415.66 6,233.24 10.22 |||||||||| 8 1,423,544.60 3,546.53 4.91 |||| 8 114:10:24.445 5.53 ||||| 8 2,692,883 7,299,158
9 59,159 1.60 20.99 |||||||||||||||||||| 9 281,816 0.57 5.75 ||||| 9 174,284.68 4,836.60 10.35 |||||||||| 9 1,683,872.98 3,501.53 5.81 ||||| 9 136:47:18.251 6.62 |||||| 9 10,136,051 59,770,629
10 69,281 1.84 23.83 ||||||||||||||||||||||| 10 290,714 0.66 5.93 ||||| 10 171,920.01 4,670.18 10.70 |||||||||| 10 1,607,031.42 3,713.63 5.55 ||||| 10 123:05:24.605 5.96 ||||| 10 5,351,594 18,331,289
11 61,392 2.57 22.15 |||||||||||||||||||||| 11 277,149 0.68 5.66 ||||| 11 174,643.71 7,476.23 10.97 |||||||||| 11 1,591,298.21 3,972.14 5.49 ||||| 11 113:57:09.198 5.52 ||||| 11 13,951,452 15,303,432
12 48,616 1.39 21.37 ||||||||||||||||||||| 12 227,475 0.57 4.64 |||| 12 137,406.42 4,032.42 10.37 |||||||||| 12 1,324,645.18 3,386.79 4.57 |||| 12 111:15:07.671 5.39 ||||| 12 5,351,595 21,823,889
13 62,583 2.31 23.74 ||||||||||||||||||||||| 13 263,628 0.58 5.38 ||||| 13 168,852.67 6,379.67 11.23 ||||||||||| 13 1,502,932.12 3,362.56 5.19 ||||| 13 127:08:08.199 6.16 |||||| 13 5,917,738 21,000,278
14 64,321 3.02 22.50 |||||||||||||||||||||| 14 285,910 0.68 5.84 ||||| 14 171,815.60 8,253.71 10.20 |||||||||| 14 1,685,188.39 4,117.32 5.82 ||||| 14 116:25:15.940 5.64 ||||| 14 2,099,154 42,315,182
15 50,506 2.02 19.89 ||||||||||||||||||| 15 253,898 0.59 5.18 ||||| 15 154,407.96 6,311.56 10.90 |||||||||| 15 1,416,678.86 3,343.20 4.89 |||| 15 120:31:59.502 5.84 ||||| 15 5,351,594 9,040,611
16 51,180 1.49 20.25 |||||||||||||||||||| 16 252,700 0.70 5.16 ||||| 16 166,788.71 4,988.58 10.88 |||||||||| 16 1,533,646.48 4,347.53 5.29 ||||| 16 100:20:29.232 4.86 |||| 16 14,466,465 16,191,327
17 49,105 1.53 20.48 |||||||||||||||||||| 17 239,737 0.78 4.89 |||| 17 161,168.96 5,151.11 11.75 ||||||||||| 17 1,371,496.26 4,587.34 4.73 |||| 17 85:02:29.296 4.12 |||| 17 8,839,468 14,069,650
18 55,764 2.26 22.70 |||||||||||||||||||||| 18 245,645 0.79 5.01 ||||| 18 144,821.05 6,013.24 10.27 |||||||||| 18 1,410,475.07 4,656.06 4.87 |||| 18 86:10:03.295 4.17 |||| 18 2,500,458 35,538,941
19 59,181 1.95 22.79 |||||||||||||||||||||| 19 259,709 0.70 5.30 ||||| 19 146,446.80 4,938.56 10.01 |||||||||| 19 1,462,580.82 4,040.58 5.05 ||||| 19 102:57:40.401 4.99 |||| 19 1,845,219 17,764,242
20 74,071 2.12 25.30 ||||||||||||||||||||||||| 20 292,741 0.62 5.97 ||||| 20 214,825.45 6,303.24 12.81 |||||||||||| 20 1,676,568.30 3,634.91 5.79 ||||| 20 131:11:50.104 6.35 |||||| 20 15,621,830 60,119,885
21 66,836 2.66 23.72 ||||||||||||||||||||||| 21 281,827 0.59 5.75 ||||| 21 173,330.05 7,055.60 9.99 ||||||||| 21 1,734,178.10 3,722.64 5.99 ||||| 21 132:30:26.632 6.42 |||||| 21 10,136,052 18,539,334
22 51,781 2.62 21.37 ||||||||||||||||||||| 22 242,360 0.72 4.95 |||| 22 144,174.88 7,457.56 9.82 ||||||||| 22 1,467,615.53 4,489.88 5.07 ||||| 22 92:58:36.539 4.50 |||| 22 8,365,553 27,361,589
23 34,919 1.74 20.94 |||||||||||||||||||| 23 166,793 0.67 3.40 ||| 23 131,226.68 6,679.39 10.93 |||||||||| 23 1,200,421.30 4,914.19 4.14 |||| 23 69:28:58.955 3.36 ||| 23 13,737,020 48,514,830

By size of request:

This shows cache statistics by size of request in bytes.
  Cached
Requests
Cached
Req/s
Cached
% of Reqs
Cached
Reqs Graph
  Requests Req/s Req % Req Graph   Cached
Bytes
Cached
B/s
Cached
% of B
Cached
Bytes Graph
  kBytes B/s kB % kB Graph   Time Time % Time Graph   Largest Cached Item Largest Item
100 0 0.00 0.00 100 1,522 0.01 0.03 100 0.00 0.00 0.00 100 61.32 0.28 0.00 100 61:34:44.918 2.98 || 100 97
1,000 746,083 14.27 31.05 ||||||||||||||||||||||||||||||| 1,000 2,402,784 2.60 49.04 ||||||||||||||||||||||||||||||||||||||||||||||||| 1,000 232,580.02 4,555.33 26.66 |||||||||||||||||||||||||| 1,000 872,274.60 965.78 3.01 ||| 1,000 256:54:17.803 12.44 |||||||||||| 1,000 999 999
10,000 255,480 2.24 13.14 ||||||||||||| 10,000 1,944,715 0.81 39.69 ||||||||||||||||||||||||||||||||||||||| 10,000 852,333.74 7,639.04 12.22 |||||||||||| 10,000 6,975,797.54 2,993.39 24.08 |||||||||||||||||||||||| 10,000 662:52:07.443 32.10 |||||||||||||||||||||||||||||||| 10,000 9,999 9,999
100,000 60,553 0.27 11.57 ||||||||||| 100,000 523,340 0.33 10.68 |||||||||| 100,000 1,232,963.21 5,618.49 9.32 ||||||||| 100,000 13,228,664.06 8,619.43 45.66 ||||||||||||||||||||||||||||||||||||||||||||| 100,000 436:33:02.603 21.14 ||||||||||||||||||||| 100,000 99,942 99,998
1,000,000 1,894 0.02 9.54 ||||||||| 1,000,000 19,859 0.02 0.41 1,000,000 363,790.16 3,995.19 8.85 |||||||| 1,000,000 4,108,307.73 4,325.21 14.18 |||||||||||||| 1,000,000 270:10:48.822 13.08 ||||||||||||| 1,000,000 978,914 999,888
10,000,000 108 0.00 9.72 ||||||||| 10,000,000 1,111 0.00 0.02 10,000,000 241,054.55 4,212.46 8.97 |||||||| 10,000,000 2,688,741.73 3,033.84 9.28 ||||||||| 10,000,000 252:05:20.970 12.21 |||||||||||| 10,000,000 8,839,468 9,563,214
100,000,000 8 0.00 12.50 |||||||||||| 100,000,000 64 0.00 0.00 100,000,000 99,649.77 4,434.00 9.07 ||||||||| 100,000,000 1,098,372.53 3,717.11 3.79 ||| 100,000,000 84:03:02.853 4.07 |||| 100,000,000 15,621,830 60,119,885

Sibling efficiency:

This table shows you the characteristics of the fetches from individual cooperating web cache servers. This one will help you to properly set up sibling relationships. The servers are sorted by the amount of transfer - the effective siblings/parents are higher in the table. Remember about some rules
  Options Requests Req/s Req % Req Graph   kBytes B/s kB % kB Graph   Time Time % Time Graph   Largest Cached Item Largest Item
Total   899,693 0.75 18.36 |||||||||||||||||| Total 1,919,969.06 1,648.95 6.63 |||||| Total 331:11:41.930 16.04 |||||||||||||||| Total 15,621,830 15,621,830
- 896,119 0.76 18.29 |||||||||||||||||| - 1,896,279.02 1,638.87 6.55 |||||| - 329:07:14.319 15.94 ||||||||||||||| - 15,621,830 15,621,830
rrlhccrq1001.lhc.redrivernet.com sibling 3,574 0.48 0.07 rrlhccrq1001.lhc.redrivernet.com 23,690.04 3,248.51 0.08 rrlhccrq1001.lhc.redrivernet.com 02:04:27.611 0.10 rrlhccrq1001.lhc.redrivernet.com 2,099,284 2,099,284

Squeezer Performance:

User time 1273.78 s
System time 8.39 s
Children time 0.00 s
Children system time 0.00 s
Together1282.17 s
Lines Processed 4,899,692
Speed 3,821 lines/s



running on OpenBSD rrlhccsh1001.lhc.redrivernet.com 3.2 SQUID#0 i386



squeezer2.pl v. 0.5 by M.K. Rewrite by andrew fresh,  last modified: Fri Mar 14 14:05:45 2003

Tutorial on using squeezer generated data