YALSP - Yet Another Log Statistical Program.

YALSP - Yet Another Log Statistical Program.
Version 1.3
Compatible with Squid 2.x log file

By Andrea Marangoni
Freeware

Log file status
First record	Mon Sep 11 00:15:25 2000
Last record	Fri Sep 15 12:57:22 2000
Days	5
Line parsed	1110335
Total error found	109
Invalid line	15
Invalid URL	93
URL too long	1

Statistics for HTTP Methods
METHOD	REQS	%	REQS SAVED	%	Kilo BYTES	%	Kilo BYTES SAVED	%
GET	1084030	97.64%	590521	54.47%	5206335	96.65%	1639708	31.49%
HEAD	1654	0.15%	1043	63.06%	476	0.01%	314	65.99%
POST	24493	2.21%	0	0.00%	179998	3.34%	0	0.00%
OPTIONS	32	0.00%	0	0.00%	11	0.00%	0	0.00%
PROPFIND	16	0.00%	0	0.00%	24	0.00%	0	0.00%
OTHER	1	0.00%	0	0.00%	0	0.00%	0	0.00%
TOTAL	1110226	100%	591564	53.28%	5260 MB	100%	1601 MB	30.44%

Statistics for Result Codes
RESULT CODES	REQS	%	REQS SAVED	%	Kilo BYTES	%	Kilo BYTES SAVED	%
TCP_MEM_HIT	97719	8.80%	97719	100.00%	170413	3.16%	170413	100.00%
TCP_HIT	236147	21.27%	236147	100.00%	1037993	19.27%	1037993	100.00%
TCP_REFRESH_HIT	97288	8.76%	97288	100.00%	386048	7.17%	386048	100.00%
TCP_IMS_HIT	151504	13.65%	151504	100.00%	39114	0.73%	39114	100.00%
TCP_NEGATIVE_HIT	8906	0.80%	8906	100.00%	6451	0.12%	6451	100.00%
TCP_MISS	477602	43.02%	0	0.00%	3598113	66.79%	0	0.00%
TCP_REFRESH_MISS	14319	1.29%	0	0.00%	104982	1.95%	0	0.00%
NONE	26741	2.41%	0	0.00%	43729	0.81%	0	0.00%
TOTAL	1110226	100%	591564	53.28%	5260 MB	100%	1601 MB	30.44%

Statistics for Hierarchy Codes
HIERARCHY CODES	REQS	%	REQS SAVED	%	Kilo BYTES	%	Kilo BYTES SAVED	%
DIRECT	589197	53.07%	97288	16.51%	4088888	75.91%	386048	9.44%
NONE	494322	44.52%	494276	99.99%	1254028	23.28%	1253973	100.00%
OTHER	26707	2.41%	0	0.00%	43930	0.82%	0	0.00%
TOTAL	1110226	100%	591564	53.28%	5260 MB	100%	1601 MB	30.44%

Explanation of the last line, the most important, that may be equal in all table.
REQS:
    In this zone is reported the request that squid processed.
        Reqs: Obvious the total request.
        %: Always 100%
        Reqs Saved: This is the number of request saved by Squid.
        Cache Hit (or only %): This is the % of request saved over the total.
        Cache Miss & Cache Other (if enabled): The sum must be the difference between 100% and Cache hit.

BYTES
    In this zone is reported the bytes that squid processed.
        Bytes: Obvious the total bytes.
        %: Always 100%
        Bytes Saved: This is the number of bytes saved by Squid.
        Cache Hit (or only %): This is the % of bytes saved over the total.
        Cache Miss & Cache Other (if enabled): The sum must be the difference between 100% and Cache hit.

Host Statistics

Statistics for FIRST Level Domain Visited
TOP 10
DESTINATION DOMAIN	REQS	%	REQS SAVED	%	Kilo BYTES	%	Kilo BYTES SAVED	%
it	538315	48.49%	345401	64.16%	2288543	42.48%	838347	36.63%
com	372177	33.52%	158741	42.65%	2128232	39.51%	505975	23.77%
net	115299	10.39%	46129	40.01%	389697	7.23%	183676	47.13%
NOT RESOLVED	31248	2.81%	20388	65.25%	165024	3.06%	46947	28.45%
org	10029	0.90%	3909	38.98%	72129	1.34%	15556	21.57%
jp	1508	0.14%	381	25.27%	55273	1.03%	2281	4.13%
ca	410	0.04%	19	4.63%	46905	0.87%	38	0.08%
fr	5430	0.49%	2338	43.06%	44854	0.83%	7789	17.37%
de	8936	0.80%	3110	34.80%	38002	0.71%	6499	17.10%
se	1622	0.15%	723	44.57%	23261	0.43%	2631	11.31%
OTHER	25252	2.27%	10425	41.28%	134924	2.50%	30278	22.44%
78 IN TOTAL	1110226	100%	591564	53.28%	5260 MB	100%	1601 MB	30.44%

Statistics for SECOND Level Domain Visited
TOP 10
DESTINATION DOMAIN	REQS	%	REQS SAVED	%	Kilo BYTES	%	Kilo BYTES SAVED	%
kataweb.it	82049	7.39%	44253	53.93%	242313	4.50%	98077	40.48%
msn.com	24419	2.20%	5184	21.23%	210031	3.90%	30599	14.57%
iol.it	47397	4.27%	36684	77.40%	174751	3.24%	46554	26.64%
virgilio.it	34640	3.12%	20883	60.29%	162500	3.02%	24650	15.17%
yahoo.com	17787	1.60%	1448	8.14%	115722	2.15%	6999	6.05%
aol.com	2911	0.26%	1383	47.51%	114684	2.13%	5226	4.56%
jumpy.it	21227	1.91%	17821	83.95%	78438	1.46%	59264	75.56%
conxion.com	84	0.01%	33	39.29%	77349	1.44%	10807	13.97%
msn.it	14000	1.26%	11336	80.97%	71534	1.33%	19868	27.77%
doubleclick.net	29921	2.70%	7856	26.26%	68142	1.26%	44811	65.76%
OTHER	835791	75.28%	444683	53.21%	4071379	75.58%	1293161	31.76%
7080 IN TOTAL	1110226	100%	591564	53.28%	5260 MB	100%	1601 MB	30.44%

Statistics for Squid Clients
TOP 10
CLIENT HOST	REQS	%	REQS SAVED	%	Kilo BYTES	%	Kilo BYTES SAVED	%
10.1.2.30	219838	19.80%	119436	54.33%	1086228	20.16%	370760	34.13%
10.1.1.25	78016	7.03%	44259	56.73%	274298	5.09%	94545	34.47%
10.1.1.221	22354	2.01%	11937	53.40%	148476	2.76%	46796	31.52%
10.1.2.239	25544	2.30%	14702	57.56%	137639	2.56%	56387	40.97%
10.1.1.26	23741	2.14%	11779	49.61%	136614	2.54%	25861	18.93%
10.1.2.250	26785	2.41%	15340	57.27%	131151	2.43%	50937	38.84%
10.1.1.20	6242	0.56%	1882	30.15%	126632	2.35%	10505	8.30%
10.1.1.152	1934	0.17%	820	42.40%	117506	2.18%	6815	5.80%
10.1.2.249	23101	2.08%	12012	52.00%	115693	2.15%	38658	33.41%
10.1.1.226	20347	1.83%	11283	55.45%	99916	1.85%	34536	34.56%
OTHER	662324	59.66%	348114	52.56%	3012689	55.93%	904217	30.01%
309 IN TOTAL	1110226	100%	591564	53.28%	5260 MB	100%	1601 MB	30.44%

Statistics for Hosts Visited
TOP 10
DESTINATON HOST	REQS	%	REQS SAVED	%	Kilo BYTES	%	Kilo BYTES SAVED	%
members.aol.com	230	0.02%	52	22.61%	107536	2.00%	851	0.79%
www.kataweb.it	30094	2.71%	23497	78.08%	93203	1.73%	19310	20.72%
www.jumpy.it	17933	1.62%	16196	90.31%	68306	1.27%	52872	77.40%
admedia.kataweb.it	10501	0.95%	9863	93.92%	67307	1.25%	62425	92.75%
msvaus.www.conxion.com	32	0.00%	10	31.25%	64840	1.20%	5066	7.81%
www.repubblica.it	10529	0.95%	7843	74.49%	58848	1.09%	26374	44.82%
www.msn.it	11568	1.04%	9938	85.91%	54607	1.01%	17509	32.06%
www.virgilio.it	12268	1.11%	9023	73.55%	46648	0.87%	9495	20.36%
ilrestodelcarlino.monrif.net	8691	0.78%	5784	66.55%	46379	0.86%	10095	21.77%
java.beenz.com	11626	1.05%	8562	73.65%	44916	0.83%	43193	96.16%
OTHER	996754	89.78%	500796	50.24%	4734254	87.89%	1392826	29.42%
11207 IN TOTAL	1110226	100%	591564	53.28%	5260 MB	100%	1601 MB	30.44%

Major Host Visited
ONE visit mean ONE client that in ONE day traster more than **100** KBytes
TOP 20 visited.
CLIENT DESTINATION	# VISIT	IN # DAYS	BY # CLIENTS
www.kataweb.it	118	5	42
ilrestodelcarlino.monrif.net	114	5	45
www.repubblica.it	113	5	55
www.virgilio.it	110	5	55
admedia.kataweb.it	105	5	43
www.msn.it	100	5	45
adimg.activeadv.net	99	5	53
ad.it.doubleclick.net	80	5	42
channels.real.com	72	5	18
www.jumpy.it	72	5	34
m.doubleclick.net	59	5	40
www.geocities.com	59	5	34
libero.iol.it	59	5	33
mail.katamail.com	57	5	23
it.altavista.com	56	5	38
www.altavista.com	52	5	29
www.tiscalinet.it	50	5	26
ads.msn.com	50	5	19
opac.sbn.it	47	5	29
www.ilsole24ore.it	45	5	29
OTHER 3653 HOSTS	8583	5	6780

Visit my Home Page

Log file status

Statistics for HTTP Methods

METHOD

REQS

%

REQSSAVED

%

KiloBYTES

%

KiloBYTESSAVED

%

Statistics for Result Codes

RESULTCODES

REQS

%

REQSSAVED

%

KiloBYTES

%

KiloBYTESSAVED

%

Statistics for Hierarchy Codes

HIERARCHYCODES

REQS

%

REQSSAVED

%

KiloBYTES

%

KiloBYTESSAVED

%

Host Statistics

Statistics for FIRST Level Domain VisitedTOP 10

DESTINATIONDOMAIN

REQS

%

REQSSAVED

%

KiloBYTES

%

KiloBYTESSAVED

%

Statistics for SECOND Level Domain VisitedTOP 10

DESTINATIONDOMAIN

REQS

%

REQSSAVED

%

KiloBYTES

%

KiloBYTESSAVED

%

Statistics for Squid ClientsTOP 10

CLIENTHOST

REQS

%

REQSSAVED

%

KiloBYTES

%

KiloBYTESSAVED

%

Statistics for Hosts VisitedTOP 10

DESTINATONHOST

REQS

%

REQSSAVED

%

KiloBYTES

%

KiloBYTESSAVED

%

Major Host VisitedONE visit mean ONE client that in ONE day traster more than 100 KBytesTOP 20 visited.

CLIENTDESTINATION

# VISIT

IN # DAYS

BY # CLIENTS

REQS
SAVED

Kilo
BYTES

Kilo
BYTES
SAVED

RESULT
CODES

REQS
SAVED

Kilo
BYTES

Kilo
BYTES
SAVED

HIERARCHY
CODES

REQS
SAVED

Kilo
BYTES

Kilo
BYTES
SAVED

Statistics for FIRST Level Domain Visited
TOP 10

DESTINATION
DOMAIN

REQS
SAVED

Kilo
BYTES

Kilo
BYTES
SAVED

Statistics for SECOND Level Domain Visited
TOP 10

DESTINATION
DOMAIN

REQS
SAVED

Kilo
BYTES

Kilo
BYTES
SAVED

Statistics for Squid Clients
TOP 10

CLIENT
HOST

REQS
SAVED

Kilo
BYTES

Kilo
BYTES
SAVED

Statistics for Hosts Visited
TOP 10

DESTINATON
HOST

REQS
SAVED

Kilo
BYTES

Kilo
BYTES
SAVED

Major Host Visited
ONE visit mean ONE client that in ONE day traster more than 100 KBytes
TOP 20 visited.

CLIENT
DESTINATION