The process of recording diagnostic information, usually for the purposes of debugging and monitoring the status or "health" of various systems.
0
votes
1answer
55 views
Analyzing logs: how to get page views broken down by page?
I have a WordPress site where we didn't enable "pretty" permalinks, and thus, all pages in it have URLs in the form ?p=3921. Now, when I log into the statistics page in my hosting provider, I see that ...
1
vote
1answer
55 views
Best practices for serving multiple sites with Apache2 [closed]
I have a server with a number of virtual hosts. Over the last couple of years I have continually been improving on most parts of serving these sites, everything from how and where to do logging, how ...
1
vote
2answers
25 views
detailed access statistics for audio files
We have an external hosting company for our video files. They provide us with detailed access statistics e.g. The duration how long how many people have seen a specific video. This is quite ...
0
votes
0answers
21 views
Changed an account URL in WHM, are raw FTP logs lost? [closed]
Earlier this morning I changed an account URL in WHM for an account. Not the entire account, just the URL. I just tried to download the raw FTP logs and its telling me they're empty. I can get the ...
23
votes
1answer
4k views
Bingbot request for trafficbasedsspsitemap.xml which does not exist
The logs for a website I manage show a request for a non-existent file by Bingbot. The details of the request are
Path: /trafficbasedsspsitemap.xml
Useragent: "Mozilla/5.0 (compatible; bingbot/2.0; ...
2
votes
3answers
83 views
Awstats IIS Log configuration fields extended
Good Day:
We are implementing AwStat in our IIS Servers and after reading the documentation and browsing some googled results, we still have questions... so where's the best site for asking them? ...
2
votes
1answer
89 views
Is there a way to know if apache receives a request from a public IP not local to your country?
I'm looking for ways to know if an apache server receives a request , from another country (e.g germany) considering its a fair request (no spam , or proxies). I want it either to appear this as a ...
3
votes
1answer
124 views
Reading apache logs is there a way i can know of concurnent users limit?
I want to know on a analysis layer from apache logs which can tell me if the # of concurrent logins (using same username) has exceeded e.g more then 4.
Is such a thing can be automated or it requires ...
0
votes
1answer
44 views
Can apache logs tell between encryped and un-encrypted traffic?
Is there a way by just looking at the apache logs you can tell if the user-credentials is encrypted or not? Meaning some kind of encryption e.g ssl or plain-text.
Thanks.
0
votes
1answer
49 views
How to know in apache logs if the application has crashed?
I need some help in finding some log pattern in apache logs related to application cash? Is there a specific key word attached related to this event e.g 'crash'.
Thanks.
1
vote
1answer
61 views
Merge database statistics into google analytics
A couple of sites I administer have this situation:
Google Analytics is set up for regular traffic reporting
I have some sort of cron tab emailing/logging weekly/monthly statistics like number of ...
0
votes
1answer
64 views
Who is trying to categorize my website?
Caught this in the logs the other day:
Started GET "/verify-UncategorisedWebsite?aHR0cHM6Ly93d3=" for 198.240.130.75 at 2012-12-03 14:51:50 +0000
I bumped around a bit and couldn't find anything ...
1
vote
1answer
87 views
Alternative to Google Analytics with A/B testing and PDF scheduling
Is there a hosted solution that competes with Google Analytics and has some of the heavy hitting features:
A/B testing with regression analysis
Conversion tracking
Funnels
Schedulable reports that ...
9
votes
1answer
237 views
Clients requesting garbled URLs
I've noticed some odd 404s which appear to be broken URL rewriting code. Our image viewer requests tiles using URLs like this:
/media/204/service/dzi/1/1_files/7/0_0.jpg
I see some - well under ...
4
votes
1answer
214 views
Undefined 404's not logging
Our custom 404 page sends us Emails to notify us of broken links. We've been lately getting emails with such a missing page:
http://domain.com/undefined
However, no log entries (IIS) exist on that ...
0
votes
0answers
113 views
Malicious & nonbeneficial IP address blocks (subnets) for AdWords blocking
I'm looking for a list or lists of address blocks / subnets of potentially malicious or unfruitful / known botnets or Google scrapers. The purpose of this is to help to eliminate bot clicks / scrapes ...
5
votes
2answers
79 views
Garbled text in server logs
I recently looked over my server's logs and I found a bunch of garbled text.
Here is a link to the full log, and here is a snapshot of what it looks like:
¹^œÌÓûFF™ÃŒ-ôÚÏàÃÒNRs§cÝi ~F#J"|³Ôq0ã~QQbA ...
0
votes
1answer
56 views
Where can i get MatrixStats?
I run several IIS web servers and want to install some sort of log reader.
A lot of the big boys use MatrixStats, however a good hard Google has come up blank on who makes it and/or where I can get ...
1
vote
1answer
497 views
Apache (XAMPP 1.8.0) access.log/Intrusion Detection Concern
[I originally posted on SO but it earned me a Tumbleweed badge. This looks like a better venue for the question.]
I have Apache (XAMPP 1.8.0) running on Vista Pro x64. A couple times now I have seen ...
2
votes
2answers
375 views
Is there a modern (eg NoSQL) web analytics solution based on log files?
I have been using Awstats for many years to process my log files. But I am missing many possibilities (like cross-domain reports) and I hate being stuck with extra fields I created years ago. ...
2
votes
2answers
140 views
Why does PHP create these log entries on every page access?
My server's error log (in cPanel) has an entry for every single time a PHP page is loaded that looks like this (where 'username' has been substituted for my actual username):
[2012-06-09 09:02:07]: ...
0
votes
1answer
533 views
Why are Awstats, Webalizer, and Google Analytics results so different?
I realize that comparing Awstats and Webalizer to Google Analytics is like comparing apples to oranges, but each of them track at least basic statistics about visitors and pages.
So why are there ...
2
votes
4answers
594 views
How should I deal with user agent parsing in logs?
My web app project includes logging functionality so we can see where visitors are coming from (referrer URL), what the popular user agents are, what pages are most popular, etc. The log is stored in ...
2
votes
2answers
132 views
Is logging personally identifiable information a bad practice or violation of law?
I know we all do semi-anonymous logging (server logs, Google Analytics, etc.). However, on one of our external web applications, we have some non-reproducible errors that the external users report ...
24
votes
2answers
2k views
Files I should have on every website
I would like to have a list of files that should exist on every website. The idea is to please most browsers and bots and get down with the number of 404 messages in the logs.
So far I have the ...
4
votes
5answers
455 views
Tool for clickstream anlyzing of Apache logs?
Are there any good tools to analyze the clickstream of individual users in Apache web server logs? For example, I'd like to be able to click on a visitors IP address and see all pages the user ...
1
vote
1answer
400 views
What is a free and easy to use IIS 7 log viewer?
I have raw IIS 7 logs I'd like to look at. An excel type view where I can sort by columns is fine for now.
2
votes
2answers
310 views
What is a “SiteCon” user agent?
I've found some unusual activity in my site's Apache logs and every hit has this UserAgent string:
"Mozilla/5.0 (Windows; U; Windows NT 5.1; en-gb; SiteCon/8.8.14)"
What is SiteCon?
4
votes
1answer
120 views
Exit link tracking with timestamped logs on 3rd party content
I want to track clicks on exit links, that are placed in 3rd party content, for example on Twitter. I also need the timestamps of the clicks.
Google Analytics can't be embedded in 3rd party content.
...
1
vote
1answer
511 views
Why are nonexistant files listed in the TRANSFER log?
This snippit from my apache log reflects some piece of malware casually browsing through my site for some unknown purpose.
The most puzzling thing to me is that the GET address doesn't correspond ...
3
votes
2answers
154 views
Track actions of paying customers
I'm looking for software that can analyze my Apache log files (or some other source) and tell me, from the visitors that actually bought something from my site, some profiling information; like time ...
1
vote
1answer
337 views
http://www.example.com/http://www.example.com/ in Apache log?
I run a website, let's say www.example.com. On it I have a path and file, say www.example.com/path/file.html.
The Apache log lists GET requests like: GET /path/file.html HTTP/1.1
Which is correct, ...
6
votes
4answers
2k views
Is it possible to use Google Analytics to track file downloads?
It's always bothered me that Google Analytics (and similar embedded web traffic monitoring services) can only see a reflection of the traffic going to my server and can only see page visits since it ...
2
votes
3answers
172 views
Log File Analyser for PC
The standard log analysis tool provided by my hoster shows very limited information (trying to force me to buy a full fledged analysis package). I have downloaded the log files and would like to ...
2
votes
2answers
2k views
Apache logs: “::1 … ”OPTIONS * HTTP/1.0" 200 -
Just looking at logs of a not-so-busy site on one of our Apache servers and notice tons of these in the log:
::1 - - [15/Apr/2011:12:11:40 -0700] "OPTIONS * HTTP/1.0" 200 -
::1 - - ...
2
votes
1answer
324 views
Apache logging based on user agent
I'd like to update my apache logging so that its destination is based on the user agent string or file type.
Specifically, I would like to send my googlebot requests to their own log file, and I ...
7
votes
3answers
175 views
How should a site respond to automated login attempts with phony usernames?
For the last couple weeks I've been seeing a consistent stream of 15-30 invalid login attempts per hours on my site. Many of them are non-sensical usernames that nobody would ever register for real, ...
6
votes
3answers
246 views
How do large sites like SO handle their access logs?
i'm always wondering how large sites like SO handle their access logs. A write to the disk on every request seems a little bit uneconomical, but is Google Analytics that reliable to use it as your ...
2
votes
1answer
110 views
Is there a good way to filter all the robots and domains they are on?
I have been working more on the bot filter for my website, but by no means is it complete.
So far I have the main ones:
Google,
Yahoo,
MSN,
Baidu,
Amazon,
and a few others...
Right now, I am ...
1
vote
1answer
105 views
What is USH.HTML and why do some robot try to access it?
I have been getting quite a few hits on my webservers for the resource /USH.HTML. I have never hosted this file, and do not know what it is.
Is this a type of robots.txt file or something specific ...
3
votes
4answers
398 views
What width should the center column be in a 3 column layout?
Monitors have gotten wider over time and as a result webpages have had an ever-widening center column.
What is the current recommendation for middle column width?
Is there an organisation that ...
8
votes
4answers
144 views
Can missing anchors be logged?
If I have a broken link it gets logged with a 404. If I have a link to an anchor and the anchor is missing, I don't get an entry in the log. How can I find those broken anchor links, especially if the ...
2
votes
2answers
2k views
How can I parse Amazon S3 log files?
What are the best options for parsing Amazon S3 (Simple Storage) log files? I've turned on logging and now I have log files that look like this:
...
