Common Log Format

For computer log management, the Common Log Format,[1] also known as the NCSA Common log format,[2] (after NCSA HTTPd) is a standardized text file format used by web servers when generating server log files.[3] Because the format is standardized, the files can be readily analyzed by a variety of web analysis programs, for example Webalizer and Analog.

Each line in a file stored in the Common Log Format has the following syntax:[4][5]

host ident authuser timestamp request-line status bytes 

The format is extended by the Combined Log Format with referer and user-agent fields.[6][5]

Example

[edit]
127.0.0.1 ident alice [01/May/2025:07:20:10 +0000] "GET /index.html HTTP/1.1" 200 9481 

A field set to dash (-) indicates missing data.

  • 127.0.0.1 is the IP address of the client (remote host) which made the request to the server.
  • ident is the RFC 1413 identity of the client, if supplied.
  • alice is the userid of the person requesting the document. Missing unless HTTP Authentication is used.
  • [01/May/2025:07:20:10 +0000] is the request timestamp. Here in strftime format %d/%b/%Y:%H:%M:%S %z.
  • "GET /index.html HTTP/1.1" is the request line from the client. The method GET, /index.html the resource requested, and HTTP/1.1 the HTTP protocol version.
  • 200 is the HTTP status code returned to the client.
  • 9481 is the response size, in bytes.

Usage

[edit]

Log files are a standard tool for computer systems developers and administrators. They record the "what happened, when, by whom" of the system. This information can record faults and help their diagnosis. It can identify security breaches and other computer misuse. It can be used for auditing. It can be used for accounting purposes.[citation needed]

The information stored is only available for later analysis if it is stored in a form that can be analysed. This data can be structured in many ways for analysis. For example, storing it in a relational database would force the data into a query-able format. However, it would also make it more difficult to retrieve if the computer crashed, and logging would not be available unless the database was available. A plain text format minimises dependencies on other system processes, and assists logging at all phases of computer operation, including start-up and shut-down, where such processes might be unavailable.[citation needed]

See also

[edit]

References

[edit]
  1. ^ "Logging in W3C httpd". World Wide Web Consortium. 1995-10-12. Retrieved 2015-04-16.
  2. ^ "Log File Formats: NCSA Common". IBM. 2004-05-19. Archived from the original on 2021-02-24. Retrieved 2013-05-07.
  3. ^ stevewhims. "NCSA Logging - Win32 apps". learn.microsoft.com. Retrieved 2023-02-17.
  4. ^ "Fusion Middleware Administrator's Guide for Oracle HTTP Server". docs.oracle.com. Oracle Corporation. Retrieved 1 May 2025.
  5. ^ a b "Log Files - Apache HTTP Server Version 2.4". httpd.apache.org. Apache Software Foundation. Retrieved 1 May 2025.
  6. ^ "Module ngx_http_log_module". nginx.org. Retrieved 1 May 2025.