curl: If-Modified-Since Command Linux / Unix Example

HTTP protocol allows a client to specify a time condition for the document it requests. It is If-Modified-Since or If-Unmodified-Since. How do I use curl Unix/Linux command line option to test a server with If-Modified-Since condition and validate Last-Modified settings?

You can use curl command to see if a copy (http resources such as text/html or image/png) that they hold is still valid. However, this will only work if response has a Last-Modified header. You can send a Last-Modified header using web server or your web application.

Step #1: Find out if response has a Last-Modified header

Type the following curl command:

curl --silent --head http://server1.cyberciti.biz/foo/bar/image.png
curl --silent --head http://server1.cyberciti.biz/foo/help.html

curl -I http://server1.cyberciti.biz/foo/bar/image.png
curl -I  http://server1.cyberciti.biz/foo/help.html

In this example, note down the Last-Modified headers in the response to this HEAD request:
$ curl -I http://www.cyberciti.biz/faq/
Sample outputs:

HTTP/1.1 200 OK
Server: nginx
Date: Tue, 11 Dec 2012 10:10:24 GMT
Content-Type: text/html; charset=UTF-8
Connection: keep-alive
X-Whom: l2-com-cyber
Last-Modified: Tue, 11 Dec 2012 10:10:23 GMT
Cache-Control: max-age=299, must-revalidate
Vary: Cookie
X-Pingback: http://www.cyberciti.biz/faq/xmlrpc.php
X-Galaxy: Andromeda-1
Vary: Accept-Encoding

The syntax is as follows to send If-Modified-Since header using the curl command line:
$ curl -I --header 'If-Modified-Since: DATE-FORMAT-HERE' http://server1.cyberciti.biz/foo/bar/image.png $ curl -I --header 'If-Modified-Since: Tue, 11 Dec 2012 10:10:24 GMT' http://www.cyberciti.biz/faq/
Sample outputs:

HTTP/1.1 304 Not Modified
Server: nginx
Date: Tue, 11 Dec 2012 10:12:11 GMT
Connection: keep-alive
X-Whom: l2-com-cyber
Vary: Cookie
Last-Modified: Tue, 11 Dec 2012 10:10:23 GMT
X-Galaxy: Andromeda-1
Vary: Accept-Encoding

The resource sends a 304 Not Modified response, indicating that it supports Last-Modified validation.

Posted by: Vivek Gite

The author is the creator of nixCraft and a seasoned sysadmin, DevOps engineer, and a trainer for the Linux operating system/Unix shell scripting. Get the latest tutorials on SysAdmin, Linux/Unix and open source topics via RSS/XML feed or weekly email newsletter.

Your support makes a big difference:

I have a small favor to ask. More people are reading the nixCraft. Many of you block advertising which is your right, and advertising revenues are not sufficient to cover my operating costs. So you can see why I need to ask for your help. The nixCraft takes a lot of my time and hard work to produce. If everyone who reads nixCraft, who likes it, helps fund it, my future would be more secure. You can donate as little as $1 to support nixCraft:

2 comment

How can you substitute the date part with a shell variable .. like this –

curl –silent -I –header ‘If-Modified-Since: “$mod”‘

Thanks

Isn’t this handled by --remote-time and --time-conf FILE ?

shiv says:
January 16, 2014 at 4:41 pm
How can you substitute the date part with a shell variable .. like this –
curl –silent -I –header ‘If-Modified-Since: “$mod”‘
Thanks
Ole says:
February 16, 2016 at 1:37 pm
Isn’t this handled by --remote-time and --time-conf FILE ?

Have a question? Post it on our forum!