Installing Jekyll using Ruby 1.9.1 on Ubuntu 13.04 should just be

$ sudo gem install jekyll

But I get an error.

The solution is to install the dev:

$ sudo apt-get install ruby1.9.1-dev 

And it worked!