Well, it appears that supervisor will not work with resque-web as it's a daemonized process. The solution was to create /etc/cron.d/resque
and put the following in it:
SHELL=/bin/bashPATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/rvm/gems/ruby-2.0.0-p195/binHOME=/* * * * * root resque-web
This runs every minute and reboots the server if it crashes. Good enough for me!