Stuart Robertson has published a very neat Firefox Extension named X-Ray, which displays HTML-tags directly on a webpage. Just load a webpage, right-click on it and select "X-Ray".

It's currently Version 0.5 and only some HTML-tags are supported, but expect more to come.

Grab it here.