I have a friend who lives on Orkney - I will ask her if she knows of anywhere

My friend has replied with a few ideas. I will copy and paste what she said.................

A few I have thought of are linked below. Tricky to find any within
walking distance to pub unless stay in main towns of Kirkwall or
Stromness. To be honest, some of the wee country pubs I wouldnt
recommend for honeymooners!!

http://www.bisgeos.co.uk/ - we have stayed here - it is lovely!!
Though not on mainland Orkney - a 2 hour boat trip away but so
tranquil. The wee cottage(we stayed in it) has a cosy box bed! the
medium cottage has a sauna Highly recommend this!! Lovely local
pub - best fish and chips in Orkney! Though a car trip away.

http://www.orkneycrofts.com/about

http://www.lenahowe.co.uk/index.php - not far from me!

http://www.rickla.com also close to me!

http://www.norton-cottage.co.uk lovely people who own this one -
newly done up and just 2miles from us.

http://www.highparkorkney.com/index.php

http://www.cottageguide.co.uk/kingstonhouse-orkney not seen this one
but found it online and it sounds luxurious! And within walking
distance of local pubs.

Most of these are a fair bit from pubs but certainly some of the newer
self catering places I am aware of. Hope this helps!