You could fit a chain tensioner in place of the rear derailleur.
If you have a rear hub which takes a cassette you could buy a single speed conversion kit containing a sprocket and some spacers. Of course you would need to remove your shifters and possibly buy some shorter chainring bolts
Something along the idea of this: