It depends on how much time you can spare. If you have plenty of time, I'd suggest going up to see Trollstigen and Geiranger. They are not mandatory, but pretty famous and you may want to say that you have been there :wink: And the road from there isn't too long to Aalesund, a city that burned to the ground in 1904. There is a saying in Norway, 'Before Aalesund burned', suggesting its importance in our history.
A shorter, but equally spectacular route to Sweden, would lead you out of Bergen to Vaksdal and Voss. There is an old and nice alternative road between Dale and Bulken/Voss well worth riding. From Voss you have two alternatives; south-east to Ulvik and Bruravik where you have to catch a short ferry ride to Brimnes before heading to Eidfjord. If you want to go hiking, you can climb to the glacier Hardangerjøkulen.
From Eidfjord, the road will take you to Geilo and Gol - or you could turn south towards Kongsberg. Kongsberg has an old mine open to tourists with old-style elevators taking you far down below, as well as train rides into the depth of the mountain.
If you go through Gol before turning south, you will end up in Hønefoss. From there I'd suggest you go to Eidsvoll where our constitution was written in 1814 and made official on May 17 of that year. From Eidsvoll, the natural route would go to Kongsvinger. Here the world's largest wood belt starts, stretching continuously all the way to Sibir or some far away part in Asia if my memory serves. From Kongsvinger, you have several routes into Sweden you can take.
But back to Voss. Going north would be my choice simply because the western part of Norway is a nirvana for riding and scenerey, whereas the eastern parts are mostly woods and fields. Quite boring, most of it, although not everything. Having a good map and possibly GPS will allow you to explore many of the little used backroads that offer so much more than the main roads.
As you head north, you have to decide whether you want to go the long route to Geiranger or the shorter route via Aurland. There is also a median option, heading north up to Vangsnes and catch the ferry to Leikanger, head towards Sogndal, Kaupanger, Lærdalsøyri and from there either to Aurland or towards Gol. Or Fagernes. The two latter are good routes, the former best reached without going north first.
I'd actually suggest you take the shortest route to Aurland if the trip is made during summer or autumn; then the old road to Lærdalsøyri is open, really spectacular. The new road is the world's longest tunnel and as spectacular as it is boring.
After reaching Fagernes, you can ride to Dokka and swing north to Lillehammer, home of the 1994 Winter Olympics. Then it's south to Hamar and the Viking Ship skating hall if that holds any interest before heading towards Elverum. From there you can either go north-east or south-east into Sweden.
I have also written a tour description from a 5-day trip we took last year in the area described here that perhaps can help you decide more where you want to go. It can be found here
http://www.armbell.com/forum/viewtopic.php?t=758&mforum=kz400 - it requires you log on, but it's free and simple. Who knows, you may even take an interest in air-cooled Kawasaki twins while you visit :razz:
I hope this was of some help. I'm not really into museums much, but can source info if you want; when I'm on a riding holiday - which isn't often due to family - I want to ride on the most winding roads I can find and see as much variations of nature as I can possibly cram into it.