actually, you won't lose all of it... I pulled the filter out first once when doing an oil change and only 1/2 quart or so came out. When I unscrewed the drain plug it poured out a lot more oil. Why bother though? You'd have to have some oil to top it off anyway, might as well change it.
Edit: Maybe it's different between '03 and '07 models?