Saving beyond a million dollar portfolio includes scaling back at some point. How your part-time job can support your retirement.