The cost of a Forever postage stamp has just gone up, under a U.S. Postal Service plan to boost the price of the first-class stamp to 73 cents from 68 cents — a price that was just raised in January.

For those passionate about the history and significance of stamps, investing in stamps can be more than a fulfilling hobby, offering substantial long-term returns. While stamp collecting and investing ...