A historic military explosive device, believed to be from World War I or World War II, was discovered Sunday afternoon inside a New Bremen residence.