This information was used to understand the problems Americans face. The consequences of its erasure, experts warn, could affect generations to come