Job market confidence has fallen 42 points since mid-2022, with college graduates and younger workers the most pessimistic