Many of these people may have separated before the divorce became official, which would help explain why wealth starts falling so early. Some people may also be working less and not trying as hard to build wealth as they have marriage troubles. Divorce is often a long and messy process, and you can see this in the four-year decline in wealth.