Despite a recent pickup in dealmaking, the industry is sitting on a backlog of at least 31,000 companies valued at $3.7 trillion.