The loss of early career workers has raised concerns about the impact on the next generation of civil servants.