I would not worry too much, if Latvia’s decline in population seems worrisome look at China or Russia! Pretty much the whole world is shrinking in terms of population ( even though we just reached 8 billion) the prognosis for next decades are pretty pretty bad for majority maybe except African countries. It’s not as much of a problem with general population size but the problem with the structure of population. At some point in not so distant future the core of every nation will be old people, who will care for them? Produce food? Maintain existing structures etc? it will be hard..