As far as i know, stone will be the answer. Like the pyramids of gizeh and such stuff. Everything else will be destroyed by weathering. The pyramids will exist for many hundreds of thousand, even millions of years. Basically almost everything we build today will be destroyed pretty fast. We build in a very cheap and efficient way and nothing will last very long. Like if we would abandoned New York, there wouldnt be much left of it in 10.000 years. I believe even in 1.000 years it will be gone. Stone monuments like the people built in the past will exist for a very long time.

Oh, and satellites in the right orbit, where it takes ages for them to come closer to earth, if they manage to get to space again. Or if aliens want to visit us.

I probably forgot something but those are my answers.