Our reference frame is only locally inertial, where "local" means "close enough that the global geometry of spacetime can be ignored". In special relativity spacetime is flat everywhere and there is no such distinction, but in GR the same is not generally true.